Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Mammoth 1 (default) vs Drex v1.5 (default)

Drex v1.5 (default) leads on average score with 2.4 vs 2.2. Mammoth 1 (default) has the lower benchmark cost at $0.000 vs $0.002. Drex v1.5 (default) is faster at 986ms vs 1.80s, with pass rates of 18.8% vs 17.4%.

Last updated at: 2026-10-24

Compared models

Rank
#442
Total Output Tokens
54
Response Time (avg)
1.80s
Total Cost
$0.000
Rank
#438
Total Output Tokens
27,468
Response Time (avg)
986ms
Total Cost
$0.002
Recommended model Drex v1.5 (default)

It has the best score here (2.4), while responding about 1.8x faster than Mammoth 1 (default).

Detailed comparison

Metric Mammoth 1 Mammoth 1 default Release: 2026-10-24 Free Available Drex v1.5 Drex v1.5 default Release: 2026-10-12
Score 2.2 2.4
Rank #442 #438
Reliability 8.9 10.0
Consistency 4.2 5.2
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 18.8% 17.4%
Flaky tests 3 0
Total Runs 36 36
Cost per result 0.000 0.043
Total Cost $0.000 $0.002
Input Price $0.000 / 1M $0.040 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 45,468 42,804
Output Tokens 54 27,468
Reasoning Tokens 0 0
Response Time (avg) 1.80s 986ms
Response Time (max) 8.17s 1.38s
Response Time (total) 21.63s 11.84s
Parameters 27B 8.95B
Availability Open source Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mammoth 1 4.9 6.7 33.3% 0 951ms 25,497 12 0
Drex v1.5 4.5 6.7 33.3% 0 794ms 21,603 12,192 0

Switch Comparison Pair

Mammoth 1defaultFree AvailablevsGemini 3 Flash PreviewhighCommand A+lowvsDrex v1.5defaultCommand A+nonevsDrex v1.5defaultGemini 3 Flash PreviewhighvsDrex v1.5defaultCommand A+highvsDrex v1.5defaultMammoth 1defaultFree AvailablevsCommand A+lowMammoth 1defaultFree AvailablevsCommand A+noneDrex v1.5defaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsDrex v1.5defaultDrex v1.5defaultvsGrok 4.20noneMammoth 1defaultFree AvailablevsCommand A+highMammoth 1defaultFree AvailablevsXing4.0 29b A4bnoneFree Available