Navigate
Advertise here

Mammoth 1 (default) vs D1 (default)

Mammoth 1 (default) leads on average score with 2.2 vs 1.9. Mammoth 1 (default) has the lower benchmark cost at $0.000 vs $0.003. D1 (default) is faster at 508ms vs 1.80s, with pass rates of 18.8% vs 11.6%.

Last updated at: 2026-10-24

Compared models

Rank
#442
Total Output Tokens
54
Response Time (avg)
1.80s
Total Cost
$0.000
Rank
#447
Total Output Tokens
0
Response Time (avg)
508ms
Total Cost
$0.003
Recommended model Mammoth 1 (default)

It has the strongest score in this comparison (2.2) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Mammoth 1 Mammoth 1 default Release: 2026-10-24 Free Available D1 D1 default Release: 2026-10-02
Score 2.2 1.9
Rank #442 #447
Reliability 8.9 10.0
Consistency 4.2 4.9
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 18.8% 11.6%
Flaky tests 3 1
Total Runs 36 36
Cost per result 0.000 0.112
Total Cost $0.000 $0.003
Input Price $0.000 / 1M $0.040 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A $0.040 / 1M
Cache Write Price N/A N/A
Total Input Tokens 45,468 55,956
Output Tokens 54 0
Reasoning Tokens 0 0
Response Time (avg) 1.80s 508ms
Response Time (max) 8.17s 820ms
Response Time (total) 21.63s 6.10s
Parameters 27B -
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mammoth 1 4.9 6.7 33.3% 0 951ms 25,497 12 0
D1 2.2 6.7 0.0% 0 456ms 25,605 0 0

Switch Comparison Pair

Gemini 3 Flash PreviewhighvsD1defaultMammoth 1defaultFree AvailablevsGemini 3 Flash PreviewhighMammoth 1defaultFree AvailablevsCommand A+lowMammoth 1defaultFree AvailablevsCommand A+noneMammoth 1defaultFree AvailablevsCommand A+highCommand A+lowvsD1defaultMammoth 1defaultFree AvailablevsXing4.0 29b A4bnoneFree AvailableCommand A+nonevsD1defaultMammoth 1defaultFree AvailablevsCommand A+mediumMammoth 1defaultFree AvailablevsGrok 4.20noneCommand A+highvsD1defaultD1defaultvsXing4.0 29b A4bnoneFree Available