Navigate
Advertise here

Mammoth 1 (default) vs Jev 1.14 (default)

Jev 1.14 (default) leads on average score with 2.3 vs 2.2. Mammoth 1 (default) has the lower benchmark cost at $0.000 vs $0.003. Jev 1.14 (default) is faster at 377ms vs 1.80s, with pass rates of 18.8% vs 23.2%.

Last updated at: 2026-10-24

Compared models

Rank
#442
Total Output Tokens
54
Response Time (avg)
1.80s
Total Cost
$0.000
Rank
#441
Total Output Tokens
18,927
Response Time (avg)
377ms
Total Cost
$0.003
Recommended model Jev 1.14 (default)

It has the best score here (2.3), while responding about 4.8x faster than Mammoth 1 (default).

Detailed comparison

Metric Mammoth 1 Mammoth 1 default Release: 2026-10-24 Free Available Jev 1.14 Jev 1.14 default Release: 2026-10-15
Score 2.2 2.3
Rank #442 #441
Reliability 8.9 10.0
Consistency 4.2 4.5
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 18.8% 23.2%
Flaky tests 3 2
Total Runs 36 36
Cost per result 0.000 0.071
Total Cost $0.000 $0.003
Input Price $0.000 / 1M $0.042 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 45,468 67,092
Output Tokens 54 18,927
Reasoning Tokens 0 0
Response Time (avg) 1.80s 377ms
Response Time (max) 8.17s 546ms
Response Time (total) 21.63s 4.52s
Parameters 27B -
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mammoth 1 4.9 6.7 33.3% 0 951ms 25,497 12 0
Jev 1.14 2.7 3.9 22.2% 1 403ms 30,072 8,130 0

Switch Comparison Pair

Mammoth 1defaultFree AvailablevsGemini 3 Flash PreviewhighGemini 3 Flash PreviewhighvsJev 1.14defaultCommand A+lowvsJev 1.14defaultCommand A+nonevsJev 1.14defaultMammoth 1defaultFree AvailablevsCommand A+lowMammoth 1defaultFree AvailablevsCommand A+noneCommand A+highvsJev 1.14defaultMammoth 1defaultFree AvailablevsCommand A+highJev 1.14defaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsJev 1.14defaultJev 1.14defaultvsGrok 4.20noneMammoth 1defaultFree AvailablevsXing4.0 29b A4bnoneFree Available