Navigate
Advertise here

Mammoth 1 (default) vs Kev 4B (default)

Kev 4B (default) leads on average score with 2.4 vs 2.2. Mammoth 1 (default) has the lower benchmark cost at $0.000 vs $0.002. Mammoth 1 (default) is faster at 1.80s vs 5.63s, with pass rates of 18.8% vs 15.9%.

Last updated at: 2026-10-24

Compared models

Rank
#442
Total Output Tokens
54
Response Time (avg)
1.80s
Total Cost
$0.000
Rank
#440
Total Output Tokens
28,061
Response Time (avg)
5.63s
Total Cost
$0.002
Recommended model Kev 4B (default)

It has the strongest score in this comparison (2.4) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Mammoth 1 Mammoth 1 default Release: 2026-10-24 Free Available Kev 4B Kev 4B default Release: 2026-09-28
Score 2.2 2.4
Rank #442 #440
Reliability 8.9 10.0
Consistency 4.2 4.9
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 18.8% 15.9%
Flaky tests 3 1
Total Runs 36 36
Cost per result 0.000 0.060
Total Cost $0.000 $0.002
Input Price $0.000 / 1M $0.042 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 45,468 42,804
Output Tokens 54 28,061
Reasoning Tokens 0 0
Response Time (avg) 1.80s 5.63s
Response Time (max) 8.17s 17.79s
Response Time (total) 21.63s 67.61s
Parameters 27B 4B
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mammoth 1 4.9 6.7 33.3% 0 951ms 25,497 12 0
Kev 4B 4.5 6.7 33.3% 0 771ms 21,603 12,207 0

Switch Comparison Pair

Mammoth 1defaultFree AvailablevsGemini 3 Flash PreviewhighCommand A+lowvsKev 4BdefaultCommand A+nonevsKev 4BdefaultGemini 3 Flash PreviewhighvsKev 4BdefaultCommand A+highvsKev 4BdefaultMammoth 1defaultFree AvailablevsCommand A+lowMammoth 1defaultFree AvailablevsCommand A+noneKev 4BdefaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsKev 4BdefaultKev 4BdefaultvsGrok 4.20noneMammoth 1defaultFree AvailablevsCommand A+highMammoth 1defaultFree AvailablevsXing4.0 29b A4bnoneFree Available