Navigate
Advertise here

Mistral Large 4 (high) vs Inkling 2 Mini (local Q4) (low)

Inkling 2 Mini (local Q4) (low) leads on average score with 7.6 vs 7.5. Inkling 2 Mini (local Q4) (low) has the lower benchmark cost at ~$0.292 vs $1.391. Inkling 2 Mini (local Q4) (low) is faster at 153.99s vs 263.69s, with pass rates of 65.2% vs 66.7%.

Last updated at: 2026-11-22

Compared models

Rank
#209
Total Output Tokens
590,306
Response Time (avg)
263.69s
Total Cost
$1.391
Rank
#202
Total Output Tokens
129,600
Response Time (avg)
153.99s
Total Cost
~$0.292
Recommended model Inkling 2 Mini (local Q4) (low)

It has the best score here (7.6), while costing about 4.8x less than Mistral Large 4 (high).

Detailed comparison

Metric Mistral Large 4 Mistral Large 4 high Release: 2026-10-06 Inkling 2 Mini (local Q4) Inkling 2 Mini (local Q4) low Release: 2026-11-20
Score 7.5 7.6
Rank #209 #202
Reliability 9.0 9.7
Consistency 7.9 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 65.2% 66.7%
Flaky tests 6 1
Total Runs 69 69
Cost per result 11.590 ~1.946
Total Cost $1.391 ~$0.292
Input Price $0.680 / 1M N/A
Output Price $2.090 / 1M N/A
Cache Read Price $0.070 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 230,895 312,366
Output Tokens 161,281 1,631
Reasoning Tokens 510,655 127,969
Response Time (avg) 263.69s 153.99s
Response Time (max) 1727.29s 1963.67s
Response Time (total) 6064.89s 3541.85s
Parameters 1.05T total (49B active) 26.4B total (3.4B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#209 Mistral Large 4

high
Cost
$0.007
Time
53.3s
Tokens
3,333 tok

#202 Thinking Machines: Inkling 2 Mini (local Q4)

low
Cost
~$0.003
Time
85.5s
Tokens
2,977 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Large 4 3.3 4.4 33.3% 2 1277.83s 6,541 53,820 279,694
Inkling 2 Mini (local Q4) 5.3 7.2 44.4% 1 831.97s 5,668 524 34,490

Switch Comparison Pair

Seed-2.0-MinimediumvsMistral Large 4highQwen3.8 Flash NextmediumvsInkling 2 Mini (local Q4)lowMistral Large 4highvsGLM 5.1mediumMuse WonderxhighvsInkling 2 Mini (local Q4)lowSpace Bunny AlphahighvsInkling 2 Mini (local Q4)lowInkling 2 Mini (local Q4)lowvsGLM 5.1mediumMistral Large 4highvsQwen3.8 27BlowFree AvailableMistral Large 4highvsGPT-6 LunalowMistral Large 4highvsQwen3.8 Flash NextmediumMuse Glimmer 30BmediumvsInkling 2 Mini (local Q4)lowMistral Large 4highvsGPT-5.6 LunamediumSeed-2.0-MinimediumvsInkling 2 Mini (local Q4)low