Navigate
Advertise here

Mistral Small 4 vs Inkling Small (low)

Inkling Small (low) leads on average score with 5.2 vs 5.1. Mistral Small 4 has the lower benchmark cost at $0.047 vs $0.059. Inkling Small (low) is faster at 1.99s vs 3.12s, with pass rates of 24.6% vs 47.8%.

Last updated at: 2026-10-01

Compared models

Rank
#292
Total Output Tokens
10,913
Response Time (avg)
3.12s
Total Cost
$0.047
Rank
#285
Total Output Tokens
14,686
Response Time (avg)
1.99s
Total Cost
$0.059
Recommended model Inkling Small (low)

It has the best score here (5.2), while responding about 1.6x faster than Mistral Small 4.

Detailed comparison

Metric Mistral Small 4 Mistral Small 4 none Release: 2026-03-16 Inkling Small Inkling Small low Release: 2026-08-01 Free Available
Score 5.1 5.2
Rank #292 #285
Reliability 10.0 10.0
Consistency 9.6 8.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 24.6% 47.8%
Flaky tests 1 4
Total Runs 69 69
Cost per result 0.928 0.649
Total Cost $0.047 $0.059
Input Price $0.150 / 1M $0.450 / 1M
Output Price $0.600 / 1M $1.200 / 1M
Total Input Tokens 265,602 81,447
Output Tokens 10,913 2,715
Reasoning Tokens 0 11,971
Response Time (avg) 3.12s 1.99s
Response Time (max) 45.46s 5.82s
Response Time (total) 71.87s 45.67s
Parameters 119B total (6B active) 276B total (12B active)
Availability Open source Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#292 Mistral Small 4

none
Cost
$0.002
Time
10.4s
Tokens
2,370 tok

#285 Thinking Machines: Inkling Small

low
Cost
$0.001
Time
5.9s
Tokens
759 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.7 9.7 0.0% 0 901ms 7,636 619 0
Inkling Small 4.6 5.0 33.3% 2 3.70s 7,374 375 4,332

Quick Compare

Switch Comparison Pair

Mercury 2.5lowvsMistral Small 4noneLing 3.0 FlashnonevsInkling SmalllowFree AvailableKAT Coder AIR V2.5mediumvsMistral Small 4noneNemotron 3.5 LightninghighFree AvailablevsInkling SmalllowFree AvailableKAT Coder AIR V2.5highvsInkling SmalllowFree AvailableKAT Coder AIR V2.5highvsMistral Small 4noneQwen3.6 35B A3BnonevsInkling SmalllowFree AvailableLaguna XS 2.1noneFree AvailablevsInkling SmalllowFree AvailableMistral Small 4nonevsNemotron 3.5 LightninghighFree AvailableMistral Small 4nonevsLaguna S 2.1mediumFree AvailableMistral Small 4mediumvsInkling SmalllowFree AvailableKimi K2.5nonevsInkling SmalllowFree Available