Navigate
AI BENCHY
Advertise here

Mistral Small 4 vs Laguna XS 2.1

Laguna XS 2.1 leads on average score with 5.3 vs 5.1. Laguna XS 2.1 has the lower benchmark cost at $0.008 vs $0.022. Mistral Small 4 is faster at 1.20s vs 1.55s, with pass rates of 25.8% vs 30.3%.

Last updated at: 2026-07-28

Rank
#185
Total Output Tokens
9,812
Response Time (avg)
1.20s
Total Cost
$0.022
Rank
#180
Total Output Tokens
13,377
Response Time (avg)
1.55s
Total Cost
$0.008
Recommended model Laguna XS 2.1

It has the best score here (5.3), while costing about 3.0x less than Mistral Small 4.

Detailed comparison

Metric Mistral Small 4 Mistral Small 4 none Release: 2026-03-16 Laguna XS 2.1 Laguna XS 2.1 none Release: 2026-07-02 Free Available
Score 5.1 5.3
Rank #185 #180
Reliability 10.0 10.0
Consistency 9.6 9.0
Tests Correct
Attempt pass rate 25.8% 30.3%
Flaky tests 1 3
Total Runs 66 66
Cost per result 0.432 0.143
Total Cost $0.022 $0.008
Input Price $0.150 / 1M $0.060 / 1M
Output Price $0.600 / 1M $0.120 / 1M
Total Input Tokens 104,708 91,598
Output Tokens 9,812 13,377
Reasoning Tokens 0 0
Response Time (avg) 1.20s 1.55s
Response Time (max) 13.16s 19.02s
Response Time (total) 26.38s 34.19s

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#185 Mistral Small 4

none
Cost
$0.002
Time
10.4s
Tokens
2,370 tok

#180 Laguna XS 2.1

none
Cost
$0.001
Time
27.6s
Tokens
4,344 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.7 9.7 0.0% 0 901ms 7,636 619 0
Laguna XS 2.1 4.3 7.8 22.2% 1 623ms 7,995 562 0

Quick Compare

Switch Comparison Pair

KAT-Coder-Air V2.5lowvsLaguna XS 2.1noneFree AvailableMiniMax M2.7mediumvsMistral Small 4noneMistral Small 4nonevsLaguna S 2.1lowFree AvailableMistral Small 4nonevsLaguna S 2.1highFree AvailableMistral Small 4mediumvsLaguna XS 2.1noneFree AvailableKAT-Coder-Air V2.5lowvsMistral Small 4noneKAT-Coder-Air V2.5mediumvsLaguna XS 2.1noneFree AvailableMistral Small 4nonevsLaguna S 2.1mediumFree AvailableMiniMax M2.7mediumvsLaguna XS 2.1noneFree AvailableKAT-Coder-Air V2.5highvsLaguna XS 2.1noneFree AvailableTrinity Large ThinkinghighvsMistral Small 4noneNemotron 3 SupermediumFree AvailablevsLaguna XS 2.1noneFree Available