Navigate
Advertise here

Claude Haiku 5.5 (low) vs Mistral Large 4 (high)

Claude Haiku 5.5 (low) leads on average score with 8.6 vs 7.5. Claude Haiku 5.5 (low) has the lower benchmark cost at $0.061 vs $1.391. Claude Haiku 5.5 (low) is faster at 7.51s vs 263.69s, with pass rates of 76.8% vs 65.2%.

Last updated at: 2026-11-18

Compared models

Rank
#119
Total Output Tokens
61,650
Response Time (avg)
7.51s
Total Cost
$0.061
Rank
#204
Total Output Tokens
590,306
Response Time (avg)
263.69s
Total Cost
$1.391
Recommended model Claude Haiku 5.5 (low)

It has the best score here (8.6), while costing about 23.0x less than Mistral Large 4 (high).

Detailed comparison

Metric Claude Haiku 5.5 Claude Haiku 5.5 low Release: 2026-10-07 Mistral Large 4 Mistral Large 4 high Release: 2026-10-06
Score 8.6 7.5
Rank #119 #204
Reliability 10.0 9.0
Consistency 8.9 7.9
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 76.8% 65.2%
Flaky tests 3 6
Total Runs 69 69
Cost per result 0.378 11.590
Total Cost $0.061 $1.391
Input Price $0.100 / 1M $0.680 / 1M
Output Price $0.500 / 1M $2.090 / 1M
Cache Read Price $0.010 / 1M $0.070 / 1M
Cache Write Price $0.125 / 1M N/A
Total Input Tokens 296,301 230,895
Output Tokens 10,672 161,281
Reasoning Tokens 50,978 510,655
Response Time (avg) 7.51s 263.69s
Response Time (max) 44.43s 1727.29s
Response Time (total) 172.74s 6064.89s
Parameters ~50B 1.05T total (49B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#119 Claude Haiku 5.5

low
Cost
$0.001
Time
7.4s
Tokens
1,851 tok

#204 Mistral Large 4

high
Cost
$0.007
Time
53.3s
Tokens
3,333 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Haiku 5.5 7.9 7.5 77.8% 1 7.30s 10,608 531 11,618
Mistral Large 4 3.3 4.4 33.3% 2 1277.83s 6,541 53,820 279,694

Switch Comparison Pair