Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Mistral: Mistral Small 4 vs OpenAI: GPT-5.5

Summary

Mistral Small 4 vs GPT-5.5 benchmark comparison: GPT-5.5 leads on average score with 9.3 vs 5.1. Mistral Small 4 has the lower benchmark cost at $0.007 vs $0.907. Mistral Small 4 is faster at 630ms vs 9.76s, with pass rates of 27.0% vs 85.7%.

Recommended model: Mistral Small 4 - It offers the best overall trade-off: a competitive score (5.1), lower cost than GPT-5.5, and balanced response time.

Last updated at: 2026-06-12

Metric Mistral Small 4 Mistral Small 4 none Release: 2026-03-16 GPT-5.5 GPT-5.5 low Release: 2026-04-24
Score 5.1 9.3
Rank #136 #5
Reliability 10.0 10.0
Consistency 9.5 10.0
Tests Correct
Attempt pass rate 27.0% 85.7%
Flaky tests 1 0
Total Runs 63 63
Cost per result 0.139 5.035
Total Cost $0.007 $0.907
Input Price $0.150 / 1M $5.000 / 1M
Output Price $0.600 / 1M $30.000 / 1M
Total Input Tokens 37,309 34,209
Output Tokens 2,201 2,046
Reasoning Tokens 0 22,460
Response Time (avg) 630ms 9.76s
Response Time (max) 1.72s 56.19s
Response Time (total) 13.22s 204.92s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#136 Mistral Small 4

none
Cost
$0.002
Time
10.4s
Tokens
2,370 tok

#5 GPT-5.5

low
Cost
$0.068
Time
37.0s
Tokens
2,339 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.4 7.9 16.7% 1 395ms 708 182 0
GPT-5.5 10.0 10.0 100.0% 0 4.41s 606 238 1,020
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.7 9.7 0.0% 0 901ms 7,636 619 0
GPT-5.5 10.0 10.0 100.0% 0 15.04s 7,302 423 6,402
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 1.72s 11,640 496 0
GPT-5.5 10.0 10.0 100.0% 0 9.56s 11,019 303 717
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 822ms 7,914 261 0
GPT-5.5 10.0 10.0 100.0% 0 3.28s 7,140 228 157
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 5.3 10.0 33.3% 0 367ms 798 28 0
GPT-5.5 5.3 10.0 33.3% 0 28.05s 723 69 11,609
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 4.0 10.0 0.0% 0 729ms 519 205 0
GPT-5.5 10.0 10.0 100.0% 0 5.17s 477 133 245
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 6.5 10.0 50.0% 0 380ms 729 69 0
GPT-5.5 9.9 10.0 100.0% 0 3.74s 660 93 415
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.1 9.9 0.0% 0 399ms 735 111 0
GPT-5.5 10.0 10.0 100.0% 0 4.74s 642 279 954
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 1.40s 6,420 213 0
GPT-5.5 10.0 10.0 100.0% 0 4.96s 5,445 250 101
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 397ms 210 17 0
GPT-5.5 3.0 10.0 0.0% 0 10.06s 195 30 840

Quick Compare

Switch Comparison Pair

GPT-5.5lowvsQwen3.7 MaxmediumMiniMax M2.7mediumvsMistral Small 4noneClaude Fable 5mediumvsGPT-5.5lowGemini 3.1 Pro PreviewmediumvsGPT-5.5lowGemini 3.5 FlashmediumvsGPT-5.5lowCobuddymediumvsMistral Small 4noneGemini 3 Flash PreviewmediumvsGPT-5.5lowMiniMax M2.5mediumvsMistral Small 4noneGPT-5.5lowvsQwen3.6 Max PreviewmediumMistral Small 4nonevsQwen3 Coder NextmediumClaude Opus 4.8mediumvsGPT-5.5lowGemini 3.5 FlashhighvsGPT-5.5low