Navigate
Advertise here

Mistral Large 4 vs GPT-5 Nano (medium)

The average score is effectively tied at 5.7 vs 5.7. GPT-5 Nano (medium) has the lower benchmark cost at $0.159 vs $0.290. Mistral Large 4 is faster at 20.43s vs 56.55s, with pass rates of 31.9% vs 53.6%.

Last updated at: 2026-11-18

Compared models

Rank
#369
Total Output Tokens
54,388
Response Time (avg)
20.43s
Total Cost
$0.290
Rank
#367
Total Output Tokens
307,921
Response Time (avg)
56.55s
Total Cost
$0.159
Recommended model Mistral Large 4

It has the best score here (5.7), while responding about 2.8x faster than GPT-5 Nano (medium).

Detailed comparison

Metric Mistral Large 4 Mistral Large 4 none Release: 2026-10-06 GPT-5 Nano GPT-5 Nano medium Release: 2025-08-07
Score 5.7 5.7
Rank #369 #367
Reliability 9.7 10.0
Consistency 9.3 6.5
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 31.9% 53.6%
Flaky tests 2 10
Total Runs 69 69
Cost per result 4.818 1.737
Total Cost $0.290 $0.159
Input Price $0.680 / 1M $0.050 / 1M
Output Price $2.090 / 1M $0.400 / 1M
Cache Read Price $0.070 / 1M $0.005 / 1M
Cache Write Price N/A N/A
Total Input Tokens 257,872 314,436
Output Tokens 54,388 13,578
Reasoning Tokens 0 294,343
Response Time (avg) 20.43s 56.55s
Response Time (max) 192.80s 227.89s
Response Time (total) 469.88s 961.32s
Parameters 1.05T total (49B active) ~120B total (~5B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#369 Mistral Large 4

none
Cost
$0.005
Time
33.0s
Tokens
2,461 tok

#367 GPT-5 Nano

medium
Cost
$0.006
Time
108.5s
Tokens
13,209 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Large 4 4.7 7.5 22.2% 1 85.04s 7,431 39,805 0
GPT-5 Nano 7.0 7.7 55.6% 1 41.62s 7,305 740 41,152

Switch Comparison Pair