Navigate
Advertise here

Mistral Large 4 (high) vs Qwen3.8 27B (low)

Qwen3.8 27B (low) leads on average score with 7.6 vs 7.5. Qwen3.8 27B (low) has the lower benchmark cost at ~$0.089 vs $1.391. Qwen3.8 27B (low) is faster at 46.60s vs 263.69s, with pass rates of 65.2% vs 68.1%.

Last updated at: 2026-10-06

Compared models

Rank
#126
Total Output Tokens
590,306
Response Time (avg)
263.69s
Total Cost
$1.391
Rank
#122
Total Output Tokens
209,143
Response Time (avg)
46.60s
Total Cost
~$0.089
Recommended model Qwen3.8 27B (low)

It has the best score here (7.6), while costing about 15.7x less than Mistral Large 4 (high).

Detailed comparison

Metric Mistral Large 4 Mistral Large 4 high Release: 2026-10-06 Qwen3.8 27B Qwen3.8 27B low Release: 2026-08-14 Free Available
Score 7.5 7.6
Rank #126 #122
Reliability 9.0 10.0
Consistency 7.9 9.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 65.2% 68.1%
Flaky tests 6 1
Total Runs 69 69
Cost per result 11.590 ~0.589
Total Cost $1.391 ~$0.089
Input Price $0.680 / 1M N/A
Output Price $2.090 / 1M N/A
Cache Read Price $0.070 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 230,895 315,290
Output Tokens 161,281 1,607
Reasoning Tokens 510,655 207,536
Response Time (avg) 263.69s 46.60s
Response Time (max) 1727.29s 376.04s
Response Time (total) 6064.89s 1071.83s
Parameters 1.05T total (49B active) 27.3B
Availability Closed Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#126 Mistral Large 4

high
Cost
$0.007
Time
53.3s
Tokens
3,333 tok

#122 Qwen3.8 27B

low
Cost
~$0.003
Time
92.8s
Tokens
6,902 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Large 4 3.3 4.4 33.3% 2 1277.83s 6,541 53,820 279,694
Qwen3.8 27B 7.7 10.0 66.7% 0 140.92s 8,127 585 86,694

Quick Compare

Switch Comparison Pair

Seed-2.0-MinimediumvsMistral Large 4highQwen3.8 27BlowFree AvailablevsSpace Bunny AlphahighQwen3.8 27BlowFree AvailablevsGLM 5.1mediumMistral Large 4highvsGLM 5.1mediumSeed-2.0-MinimediumvsQwen3.8 27BlowFree AvailableMistral Large 4highvsGPT-6 LunalowMistral Large 4highvsQwen3.8 Flash NextmediumMistral Large 4highvsGPT-5.6 LunamediumMistral Large 4highvsQwen3.6 FlashmediumDeepSeek V4 Flash 0731lowvsMistral Large 4highSeed-2.0-CodehighvsQwen3.8 27BlowFree AvailableSeed-2.0-CodemediumvsMistral Large 4high