Navigate
Advertise here

Mistral Large 4 (low) vs Qwen3.8 27B (low)

The average score is effectively tied at 7.6 vs 7.6. Qwen3.8 27B (low) has the lower benchmark cost at ~$0.089 vs $1.648. Qwen3.8 27B (low) is faster at 46.60s vs 300.15s, with pass rates of 65.2% vs 68.1%.

Last updated at: 2026-10-06

Compared models

Rank
#119
Total Output Tokens
714,287
Response Time (avg)
300.15s
Total Cost
$1.648
Rank
#122
Total Output Tokens
209,143
Response Time (avg)
46.60s
Total Cost
~$0.089
Recommended model Qwen3.8 27B (low)

It has the best score here (7.6), while costing about 18.7x less than Mistral Large 4 (low).

Detailed comparison

Metric Mistral Large 4 Mistral Large 4 low Release: 2026-10-06 Qwen3.8 27B Qwen3.8 27B low Release: 2026-08-14 Free Available
Score 7.6 7.6
Rank #119 #122
Reliability 9.0 10.0
Consistency 8.7 9.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 65.2% 68.1%
Flaky tests 4 1
Total Runs 69 69
Cost per result 12.670 ~0.589
Total Cost $1.648 ~$0.089
Input Price $0.680 / 1M N/A
Output Price $2.090 / 1M N/A
Cache Read Price $0.070 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 226,734 315,290
Output Tokens 278,013 1,607
Reasoning Tokens 638,296 207,536
Response Time (avg) 300.15s 46.60s
Response Time (max) 1798.01s 376.04s
Response Time (total) 6903.40s 1071.83s
Parameters 1.05T total (49B active) 27.3B
Availability Closed Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#119 Mistral Large 4

low
Cost
$0.015
Time
115.1s
Tokens
6,915 tok

#122 Qwen3.8 27B

low
Cost
~$0.003
Time
92.8s
Tokens
6,902 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Large 4 3.4 7.2 22.2% 1 1379.72s 5,896 129,426 386,126
Qwen3.8 27B 7.7 10.0 66.7% 0 140.92s 8,127 585 86,694

Quick Compare

Switch Comparison Pair

Qwen3.8 27BlowFree AvailablevsSpace Bunny AlphahighMistral Large 4lowvsQwen3.8 Flash NextmediumQwen3.8 27BlowFree AvailablevsGLM 5.1mediumSeed-2.0-MinimediumvsQwen3.8 27BlowFree AvailableMistral Large 4lowvsSpace Bunny AlphahighMistral Large 4lowvsGLM 5.1mediumMistral Large 4highvsQwen3.8 27BlowFree AvailableSeed-2.0-MinimediumvsMistral Large 4lowMuse Glimmer 30BmediumvsMistral Large 4lowSeed-2.0-CodehighvsQwen3.8 27BlowFree AvailableMistral Large 4lowvsQwen3.5 Plus 2026-04-20mediumMuse Glimmer 30BmediumvsQwen3.8 27BlowFree Available