Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Gemma 4 31B vs Mistral Large 4

The average score is effectively tied at 5.7 vs 5.7. Gemma 4 31B has the lower benchmark cost at $0.031 vs $0.290. Gemma 4 31B is faster at 7.28s vs 20.43s, with pass rates of 42.0% vs 31.9%.

Last updated at: 2026-11-13

Compared models

Rank
#352
Total Output Tokens
15,499
Response Time (avg)
7.28s
Total Cost
$0.031
Rank
#348
Total Output Tokens
54,388
Response Time (avg)
20.43s
Total Cost
$0.290
Recommended model Gemma 4 31B

It has the best score here (5.7), while costing about 9.3x less than Mistral Large 4.

Detailed comparison

Metric Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 Free Available Mistral Large 4 Mistral Large 4 none Release: 2026-10-06
Score 5.7 5.7
Rank #352 #348
Reliability 10.0 9.7
Consistency 9.6 9.3
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 42.0% 31.9%
Flaky tests 1 2
Total Runs 69 69
Cost per result 0.520 4.818
Total Cost $0.031 $0.290
Input Price $0.090 / 1M $0.680 / 1M
Output Price $0.340 / 1M $2.090 / 1M
Cache Read Price $0.050 / 1M $0.070 / 1M
Cache Write Price N/A N/A
Total Input Tokens 270,970 257,872
Output Tokens 15,499 54,388
Reasoning Tokens 0 0
Response Time (avg) 7.28s 20.43s
Response Time (max) 44.73s 192.80s
Response Time (total) 152.84s 469.88s
Parameters 30.7B 1.05T total (49B active)
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#352 Gemma 4 31B

none
Cost
$0.001
Time
12.8s
Tokens
795 tok

#348 Mistral Large 4

none
Cost
$0.005
Time
33.0s
Tokens
2,461 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 5.5 10.0 33.3% 0 11.19s 8,381 735 0
Mistral Large 4 4.7 7.5 22.2% 1 85.04s 7,431 39,805 0

Switch Comparison Pair