Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Claude Haiku 5.5 (low) vs Gemma 4 31B (medium)

Claude Haiku 5.5 (low) leads on average score with 8.6 vs 6.9. Claude Haiku 5.5 (low) has the lower benchmark cost at $0.061 vs $0.144. Claude Haiku 5.5 (low) is faster at 7.51s vs 78.76s, with pass rates of 76.8% vs 66.7%.

Last updated at: 2026-11-13

Compared models

Rank
#104
Total Output Tokens
61,650
Response Time (avg)
7.51s
Total Cost
$0.061
Rank
#236
Total Output Tokens
277,315
Response Time (avg)
78.76s
Total Cost
$0.144
Recommended model Claude Haiku 5.5 (low)

It has the best score here (8.6), while costing about 2.4x less than Gemma 4 31B (medium).

Detailed comparison

Metric Claude Haiku 5.5 Claude Haiku 5.5 low Release: 2026-10-07 Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available
Score 8.6 6.9
Rank #104 #236
Reliability 10.0 10.0
Consistency 8.9 8.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 76.8% 66.7%
Flaky tests 3 3
Total Runs 69 69
Cost per result 0.378 1.195
Total Cost $0.061 $0.144
Input Price $0.100 / 1M $0.090 / 1M
Output Price $0.500 / 1M $0.340 / 1M
Cache Read Price $0.010 / 1M $0.050 / 1M
Cache Write Price $0.125 / 1M N/A
Total Input Tokens 296,301 251,164
Output Tokens 10,672 36,112
Reasoning Tokens 50,978 241,203
Response Time (avg) 7.51s 78.76s
Response Time (max) 44.43s 437.40s
Response Time (total) 172.74s 1653.96s
Parameters ~50B 30.7B
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#104 Claude Haiku 5.5

low
Cost
$0.001
Time
7.4s
Tokens
1,851 tok

#236 Gemma 4 31B

medium
Cost
$0.002
Time
45.7s
Tokens
2,696 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Haiku 5.5 7.9 7.5 77.8% 1 7.30s 10,608 531 11,618
Gemma 4 31B 4.3 5.8 22.2% 1 219.76s 5,568 11,098 33,212

Switch Comparison Pair