Navigate
Advertise here

Claude Haiku 5.5 (max) vs Gemini 3.7 Flash (low)

Gemini 3.7 Flash (low) leads on average score with 9.4 vs 8.5. Gemini 3.7 Flash (low) has the lower benchmark cost at $0.183 vs $0.509. Gemini 3.7 Flash (low) is faster at 6.24s vs 61.71s, with pass rates of 85.5% vs 95.7%.

Last updated at: 2026-10-07

Compared models

Rank
#70
Total Output Tokens
919,699
Response Time (avg)
61.71s
Total Cost
$0.509
Rank
#25
Total Output Tokens
38,453
Response Time (avg)
6.24s
Total Cost
$0.183
Recommended model Gemini 3.7 Flash (low)

It has the best score here (9.4), while costing about 2.8x less than Claude Haiku 5.5 (max).

Detailed comparison

Metric Claude Haiku 5.5 Claude Haiku 5.5 max Release: 2026-10-07 Gemini 3.7 Flash Gemini 3.7 Flash low Release: 2026-08-14
Score 8.5 9.4
Rank #70 #25
Reliability 10.0 10.0
Consistency 9.6 9.3
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 85.5% 95.7%
Flaky tests 1 2
Total Runs 69 69
Cost per result 2.677 0.868
Total Cost $0.509 $0.183
Input Price $0.100 / 1M $0.750 / 1M
Output Price $0.500 / 1M $3.750 / 1M
Cache Read Price $0.010 / 1M $0.075 / 1M
Cache Write Price $0.125 / 1M $0.042 / 1M
Total Input Tokens 487,516 188,519
Output Tokens 10,212 7,694
Reasoning Tokens 909,487 30,759
Response Time (avg) 61.71s 6.24s
Response Time (max) 288.94s 58.75s
Response Time (total) 1419.40s 143.56s
Parameters ~50B ~500B total (~20B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#70 Claude Haiku 5.5

max
OpenRouter returned no showcase content (finish_reason: error).
Cost
$0.000
Time
164.5s
Tokens
0 tok

#25 Gemini 3.7 Flash

low
Cost
$0.010
Time
23.5s
Tokens
5,210 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Haiku 5.5 10.0 10.0 100.0% 0 55.87s 10,608 532 125,988
Gemini 3.7 Flash 7.6 7.2 77.8% 1 6.20s 8,118 461 11,508

Quick Compare

Switch Comparison Pair

Claude Opus 5highvsGemini 3.7 FlashlowClaude Opus 5mediumvsGemini 3.7 FlashlowClaude Haiku 5.5maxvsQwen3.7 MaxmediumClaude Haiku 5.5maxvsMuse Spark 1.3lowClaude Opus 5.5highvsGemini 3.7 FlashlowClaude Haiku 5.5maxvsGrok 4.6highClaude Haiku 5.5maxvsQwen3.8 2.4T A95BlowClaude Haiku 5.5maxvsGPT-5 MinimediumClaude Haiku 5.5maxvsMuse Glimmer 30BxhighClaude Haiku 5.5maxvsGemini 3.1 Pro PreviewmediumClaude Haiku 5.5maxvsQwen3.8 Max (0902)lowClaude Haiku 5.5maxvsInklinghighFree Available