Navigate
Advertise here

Gemini 2.5 Flash vs Hy4 preview (low)

Gemini 2.5 Flash leads on average score with 5.5 vs 5.4. Gemini 2.5 Flash has the lower benchmark cost at $0.017 vs $1.844. Gemini 2.5 Flash is faster at 6.00s vs 207.21s, with pass rates of 37.7% vs 21.7%.

Last updated at: 2026-11-13

Compared models

Rank
#364
Total Output Tokens
1,890
Response Time (avg)
6.00s
Total Cost
$0.017
Rank
#372
Total Output Tokens
687,477
Response Time (avg)
207.21s
Total Cost
$1.844
Recommended model Gemini 2.5 Flash

It has the best score here (5.5), while costing about 110.5x less than Hy4 preview (low).

Detailed comparison

Metric Gemini 2.5 Flash Gemini 2.5 Flash none Release: 2025-06-17 Hy4 preview Hy4 preview low Release: 2026-08-29
Score 5.5 5.4
Rank #364 #372
Reliability 10.0 6.5
Consistency 9.6 8.2
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 37.7% 21.7%
Flaky tests 1 4
Total Runs 69 69
Cost per result 0.209 61.455
Total Cost $0.017 $1.844
Input Price $0.300 / 1M $0.751 / 1M
Output Price $2.500 / 1M $2.251 / 1M
Cache Read Price $0.030 / 1M $0.038 / 1M
Cache Write Price $0.084 / 1M N/A
Total Input Tokens 39,886 162,180
Output Tokens 1,890 5,030
Reasoning Tokens 0 682,447
Response Time (avg) 6.00s 207.21s
Response Time (max) 118.00s 597.45s
Response Time (total) 138.04s 4765.91s
Parameters ~350B total (~20B active) 770B total (49B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#364 Gemini 2.5 Flash

none
Invalid SVG
Cost
$0.164
Time
215.5s
Tokens
65,659 tok

#372 Hy4 preview

low
Provider returned error
Cost
$0.000
Time
1.1s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 2.5 Flash 5.5 10.0 33.3% 0 736ms 8,122 483 0
Hy4 preview 5.2 8.6 0.0% 0 219.15s 6,110 135 96,407

Switch Comparison Pair