Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Gemini 2.5 Flash vs Step 3.5 Flash (medium)

Gemini 2.5 Flash leads on average score with 5.5 vs 5.4. Gemini 2.5 Flash has the lower benchmark cost at $0.017 vs $0.105. Gemini 2.5 Flash is faster at 6.00s vs 190.48s, with pass rates of 37.7% vs 49.3%.

Last updated at: 2026-11-17

Compared models

Rank
#381
Total Output Tokens
1,890
Response Time (avg)
6.00s
Total Cost
$0.017
Rank
#391
Total Output Tokens
454,482
Response Time (avg)
190.48s
Total Cost
$0.105
Recommended model Gemini 2.5 Flash

It has the best score here (5.5), while costing about 6.3x less than Step 3.5 Flash (medium).

Detailed comparison

Metric Gemini 2.5 Flash Gemini 2.5 Flash none Release: 2025-06-17 Step 3.5 Flash Step 3.5 Flash medium Release: 2026-02-01
Score 5.5 5.4
Rank #381 #391
Reliability 10.0 10.0
Consistency 9.6 8.3
Attempts 69/69 66/69
Tests Correct
Attempt pass rate 37.7% 49.3%
Flaky tests 1 3
Total Runs 69 66
Cost per result 0.209 1.047
Total Cost $0.017 $0.105
Input Price $0.300 / 1M $0.100 / 1M
Output Price $2.500 / 1M $0.300 / 1M
Cache Read Price $0.030 / 1M N/A
Cache Write Price $0.084 / 1M N/A
Total Input Tokens 39,886 139,086
Output Tokens 1,890 193,584
Reasoning Tokens 0 413,546
Response Time (avg) 6.00s 190.48s
Response Time (max) 118.00s 1597.85s
Response Time (total) 138.04s 3238.23s
Parameters ~350B total (~20B active) 196B total (11B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#381 Gemini 2.5 Flash

none
Invalid SVG
Cost
$0.164
Time
215.5s
Tokens
65,659 tok

#391 Step 3.5 Flash

medium
Cost
$0.008
Time
277.1s
Tokens
23,695 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 2.5 Flash 5.5 10.0 33.3% 0 736ms 8,122 483 0
Step 3.5 Flash 2.4 5.2 0.0% 0 258.38s 2,211 13,207 22,429

Switch Comparison Pair