Navigate
Advertise here

Gemini 2.5 Flash vs Granite 4.2 8B (low)

Gemini 2.5 Flash leads on average score with 5.5 vs 5.3. Gemini 2.5 Flash has the lower benchmark cost at $0.017 vs $0.036. Gemini 2.5 Flash is faster at 6.00s vs 58.20s, with pass rates of 37.7% vs 33.3%.

Last updated at: 2026-10-02

Compared models

Rank
#269
Total Output Tokens
1,890
Response Time (avg)
6.00s
Total Cost
$0.017
Rank
#283
Total Output Tokens
61,351
Response Time (avg)
58.20s
Total Cost
$0.036
Recommended model Gemini 2.5 Flash

It has the best score here (5.5), while costing about 2.1x less than Granite 4.2 8B (low).

Detailed comparison

Metric Gemini 2.5 Flash Gemini 2.5 Flash none Release: 2025-06-17 Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02
Score 5.5 5.3
Rank #269 #283
Reliability 10.0 9.2
Consistency 9.6 9.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 37.7% 33.3%
Flaky tests 1 1
Total Runs 69 69
Cost per result 0.209 0.508
Total Cost $0.017 $0.036
Input Price $0.300 / 1M $0.060 / 1M
Output Price $2.500 / 1M $0.250 / 1M
Cache Read Price $0.030 / 1M $0.015 / 1M
Cache Write Price $0.084 / 1M N/A
Total Input Tokens 39,886 332,917
Output Tokens 1,890 18,989
Reasoning Tokens 0 42,362
Response Time (avg) 6.00s 58.20s
Response Time (max) 118.00s 566.80s
Response Time (total) 138.04s 1338.65s
Parameters ~350B total (~20B active) 8B
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#269 Gemini 2.5 Flash

none
Invalid SVG
Cost
$0.164
Time
215.5s
Tokens
65,659 tok

#283 IBM: Granite 4.2 8B

low
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 2.5 Flash 5.5 10.0 33.3% 0 736ms 8,122 483 0
Granite 4.2 8B 5.5 10.0 33.3% 0 13.01s 8,439 2,469 2,984

Quick Compare

Switch Comparison Pair