#16
Gemini 2.5 Flash
Google · Release: 2025-06-17 · google/gemini-2.5-flash::medium
Avg Score
7.06
Cost per result
2.762
Consistency
9.39
Total Cost
$0.249
Tests Correct
9
A test is fully passed only if every run passed for that test.
Wrong Tests
5
Attempt pass rate: 69.1%
Flaky tests
1
Response time: avg 11.74s · total 164.33s · max 95.48s
Wrong answer: 4
Did not follow instructions: 1
Top Models by Score
Choose the first model, then click a second model to open a side-by-side page.
Quick Compare
Gemini 2.5 FlashmediumvsGemini 3 Flash PreviewnoneGemini 2.5 FlashmediumvsStep 3.5 FlashmediumFree AvailableGemini 2.5 FlashmediumvsGPT-5.3 ChatnoneGemini 2.5 FlashmediumvsDeepSeek V3.2mediumGemini 2.5 FlashmediumvsGLM 5mediumGemini 2.5 FlashmediumvsGPT-5.2mediumGemini 2.5 FlashmediumvsGemini 3 Flash PreviewmediumGemini 2.5 FlashmediumvsGemini 3.1 Pro Previewmedium
Category Breakdown
| Category | Avg Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 7.34 | 10.00 | 2/3 |
| Data parsing and extraction | 9.88 | 10.00 | 2/2 |
| Domain specific | 4.00 | 7.21 | 1/3 |
| Instructions following | 7.00 | 9.91 | 1/2 |
| Puzzle Solving | 7.00 | 10.00 | 2/3 |
| Tool Calling | 10.00 | 10.00 | 1/1 |