#36

Gemini 2.5 Flash

Google · Release: 2025-06-17 · google/gemini-2.5-flash::none

Avg Score

5.34

Cost per result

0.107

Consistency

9.40

Total Cost

$0.007

Tests Correct

6

A test is fully passed only if every run passed for that test.

Wrong Tests

8

Attempt pass rate: 47.6%

Flaky tests

1

Response time: avg 698ms · total 9.78s · max 1.91s

Wrong answer: 6 Did not follow instructions: 2

Top Models by Score

Choose the first model, then click a second model to open a side-by-side page.

#30 Qwen3.5-35B-A3B 5.93

#31 GPT-5 Nano 5.86

#32 Qwen3.5-Flash 5.79

#33 GPT-5 Mini 5.77

#34 gpt-oss-120b 5.65

#35 MiniMax M2.5 5.65

#36 Gemini 2.5 Flash 5.34

#37 Qwen3.5-122B-A10B 5.20

#38 GPT-4o-mini 4.86

#39 DeepSeek V3.2 4.70

#40 Qwen3.5-27B 4.70

#41 Qwen3.5-35B-A3B 4.63

#42 Trinity Large Preview (free) 4.34

Category	Avg Score	Consistency	Tests Correct
Anti-AI Tricks	1.00	10.00	0/3
Data parsing and extraction	9.88	10.00	2/2
Domain specific	4.00	7.21	1/3
Instructions following	8.00	9.99	1/2
Puzzle Solving	4.67	10.00	1/3
Tool Calling	10.00	10.00	1/1