#21

Gemini 3.5 Flash

Google Release: 2026-05-19 Tested on: 2026-05-19 23:35 google/gemini-3.5-flash::minimal

(high) (medium) (low) (minimal) (none)

8.1

Consistency

9.6

10.0

$0.070

Total Output Tokens

2,262

Input Price

$1.500 / 1M

Output Price

$9.000 / 1M

Wrong Tests: 5

Attempt pass rate: 75.4%

Flaky tests

1

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

1.37s

Response Time (max): 3.56s

Response Time (total): 26.04s

Wrong answer: 4 Invalid tool call: 1

Charts

Choose the first model, then click a second model to open a side-by-side page.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Gemini 3.5 FlashminimalvsQwen3.5 Plus 2026-02-15medium Gemini 3.5 FlashminimalvsGemma 4 31BmediumFree Available Gemini 3.5 FlashminimalvsSeed-2.0-Litemedium Gemini 3.5 FlashminimalvsGemini 3 PRO Previewmedium Gemini 3.5 FlashminimalvsGemini 3 Flash Previewmedium Gemini 3.5 FlashminimalvsGemini 3.5 Flashlow Gemini 3.5 FlashminimalvsRing-2.6-1Tmedium

Category Breakdown

Category	Score	Consistency	Tests Correct
Anti-AI Tricks	6.5	10.0
Coding	10.0	10.0
Combined	3.0	10.0
Data parsing and extraction	10.0	10.0
Domain specific	10.0	10.0
General Intelligence	10.0	10.0
Instructions following	6.4	5.8
Puzzle Solving	10.0	10.0
Tool Calling	10.0	10.0
Trivia	3.0	10.0

Compared models