#33

GPT-5 Mini

OpenAI · Release: 2025-08-07 · openai/gpt-5-mini::medium

Avg Score

5.77

Cost per result

1.200

Consistency

8.80

Total Cost

$0.084

Tests Correct

7

A test is fully passed only if every run passed for that test.

Wrong Tests

7

Attempt pass rate: 57.1%

Flaky tests

2

Response time: avg 21.47s · total 300.64s · max 82.55s

Did not follow instructions: 3 Wrong answer: 3 Timed out: 1

Top Models by Score

Choose the first model, then click a second model to open a side-by-side page.

#27 GLM 5 6.08

#28 Claude Opus 4.6 6.08

#29 MiMo-V2-Flash 6.00

#30 Qwen3.5-35B-A3B 5.93

#31 GPT-5 Nano 5.86

#32 Qwen3.5-Flash 5.79

#33 GPT-5 Mini 5.77

#34 gpt-oss-120b 5.65

#35 MiniMax M2.5 5.65

#36 Gemini 2.5 Flash 5.34

#37 Qwen3.5-122B-A10B 5.20

#38 GPT-4o-mini 4.86

#39 DeepSeek V3.2 4.70

Category	Avg Score	Consistency	Tests Correct
Anti-AI Tricks	7.00	9.62	2/3
Data parsing and extraction	9.88	10.00	2/2
Domain specific	1.00	7.21	0/3
Instructions following	7.00	6.64	1/2
Puzzle Solving	4.34	9.78	1/3
Tool Calling	10.00	10.00	1/1