#7
GPT-5.4
OpenAI · Release: 2026-03-05 · openai/gpt-5.4::medium
Avg Score
82
Cost per result
6.533
Consistency
89
Total Cost
$0.784
Tests Correct
12
A test is fully passed only if every run passed for that test.
Wrong Tests
3
Attempt pass rate: 86.7%
Flaky tests
2
Response time: avg 21.06s · total 315.95s · max 100.41s
Wrong answer: 2 Did not follow instructions: 1
Top Models by Score
Choose the first model, then click a second model to open a side-by-side page.
Quick Compare
GPT-5.4mediumvsQwen3.5-122B-A10BmediumGPT-5.4mediumvsGemini 3 Flash PreviewlowGPT-5.4mediumvsQwen3.5-27BmediumGPT-5.4mediumvsGemini 3 Pro PreviewmediumGPT-5.4mediumvsGPT-5.3-CodexmediumGPT-5.4mediumvsGemini 3.1 Flash Lite PreviewhighGPT-5.4mediumvsGemini 3 Flash PreviewmediumGPT-5.4mediumvsGemini 3.1 Pro PreviewmediumGPT-5.4mediumvsStep 3.5 FlashmediumFree Available
Category Breakdown
| Category | Avg Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 100 | 100 | 3/3 |
| Combined | 100 | 100 | 1/1 |
| Data parsing and extraction | 99 | 100 | 2/2 |
| Domain specific | 40 | 72 | 1/3 |
| Instructions following | 100 | 100 | 2/2 |
| Puzzle Solving | 70 | 72 | 2/3 |
| Tool Calling | 100 | 100 | 1/1 |