#65

GPT-5.4

OpenAI · Release: 2026-03-05 · openai/gpt-5.4::none

5.9

Consistency

9.1

$0.104

Total Output Tokens

2,317

Input Price

$2.500 / 1M

Output Price

$15.000 / 1M

Wrong Tests: 11

Attempt pass rate: 42.6%

Flaky tests

2

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

1.51s

Response Time (max): 2.95s

Response Time (total): 27.21s

Wrong answer: 10 Did not follow instructions: 1

Charts

Choose the first model, then click a second model to open a side-by-side page.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

GPT-5.4nonevsSeed-2.0-Litenone GPT-5.4nonevsQwen3.5-35B-A3Bnone GPT-5.4nonevsGemma 4 26B A4BnoneFree Available GPT-5.4nonevsDeepSeek V3.2none GPT-5.4nonevsQwen3.5-Flashnone GPT-5.4nonevsMiMo-V2-Pronone GPT-5.4nonevsGemini 3 Flash Previewmedium GPT-5.4nonevsGemini 3.1 Pro Previewmedium GPT-5.4nonevsQwen3.6 Plus PreviewmediumFree Available

Category Breakdown

Category	Score	Consistency	Tests Correct
Anti-AI Tricks	3.2	8.0
Coding	10.0	10.0
Combined	3.0	10.0
Data parsing and extraction	10.0	10.0
Domain specific	5.3	7.2
General Intelligence	4.4	9.9
Instructions following	6.5	10.0
Puzzle Solving	5.6	9.8
Tool Calling	10.0	10.0

Compared models