Advertise here
#128

GPT-5.4 Mini

OpenAI Release: 2026-03-17 Tested on: 2026-10-01 09:27 openai/gpt-5.4-mini::medium
~400B total (~17B active)MoEClosedEstimated
(medium) (none)

Summary

GPT-5.4 Mini scores 7.9 on AI BENCHY and ranks #128. It has 10.0 reliability, a 69.6% pass rate, $1.102 total cost, and 29.94s average response time.

What makes GPT-5.4 Mini unique: It stands out most in Coding, where it ranks #3, while Tool Calling is its weakest area at #15.

Model facts

Researched on 2026-08-12

Estimated
Parameters
~400B total (~17B active)
Architecture
MoE
Availability
Closed
License
-

Best estimate from public evidence; the vendor did not disclose every value. Vendor does not disclose the architecture or count.

Parameter source Availability source

Score

7.9

Consistency

8.2

Reliability

10.0

Total Cost (Current Price)

$1.102 ↑ +9.3%

Tested at: $1.008

Total Output Tokens

184,172

Total Input Tokens

238,925

Input Price

$0.750 / 1M

Output Price

$4.500 / 1M

Cache Read Price

$0.075 / 1M

Cache Write Price

N/A

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Tests Correct

Wrong Tests: 10

Attempt pass rate: 69.6%

Flaky tests

5

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

29.94s

Response Time (max): 138.75s

Response Time (total): 688.57s

Wrong answer: 6 Did not follow instructions: 3 Invalid tool call: 1

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#128 GPT-5.4 Mini

medium
Cost
$0.056
Time
95.5s
Tokens
12,464 tok

Run history

Tested on Score Reliability Tests Correct Total Cost Compare
2026-10-01 09:27 Re-test 7.9 10.0 $1.102 ↑ Current run
2026-07-16 22:38 New test added 7.5 10.0 $0.756 Compare
2026-06-04 13:47 New test added 7.5 10.0 $0.526 Compare
2026-05-22 00:21 Suite changed 7.1 10.0 $0.487 Compare
2026-04-11 01:44 First recorded run 7.3 N/A $0.299 Compare

This run used a different benchmark suite. Keep suite changes in mind when reading historical movement.

Price History

Historical pricing data for this model from OpenRouter.

Date Input Price Output Price Cache Read Price Cache Write Price
2026-08-14 12:51 $0.750 / 1M $4.500 / 1M N/A N/A
2026-10-01 18:33 $0.750 / 1M $4.500 / 1M $0.075 / 1M N/A

Charts

Choose the first model, then click a second model to open a side-by-side page.

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

GPT-5.4 MinimediumvsClaude Fable 5.1highGPT-5.4 MinimediumvsQwen3.7 MaxnoneGPT-5.4 MinimediumvsGLM 5.3 FlashXmaxGPT-5.4 MinimediumvsGemini 3.5 FlashmediumGPT-5.4 MinimediumvsQwen3.5-27BmediumGPT-5.4 MinimediumvsQwen3.8 2.4T A95BhighGPT-5.4 MinimediumvsGPT-5.6 TerralowGPT-5.4 MinimediumvsMiMo-V2.6-FlashmediumGPT-5.4 MinimediumvsQwen3.8 Flash NextlowGPT-5.4 MinimediumvsMuse Wondermax

Category Breakdown

Category Score Consistency Tests Correct
Agentic 10.0 10.0
Anti-AI Tricks 8.6 7.9
Coding 8.4 7.4
Combined 6.9 5.9
Data parsing and extraction 10.0 10.0
Domain specific 3.6 7.2
General Intelligence 4.5 10.0
Instructions following 9.8 10.0
Puzzle Solving 7.8 10.0
Tool Calling 4.7 1.6
Trivia 3.0 10.0

Compared models