Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.2 Chat vs OpenAI: GPT-5.4

Last updated at: 2026-03-15

Metric GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11 GPT-5.4 GPT-5.4 medium Release: 2026-03-05
Rank #17 #9
Score 8.0 8.5
Consistency 9.1 8.5
Cost per result 2.440 6.601
Total Cost $0.269 $0.793
Tests Correct
Attempt pass rate 75.0% 83.3%
Flaky tests 2 3
Total Runs 48 48
Output Tokens 15,845 1,756
Reasoning Tokens 0 46,642
Response Time (avg) 7.03s 20.05s
Response Time (max) 38.52s 100.41s
Response Time (total) 112.51s 320.87s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 3.97s 1,651 0
GPT-5.4 10.0 10.0 100.0% 0 5.02s 216 1,466
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 9.12s 1,243 0
GPT-5.4 10.0 10.0 100.0% 0 20.57s 301 3,543
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 3.05s 980 0
GPT-5.4 10.0 10.0 100.0% 0 5.32s 234 804
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 5.3 10.0 33.3% 0 17.78s 7,810 0
GPT-5.4 5.3 7.2 44.4% 1 74.27s 61 34,748
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 4.4 3.0 33.3% 1 3.20s 335 0
GPT-5.4 4.7 3.1 33.3% 1 4.92s 145 321
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 7.5 6.1 83.3% 1 5.46s 1,528 0
GPT-5.4 10.0 10.0 100.0% 0 3.11s 93 897
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 7.7 10.0 66.7% 0 4.42s 1,743 0
GPT-5.4 8.2 7.2 88.9% 1 9.13s 442 3,832
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 4.68s 555 0
GPT-5.4 10.0 10.0 100.0% 0 13.28s 264 1,031

Quick Compare

Switch Comparison Pair

Gemini 3.1 Flash Lite PreviewmediumvsGPT-5.2 ChatnoneGemini 2.5 FlashmediumvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsMiMo-V2-FlashmediumGPT-5.2 ChatnonevsGLM 5 TurbomediumDeepSeek V3.2mediumvsGPT-5.2 ChatnoneGemini 3.1 Flash Lite PreviewlowvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsQwen3.5-FlashmediumGPT-5.2 ChatnonevsGrok 4.20 BetamediumGPT-5.2 ChatnonevsGLM 5mediumGemini 3 Flash PreviewlowvsGPT-5.4mediumGPT-5.2 ChatnonevsStep 3.5 FlashmediumFree AvailableClaude Sonnet 4.6mediumvsGPT-5.2 Chatnone