Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.2 Chat vs OpenAI: GPT-5.4 Nano

Last updated at: 2026-03-17

Metric GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11 GPT-5.4 Nano GPT-5.4 Nano medium Release: 2026-03-17
Rank #24 #28
Score 7.8 7.4
Consistency 8.6 9.0
Cost per result 2.462 0.769
Total Cost $0.271 $0.077
Tests Correct
Attempt pass rate 74.5% 66.7%
Flaky tests 3 2
Total Runs 51 51
Output Tokens 16,001 2,474
Reasoning Tokens 0 54,516
Response Time (avg) 6.72s 11.08s
Response Time (max) 38.52s 94.06s
Response Time (total) 114.20s 188.39s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 8.7 7.9 91.7% 1 3.40s 1,807 0
GPT-5.4 Nano 8.3 10.0 75.0% 0 4.52s 683 2,254
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 9.12s 1,243 0
GPT-5.4 Nano 9.8 10.0 100.0% 0 24.13s 349 5,719
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 3.05s 980 0
GPT-5.4 Nano 10.0 10.0 100.0% 0 2.54s 234 516
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 5.3 10.0 33.3% 0 17.78s 7,810 0
GPT-5.4 Nano 5.9 7.2 55.6% 1 38.18s 60 43,325
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 4.4 3.0 33.3% 1 3.20s 335 0
GPT-5.4 Nano 4.5 10.0 0.0% 0 4.15s 179 443
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 7.5 6.1 83.3% 1 5.46s 1,528 0
GPT-5.4 Nano 9.8 10.0 100.0% 0 1.88s 95 521
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 7.7 10.0 66.7% 0 4.42s 1,743 0
GPT-5.4 Nano 4.0 7.1 22.2% 1 3.65s 640 1,356
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 4.68s 555 0
GPT-5.4 Nano 10.0 10.0 100.0% 0 7.71s 234 382

Quick Compare

Switch Comparison Pair

GPT-5.2 ChatnonevsStep 3.5 FlashmediumFree AvailableGPT-5.2 ChatnonevsGrok 4.20 BetamediumClaude Sonnet 4.6mediumvsGPT-5.2 ChatnoneClaude Sonnet 4.6nonevsGPT-5.4 NanomediumGPT-5.2 ChatnonevsQwen3.5-FlashmediumGPT-5.2 ChatnonevsMiMo-V2-FlashmediumGemini 3.1 Flash Lite PreviewlowvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsGLM 5 TurbomediumClaude Opus 4.6mediumvsGPT-5.2 ChatnoneGemini 3.1 Flash Lite PreviewmediumvsGPT-5.2 ChatnoneGemini 2.5 FlashmediumvsGPT-5.2 ChatnoneDeepSeek V3.2mediumvsGPT-5.2 Chatnone