Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.2 Chat vs StepFun: Step 3.7 Flash

Last updated at: 2026-05-29

Metric GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11 Step 3.7 Flash Step 3.7 Flash medium Release: 2026-05-29
Score 7.9 7.9
Rank #33 #32
Reliability 10.0 9.9
Consistency 8.9 9.2
Tests Correct
Attempt pass rate 73.3% 71.7%
Flaky tests 3 2
Total Runs 60 58
Cost per result 2.703 2.663
Total Cost $0.352 $0.347
Input Price $1.750 / 1M $0.200 / 1M
Output Price $14.000 / 1M $1.150 / 1M
Output Tokens 21,144 294,481
Reasoning Tokens 0 0
Response Time (avg) 6.82s 18.32s
Response Time (max) 38.52s 113.98s
Response Time (total) 136.34s 366.45s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 8.7 7.9 91.7% 1 3.40s 1,807 0
Step 3.7 Flash 8.7 7.9 91.7% 1 9.65s 32,185 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 8.2 6.7 83.3% 1 8.05s 4,131 0
Step 3.7 Flash 8.2 6.7 83.3% 1 10.64s 19,320 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 9.12s 1,243 0
Step 3.7 Flash 10.0 10.0 100.0% 0 9.06s 7,106 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 3.05s 980 0
Step 3.7 Flash 10.0 10.0 100.0% 0 2.75s 3,020 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 5.3 10.0 33.3% 0 17.78s 7,810 0
Step 3.7 Flash 7.7 10.0 66.7% 0 48.27s 70,347 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 4.4 3.0 33.3% 1 3.20s 335 0
Step 3.7 Flash 4.0 10.0 0.0% 0 6.85s 3,987 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 9.8 10.0 100.0% 0 5.51s 1,441 0
Step 3.7 Flash 9.8 10.0 100.0% 0 1.83s 2,166 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 7.7 10.0 66.7% 0 4.10s 1,603 0
Step 3.7 Flash 5.7 9.9 33.3% 0 6.19s 15,071 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 4.68s 555 0
Step 3.7 Flash 10.0 10.0 100.0% 0 4.16s 2,115 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 3.0 10.0 0.0% 0 6.89s 1,239 0
Step 3.7 Flash 3.0 10.0 0.0% 0 113.98s 139,164 0

Quick Compare

Switch Comparison Pair

Qwen3.7 MaxnonevsStep 3.7 FlashmediumGemma 4 26B A4BmediumFree AvailablevsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsGLM 5 TurbomediumGemini 3.5 FlashminimalvsStep 3.7 FlashmediumGPT-5.2 ChatnonevsQwen3.5-27BmediumGPT-5.2 ChatnonevsQwen3.6 35B A3BmediumGPT-5.2 ChatnonevsGrok 4.3mediumGemini 3.5 FlashminimalvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsQwen3.6 PlusmediumGemma 4 31BmediumFree AvailablevsGPT-5.2 ChatnoneGemini 3.1 Flash Lite PreviewmediumvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsQwen3.5 Plus 2026-04-20medium