Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.3 Chat vs StepFun: Step 3.7 Flash

Last updated at: 2026-06-04

Metric GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03 Step 3.7 Flash Step 3.7 Flash high Release: 2026-05-29
Score 7.2 7.0
Rank #63 #71
Reliability 10.0 10.0
Consistency 8.1 8.2
Tests Correct
Attempt pass rate 66.7% 63.5%
Flaky tests 5 4
Total Runs 63 63
Cost per result 3.605 10.434
Total Cost $0.433 $1.148
Input Price $1.750 / 1M $0.200 / 1M
Output Price $14.000 / 1M $1.150 / 1M
Total Input Tokens 34,209 38,391
Output Tokens 26,617 991,355
Reasoning Tokens 0 0
Response Time (avg) 6.34s 64.46s
Response Time (max) 18.33s 364.99s
Response Time (total) 133.13s 1353.57s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 6.7 8.1 58.3% 1 3.86s 606 3,167 0
Step 3.7 Flash 10.0 10.0 100.0% 0 13.40s 696 42,656 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 5.6 4.7 55.6% 2 10.52s 7,302 6,632 0
Step 3.7 Flash 4.0 6.0 22.2% 1 206.21s 6,057 327,340 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 11.96s 11,019 2,614 0
Step 3.7 Flash 10.0 10.0 100.0% 0 13.01s 13,638 8,802 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.21s 7,140 942 0
Step 3.7 Flash 10.0 10.0 100.0% 0 14.72s 7,368 23,113 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 3.5 4.4 33.3% 2 13.01s 723 8,264 0
Step 3.7 Flash 4.1 4.4 44.5% 2 149.64s 783 410,502 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 4.6 10.0 0.0% 0 1.99s 477 319 0
Step 3.7 Flash 5.5 10.0 0.0% 0 4.17s 510 2,862 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 9.8 10.0 100.0% 0 3.51s 660 1,491 0
Step 3.7 Flash 9.8 10.0 100.0% 0 1.52s 705 2,010 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.99s 642 1,758 0
Step 3.7 Flash 5.3 7.2 44.4% 1 10.22s 711 25,422 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 8.36s 5,445 861 0
Step 3.7 Flash 10.0 10.0 100.0% 0 2.79s 7,701 1,172 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 3.0 10.0 0.0% 0 4.38s 195 569 0
Step 3.7 Flash 3.0 10.0 0.0% 0 149.34s 222 147,476 0

Quick Compare

Switch Comparison Pair

GPT-5.4 NanomediumvsStep 3.7 FlashhighClaude Opus 4.6mediumvsStep 3.7 FlashhighClaude Opus 4.8nonevsStep 3.7 FlashhighMiniMax M3mediumvsStep 3.7 FlashhighGPT-5.3 ChatnonevsMiMo-V2-FlashmediumGPT-5.3 ChatnonevsStep 3.5 FlashmediumGemini 3.1 Flash LitelowvsGPT-5.3 ChatnoneKimi K2.6mediumFree AvailablevsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsGLM 5V TurbomediumGPT-5.3 ChatnonevsGrok 4.20mediumDeepSeek V3.2mediumvsStep 3.7 FlashhighGPT-5.3 ChatnonevsStep 3.7 Flashlow