Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.3 Chat vs StepFun: Step 3.5 Flash

Last updated at: 2026-06-03

Metric GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03 Step 3.5 Flash Step 3.5 Flash medium Release: 2026-02-01
Score 7.4 7.4
Rank #53 #55
Reliability 10.0 10.0
Consistency 8.4 9.4
Tests Correct
Attempt pass rate 68.3% 59.7%
Flaky tests 4 1
Total Runs 60 57
Cost per result 3.350 0.133
Total Cost $0.402 $0.062
Input Price $1.750 / 1M $0.090 / 1M
Output Price $14.000 / 1M $0.300 / 1M
Total Input Tokens 31,590 33,555
Output Tokens 24,757 90,478
Reasoning Tokens 0 173,544
Response Time (avg) 6.13s 43.20s
Response Time (max) 18.33s 170.45s
Response Time (total) 122.61s 561.54s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 6.7 8.1 58.3% 1 3.86s 606 3,167 0
Step 3.5 Flash 10.0 10.0 100.0% 0 40.57s 694 20,391 24,176
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 6.9 6.2 66.7% 1 10.52s 4,683 4,772 0
Step 3.5 Flash 3.5 7.8 0.0% 0 62.83s 1,335 12,098 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 11.96s 11,019 2,614 0
Step 3.5 Flash 10.0 10.0 100.0% 0 29.57s 13,638 1,176 12,984
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.21s 7,140 942 0
Step 3.5 Flash 10.0 10.0 100.0% 0 15.01s 7,368 600 13,886
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 3.5 4.4 33.3% 2 13.01s 723 8,264 0
Step 3.5 Flash 5.3 7.2 44.4% 1 170.45s 673 45,350 90,436
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 4.6 10.0 0.0% 0 1.99s 477 319 0
Step 3.5 Flash 5.5 10.0 0.0% 0 22.39s 509 240 3,506
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 9.8 10.0 100.0% 0 3.51s 660 1,491 0
Step 3.5 Flash 8.3 10.0 50.0% 0 4.78s 705 2,364 3,521
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.99s 642 1,758 0
Step 3.5 Flash 5.3 10.0 33.3% 0 7.22s 711 5,630 10,861
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 8.36s 5,445 861 0
Step 3.5 Flash 10.0 10.0 100.0% 0 11.91s 7,701 275 3,802
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 3.0 10.0 0.0% 0 4.38s 195 569 0
Step 3.5 Flash 3.0 10.0 0.0% 0 108.45s 221 2,354 10,372

Quick Compare

Switch Comparison Pair

GPT-5.3 ChatnonevsGLM 5.1mediumGPT-5.3 ChatnonevsMiMo-V2.5mediumGemini 3.1 Flash LitelowvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsStep 3.7 FlashlowKimi K2.6mediumFree AvailablevsGPT-5.3 ChatnoneGemini 3.1 Flash LitelowvsStep 3.5 FlashmediumGPT-5.3 ChatnonevsGLM 5V TurbomediumGPT-5.3 ChatnonevsQwen3.6 35B A3BmediumGemini 3.1 Flash Lite PreviewnonevsStep 3.5 FlashmediumGPT-5.3 ChatnonevsQwen3.5 Plus 2026-04-20mediumClaude Opus 4.8nonevsStep 3.5 FlashmediumGPT-5.3 ChatnonevsQwen3.5-35B-A3Bmedium