Compare Charts

Language:

❤️ Made by XCS

AI BENCHY Compare

OpenAI: GPT-5.3-Codex vs StepFun: Step 3.5 Flash

Model Name:

Last updated at : 2026-02-27 15:16

Summary

Metric	OpenAI: GPT-5.3-Codex medium Release: Unknown release date	StepFun: Step 3.5 Flash medium Release: Unknown release date Free Available
Rank	#7	#11
Score	7.93	7.00
Consistency	8.84	8.32
Cost per result	4.641	0.000
Total Cost	$0.465	$0.000
Tests Correct
Wrong Tests	4	5
Attempt pass rate	78.6%	73.8%
Flaky tests	2	3
Output Tokens	1,201	60,502
Reasoning Tokens	30,056	117,044

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
OpenAI: GPT-5.3-Codex	10.00	10.00	100.0%	0		216	1,421
StepFun: Step 3.5 Flash	10.00	10.00	100.0%	0		13,924	17,208

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
OpenAI: GPT-5.3-Codex	10.00	10.00	100.0%	0		234	735
StepFun: Step 3.5 Flash	10.00	10.00	100.0%	0		535	11,548

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
OpenAI: GPT-5.3-Codex	4.00	7.21	55.6%	1		64	25,308
StepFun: Step 3.5 Flash	4.00	7.21	44.4%	1		40,942	74,237

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
OpenAI: GPT-5.3-Codex	9.00	10.00	50.0%	0		93	693
StepFun: Step 3.5 Flash	10.00	10.00	100.0%	0		2,121	3,274

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
OpenAI: GPT-5.3-Codex	7.00	7.38	77.8%	1		340	1,407
StepFun: Step 3.5 Flash	2.00	4.96	33.3%	2		2,705	6,975

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
OpenAI: GPT-5.3-Codex	10.00	10.00	100.0%	0		254	492
StepFun: Step 3.5 Flash	10.00	10.00	100.0%	0		275	3,802

Switch Comparison Pair

Compare OpenAI: GPT-5.3-Codex against...

Compare StepFun: Step 3.5 Flash against...