OpenAI: GPT-5.6 Sol vs StepFun: Step 3.7 Flash

average score iko karibu sawa: 6.9 vs 6.9. GPT-5.6 Sol ina gharama ya chini ya benchmark: $0.524 vs $1.207. GPT-5.6 Sol ni ya haraka zaidi: 2.16s vs 64.68s, na pass rates 59.1% vs 63.6%.

Muundo unaopendekezwaGPT-5.6 SolIt has the best score here (6.9), while costing about 2.3x less than Step 3.7 Flash (high).

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-07-17

Kipimo	GPT-5.6 Sol GPT-5.6 Sol none Toleo: 2026-07-09	Step 3.7 Flash Step 3.7 Flash high Toleo: 2026-05-29

Kipimo	GPT-5.6 Sol GPT-5.6 Sol none Toleo: 2026-07-09	Step 3.7 Flash Step 3.7 Flash high Toleo: 2026-05-29
Alama	6.9	6.9
Nafasi	#80	#83
Uaminifu	10.0	10.0
Uthabiti	9.0	8.0
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	59.1%	63.6%
Majaribio yasiyo thabiti	3	5
Jumla ya uendeshaji	66	66
Gharama kwa matokeo	4.761	10.973
Jumla ya gharama	$0.524	$1.207
Bei ya ingizo	$5.000 / 1M	$0.200 / 1M
Bei ya toleo	$30.000 / 1M	$1.150 / 1M
Jumla ya tokeni za ingizo	78,593	98,691
Tokeni za matokeo	4,357	1,032,395
Tokeni za hoja	0	0
Muda wa majibu (wastani)	2.16s	64.68s
Muda wa majibu (upeo)	12.81s	364.99s
Muda wa majibu (jumla)	47.62s	1423.01s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#80 GPT-5.6 Sol

none

Gharama: $0.116
Muda: 78.7s
Tokeni: 3,944 tok

#83 Step 3.7 Flash

high

Gharama: $0.007
Muda: 63.6s
Tokeni: 6,030 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Kategoria:

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.6 Sol	8.3	10.0	75.0%	0		1.27s	606	154	0
Step 3.7 Flash	10.0	10.0	100.0%	0		13.40s	696	42,656	0

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.6 Sol	5.5	10.0	33.3%	0		1.39s	7,302	390	0
Step 3.7 Flash	4.0	6.0	22.2%	1		206.21s	6,057	327,340	0

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.6 Sol	6.5	10.0	50.0%	0		8.37s	55,394	2,881	0
Step 3.7 Flash	8.7	6.9	83.3%	1		41.23s	73,938	49,842	0

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.6 Sol	10.0	10.0	100.0%	0		1.53s	7,140	222	0
Step 3.7 Flash	10.0	10.0	100.0%	0		14.72s	7,368	23,113	0

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.6 Sol	3.6	7.2	22.2%	1		1.43s	723	54	0
Step 3.7 Flash	4.1	4.4	44.5%	2		149.64s	783	410,502	0

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.6 Sol	6.5	3.4	66.7%	1		1.52s	477	91	0
Step 3.7 Flash	5.5	10.0	0.0%	0		4.17s	510	2,862	0

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.6 Sol	8.5	6.8	83.3%	1		1.33s	660	84	0
Step 3.7 Flash	9.8	10.0	100.0%	0		1.52s	705	2,010	0

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.6 Sol	7.7	10.0	66.7%	0		1.49s	642	211	0
Step 3.7 Flash	5.3	7.2	44.4%	1		10.22s	711	25,422	0

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.6 Sol	10.0	10.0	100.0%	0		3.70s	5,454	246	0
Step 3.7 Flash	10.0	10.0	100.0%	0		2.79s	7,701	1,172	0

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.6 Sol	3.0	10.0	0.0%	0		1.95s	195	24	0
Step 3.7 Flash	3.0	10.0	0.0%	0		149.34s	222	147,476	0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

GPT-5.5nonevsStep 3.7 Flashhigh GPT-5.6 SolnonevsMiMo-V2.5-Promedium Qwen3.6 FlashmediumvsStep 3.7 Flashhigh GPT-5.6 SolnonevsQwen3.6 Flashmedium Step 3.7 FlashhighvsMiMo-V2.5-Promedium KAT-Coder-Pro V2.5mediumvsGPT-5.6 Solnone Gemini 3.5 FlashminimalvsStep 3.7 Flashhigh DeepSeek V4 PrononevsStep 3.7 Flashhigh Seed-2.0-MinimediumvsGPT-5.6 Solnone KAT-Coder-Pro V2.5mediumvsStep 3.7 Flashhigh Gemini 3.5 FlashminimalvsGPT-5.6 Solnone Mercury 2mediumvsGPT-5.6 Solnone