AI BENCHY Compare

OpenAI: GPT-5.5 vs Qwen: Qwen3.5-35B-A3B

Summary

GPT-5.5 (low) vs Qwen3.5-35B-A3B (medium) benchmark comparison: GPT-5.5 (low) leads on average score with 9.3 vs 6.3. Qwen3.5-35B-A3B (medium) has the lower benchmark cost at $0.401 vs $0.907. GPT-5.5 (low) is faster at 9.76s vs 72.57s, with pass rates of 85.7% vs 69.8%.

Recommended model: GPT-5.5 (low) - It has the best score here (9.3), while responding about 7.4x faster than Qwen3.5-35B-A3B (medium).

Last updated at: 2026-07-10

Metric	GPT-5.5 GPT-5.5 low Release: 2026-04-24	Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24

Metric	GPT-5.5 GPT-5.5 low Release: 2026-04-24	Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24
Score	9.3	6.3
Rank	#7	#104
Reliability	10.0	10.0
Consistency	10.0	7.5
Tests Correct
Attempt pass rate	85.7%	69.8%
Flaky tests	0	6
Total Runs	63	63
Cost per result	5.035	5.162
Total Cost	$0.907	$0.401
Input Price	$5.000 / 1M	$0.140 / 1M
Output Price	$30.000 / 1M	$1.000 / 1M
Total Input Tokens	34,209	42,196
Output Tokens	2,046	40,630
Reasoning Tokens	22,460	353,577
Response Time (avg)	9.76s	72.57s
Response Time (max)	56.19s	409.98s
Response Time (total)	204.92s	1524.04s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#7 GPT-5.5

low

Cost: $0.068
Time: 37.0s
Tokens: 2,339 tok

#104 Qwen3.5-35B-A3B

medium

Cost: $0.009
Time: 71.4s
Tokens: 8,631 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		4.41s	606	238	1,020
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		21.13s	672	798	42,652

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		15.04s	7,302	423	6,402
Qwen3.5-35B-A3B	5.9	9.3	33.3%	0		206.65s	4,106	23,844	111,462

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		9.56s	11,019	303	717
Qwen3.5-35B-A3B	4.7	1.6	66.7%	1		75.34s	20,992	775	12,485

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		3.28s	7,140	228	157
Qwen3.5-35B-A3B	7.3	5.9	83.3%	1		59.33s	6,061	235	19,493

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	5.3	10.0	33.3%	0		28.05s	723	69	11,609
Qwen3.5-35B-A3B	4.1	4.4	44.5%	2		88.34s	500	41	46,368

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		5.17s	477	133	245
Qwen3.5-35B-A3B	2.8	1.6	33.3%	1		30.30s	172	20	3,753

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	9.9	10.0	100.0%	0		3.74s	660	93	415
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		24.45s	699	97	17,361

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		4.74s	642	279	954
Qwen3.5-35B-A3B	8.2	7.2	88.9%	1		33.13s	597	3,592	26,585

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		4.96s	5,445	250	101
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		4.65s	8,193	309	1,365

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	3.0	10.0	0.0%	0		10.06s	195	30	840
Qwen3.5-35B-A3B	3.0	10.0	0.0%	0		177.35s	204	10,919	72,053

Quick Compare

Switch Comparison Pair