Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.4 Mini vs Qwen: Qwen3.5-35B-A3B

Summary

GPT-5.4 Mini vs Qwen3.5-35B-A3B benchmark comparison: Qwen3.5-35B-A3B leads on average score with 5.9 vs 5.3. Qwen3.5-35B-A3B has the lower benchmark cost at $0.012 vs $0.038. GPT-5.4 Mini is faster at 1.13s vs 3.37s, with pass rates of 30.2% vs 42.9%.

Recommended model: Qwen3.5-35B-A3B - It has the best score here (5.9), while costing about 3.3x less than GPT-5.4 Mini.

Last updated at: 2026-06-12

Metric GPT-5.4 Mini GPT-5.4 Mini none Release: 2026-03-17 Qwen3.5-35B-A3B Qwen3.5-35B-A3B none Release: 2026-02-24
Score 5.3 5.9
Rank #131 #108
Reliability 10.0 10.0
Consistency 8.8 8.9
Tests Correct
Attempt pass rate 30.2% 42.9%
Flaky tests 3 3
Total Runs 63 63
Cost per result 0.743 0.230
Total Cost $0.038 $0.012
Input Price $0.750 / 1M $0.140 / 1M
Output Price $4.500 / 1M $1.000 / 1M
Total Input Tokens 34,244 48,194
Output Tokens 2,541 4,343
Reasoning Tokens 0 0
Response Time (avg) 1.13s 3.37s
Response Time (max) 2.52s 47.43s
Response Time (total) 23.82s 70.75s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#131 GPT-5.4 Mini

none
Cost
$0.010
Time
11.7s
Tokens
2,151 tok

#108 Qwen3.5-35B-A3B

none
Cost
$0.005
Time
28.4s
Tokens
4,518 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Mini 3.1 8.1 8.3% 1 929ms 606 654 0
Qwen3.5-35B-A3B 3.4 7.9 16.7% 1 1.43s 696 574 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Mini 5.5 10.0 33.3% 0 913ms 7,305 401 0
Qwen3.5-35B-A3B 5.5 10.0 33.3% 0 1.39s 7,808 571 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Mini 3.0 10.0 0.0% 0 2.52s 11,019 298 0
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 47.43s 20,739 1,833 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Mini 10.0 10.0 100.0% 0 1.30s 7,140 222 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 1.16s 7,794 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Mini 3.5 4.4 33.3% 2 937ms 723 88 0
Qwen3.5-35B-A3B 7.7 10.0 66.7% 0 485ms 789 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Mini 4.8 10.0 0.0% 0 1.82s 477 174 0
Qwen3.5-35B-A3B 6.5 3.4 66.7% 1 1.19s 522 114 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Mini 6.3 10.0 50.0% 0 728ms 660 101 0
Qwen3.5-35B-A3B 6.3 10.0 50.0% 0 809ms 711 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Mini 5.4 10.0 33.3% 0 836ms 642 305 0
Qwen3.5-35B-A3B 3.7 7.4 22.2% 1 1.35s 714 655 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Mini 3.0 10.0 0.0% 0 2.32s 5,477 255 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.30s 8,211 264 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Mini 3.0 10.0 0.0% 0 1.33s 195 43 0
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 493ms 210 11 0

Quick Compare

Switch Comparison Pair

MiniMax M2.7mediumvsGPT-5.4 MininoneMistral Small 4mediumvsGPT-5.4 MininoneGemini 3.1 Flash LiteminimalvsQwen3.5-35B-A3BnoneDeepSeek V4 ProhighvsQwen3.5-35B-A3BnoneCobuddymediumvsGPT-5.4 MininoneGemma 4 31BmediumFree AvailablevsQwen3.5-35B-A3BnoneNemotron 3 SupermediumFree AvailablevsQwen3.5-35B-A3BnoneGemini 3.1 Flash LitelowvsQwen3.5-35B-A3BnoneGemini 3.1 Flash Lite PreviewlowvsQwen3.5-35B-A3BnoneMiniMax M2.5mediumvsGPT-5.4 MininoneGPT-5.4 MininonevsQwen3 Coder NextmediumGPT-5 NanomediumvsQwen3.5-35B-A3Bnone