Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.4 Mini vs Qwen: Qwen3.6 35B A3B

Last updated at: 2026-04-27

Metric GPT-5.4 Mini GPT-5.4 Mini none Release: 2026-03-17 Qwen3.6 35B A3B Qwen3.6 35B A3B none Release: 2026-04-20
Score 5.1 5.1
Rank #109 #112
Reliability N/A 10.0
Consistency 8.6 7.4
Tests Correct
Attempt pass rate 35.2% 39.6%
Flaky tests 3 5
Total Runs 54 54
Cost per result 0.630 0.471
Total Cost $0.032 $0.019
Input Price $0.750 / 1M $0.162 / 1M
Output Price $4.500 / 1M $0.966 / 1M
Output Tokens 2,418 17,503
Reasoning Tokens 0 0
Response Time (avg) 1.17s 2.87s
Response Time (max) 2.52s 12.46s
Response Time (total) 21.01s 46.00s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Mini 3.1 8.1 8.3% 1 929ms 654 0
Qwen3.6 35B A3B 3.6 7.6 16.7% 1 2.10s 1,571 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Mini 10.0 10.0 100.0% 0 1.19s 333 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 2.05s 921 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Mini 3.0 10.0 0.0% 0 2.52s 298 0
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Mini 10.0 10.0 100.0% 0 1.30s 222 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 1.46s 248 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Mini 3.5 4.4 33.3% 2 937ms 88 0
Qwen3.6 35B A3B 3.5 4.4 33.3% 2 7.45s 11,381 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Mini 4.8 10.0 0.0% 0 1.82s 174 0
Qwen3.6 35B A3B 4.4 3.0 33.3% 1 3.51s 1,545 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Mini 6.3 10.0 50.0% 0 728ms 101 0
Qwen3.6 35B A3B 6.2 5.8 66.7% 1 1.86s 1,264 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Mini 5.4 10.0 33.3% 0 860ms 293 0
Qwen3.6 35B A3B 3.2 9.9 0.0% 0 1.00s 573 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Mini 3.0 10.0 0.0% 0 2.32s 255 0
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0

Quick Compare

Switch Comparison Pair

GPT-5.4 MininonevsElephant AlphamediumMiniMax M2.7mediumvsGPT-5.4 MininoneElephant AlphamediumvsQwen3.6 35B A3BnoneMiniMax M2.7mediumvsQwen3.6 35B A3BnoneGPT-5.4 MininonevsQwen3 Coder NextmediumQwen3.6 35B A3BnonevsGLM 4.7 FlashmediumMistral Small 4mediumvsGPT-5.4 MininoneGPT-5.4 MininonevsGLM 4.7 FlashmediumMiniMax M2.5mediumFree AvailablevsGPT-5.4 MininoneMistral Small 4mediumvsQwen3.6 35B A3BnoneMiniMax M2.5mediumFree AvailablevsQwen3.6 35B A3BnoneGPT-5.4 MininonevsQwen3.5-9Bmedium