Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.4 Nano vs Qwen: Qwen3.6 35B A3B

Last updated at: 2026-05-01

Metric GPT-5.4 Nano GPT-5.4 Nano none Release: 2026-03-17 Qwen3.6 35B A3B Qwen3.6 35B A3B none Release: 2026-04-20
Score 4.6 5.1
Rank #127 #119
Reliability N/A 10.0
Consistency 7.4 7.4
Tests Correct
Attempt pass rate 33.3% 39.6%
Flaky tests 6 5
Total Runs 54 54
Cost per result 0.299 0.471
Total Cost $0.009 $0.019
Input Price $0.200 / 1M $0.162 / 1M
Output Price $1.250 / 1M $0.966 / 1M
Output Tokens 2,762 17,503
Reasoning Tokens 0 0
Response Time (avg) 1.40s 2.87s
Response Time (max) 3.84s 12.46s
Response Time (total) 25.14s 46.00s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 3.5 8.0 16.7% 1 1.18s 800 0
Qwen3.6 35B A3B 3.6 7.6 16.7% 1 2.10s 1,571 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 7.1 3.7 66.7% 1 1.43s 577 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 2.05s 921 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 3.0 10.0 0.0% 0 3.84s 280 0
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 6.5 10.0 50.0% 0 1.11s 219 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 1.46s 248 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 2.9 4.4 22.2% 2 926ms 52 0
Qwen3.6 35B A3B 3.5 4.4 33.3% 2 7.45s 11,381 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 3.8 2.5 33.3% 1 1.31s 180 0
Qwen3.6 35B A3B 4.4 3.0 33.3% 1 3.51s 1,545 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 6.3 10.0 50.0% 0 787ms 84 0
Qwen3.6 35B A3B 6.2 5.8 66.7% 1 1.86s 1,264 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 3.7 7.3 22.2% 1 1.29s 348 0
Qwen3.6 35B A3B 3.2 9.9 0.0% 0 1.00s 573 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 10.0 10.0 100.0% 0 3.40s 222 0
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0

Quick Compare

Switch Comparison Pair

GPT-5.4 NanononevsGLM 4.7 FlashmediumNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsQwen3.6 35B A3BnoneElephant AlphamediumvsQwen3.6 35B A3BnoneMiniMax M2.7mediumvsQwen3.6 35B A3BnoneGPT-5.4 NanononevsQwen3.5-9BmediumGPT-5.4 NanononevsQwen3 Coder NextmediumQwen3.6 35B A3BnonevsGLM 4.7 FlashmediumMiniMax M2.5mediumFree AvailablevsQwen3.6 35B A3BnoneMistral Small 4mediumvsQwen3.6 35B A3BnoneNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsGPT-5.4 NanononeGPT-5.4 NanononevsElephant AlphamediumMiniMax M2.7mediumvsGPT-5.4 Nanonone