Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5 Nano vs Qwen: Qwen3.6 35B A3B

Last updated at: 2026-04-27

Metric GPT-5 Nano GPT-5 Nano medium Release: 2025-08-07 Qwen3.6 35B A3B Qwen3.6 35B A3B none Release: 2026-04-20
Score 6.3 5.1
Rank #74 #112
Reliability N/A 10.0
Consistency 6.5 7.4
Tests Correct
Attempt pass rate 59.3% 39.6%
Flaky tests 8 5
Total Runs 54 54
Cost per result 0.942 0.471
Total Cost $0.066 $0.019
Input Price $0.050 / 1M $0.162 / 1M
Output Price $0.400 / 1M $0.966 / 1M
Output Tokens 4,980 17,503
Reasoning Tokens 156,288 0
Response Time (avg) 44.13s 2.87s
Response Time (max) 204.02s 12.46s
Response Time (total) 485.47s 46.00s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 6.5 7.9 58.3% 1 25.50s 1,221 21,184
Qwen3.6 35B A3B 3.6 7.6 16.7% 1 2.10s 1,571 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 6.7 3.5 66.7% 1 40.73s 480 12,992
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 2.05s 921 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 10.0 10.0 100.0% 0 65.96s 578 17,984
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 3.7 1.7 50.0% 2 21.42s 453 10,560
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 1.46s 248 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 5.2 4.4 55.6% 2 204.02s 237 64,448
Qwen3.6 35B A3B 3.5 4.4 33.3% 2 7.45s 11,381 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 4.1 10.0 0.0% 0 17.51s 202 4,608
Qwen3.6 35B A3B 4.4 3.0 33.3% 1 3.51s 1,545 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 8.5 6.8 83.3% 1 11.90s 382 4,096
Qwen3.6 35B A3B 6.2 5.8 66.7% 1 1.86s 1,264 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 5.3 7.2 44.4% 1 19.81s 869 13,440
Qwen3.6 35B A3B 3.2 9.9 0.0% 0 1.00s 573 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 10.0 10.0 100.0% 0 33.30s 558 6,976
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0

Quick Compare

Switch Comparison Pair

GPT-5 NanomediumvsGLM 5V TurbononeGPT-5 NanomediumvsQwen3.5-FlashnoneGemma 4 26B A4BnoneFree AvailablevsGPT-5 NanomediumSeed-2.0-LitenonevsGPT-5 NanomediumGemini 2.5 FlashnonevsGPT-5 NanomediumGPT-5 NanomediumvsQwen3.5-35B-A3BnoneElephant AlphamediumvsQwen3.6 35B A3BnoneMiniMax M2.7mediumvsQwen3.6 35B A3BnoneGPT-5 NanomediumvsMiMo-V2-OmninoneGPT-5 NanomediumvsQwen3.6 27BnoneDeepSeek V3.2nonevsGPT-5 NanomediumGPT-5 NanomediumvsMiMo-V2-Pronone