Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5 Nano vs Qwen: Qwen3 Coder Next

Last updated at: 2026-04-29

Metric GPT-5 Nano GPT-5 Nano medium Release: 2025-08-07 Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03
Score 6.3 5.1
Rank #74 #113
Reliability N/A N/A
Consistency 6.5 9.7
Tests Correct
Attempt pass rate 59.3% 25.9%
Flaky tests 8 1
Total Runs 54 54
Cost per result 0.942 0.188
Total Cost $0.066 $0.008
Input Price $0.050 / 1M $0.140 / 1M
Output Price $0.400 / 1M $0.800 / 1M
Output Tokens 4,980 3,617
Reasoning Tokens 156,288 0
Response Time (avg) 44.13s 10.18s
Response Time (max) 204.02s 45.14s
Response Time (total) 485.47s 122.13s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 6.5 7.9 58.3% 1 25.50s 1,221 21,184
Qwen3 Coder Next 3.6 10.0 0.0% 0 3.31s 1,321 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 6.7 3.5 66.7% 1 40.73s 480 12,992
Qwen3 Coder Next 7.3 3.7 66.7% 1 3.14s 585 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 10.0 10.0 100.0% 0 65.96s 578 17,984
Qwen3 Coder Next 3.0 10.0 0.0% 0 45.14s 317 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 3.7 1.7 50.0% 2 21.42s 453 10,560
Qwen3 Coder Next 6.5 10.0 50.0% 0 1.32s 246 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 5.2 4.4 55.6% 2 204.02s 237 64,448
Qwen3 Coder Next 5.3 10.0 33.3% 0 962ms 26 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 4.1 10.0 0.0% 0 17.51s 202 4,608
Qwen3 Coder Next 10.0 10.0 100.0% 0 1.34s 152 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 8.5 6.8 83.3% 1 11.90s 382 4,096
Qwen3 Coder Next 4.8 10.0 0.0% 0 7.71s 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 5.3 7.2 44.4% 1 19.81s 869 13,440
Qwen3 Coder Next 3.2 10.0 0.0% 0 22.86s 652 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 10.0 10.0 100.0% 0 33.30s 558 6,976
Qwen3 Coder Next 10.0 10.0 100.0% 0 2.47s 255 0

Quick Compare

Switch Comparison Pair

GPT-5 NanomediumvsGLM 5V TurbononeGPT-5 NanomediumvsQwen3.5-FlashnoneGemma 4 26B A4BnoneFree AvailablevsGPT-5 NanomediumSeed-2.0-LitenonevsGPT-5 NanomediumGemini 2.5 FlashnonevsGPT-5 NanomediumNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsQwen3 Coder NextnoneElephant AlphamediumvsQwen3 Coder NextnoneGPT-5 NanomediumvsQwen3.5-35B-A3BnoneMiniMax M2.7mediumvsQwen3 Coder NextnoneDeepSeek V4 PrononevsGPT-5 NanomediumGPT-5 NanomediumvsMiMo-V2-OmninoneGPT-5 NanomediumvsQwen3.6 27Bnone