Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.4 vs Qwen: Qwen3 Coder Next

Summary

GPT-5.4 vs Qwen3 Coder Next benchmark comparison: GPT-5.4 leads on average score with 5.8 vs 5.1. Qwen3 Coder Next has the lower benchmark cost at $0.009 vs $0.122. GPT-5.4 is faster at 1.42s vs 8.62s, with pass rates of 36.5% vs 27.0%.

Recommended model: GPT-5.4 - It has the best score here (5.8), while responding about 6.1x faster than Qwen3 Coder Next.

Last updated at: 2026-07-02

Metric GPT-5.4 GPT-5.4 none Release: 2026-03-05 Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03
Score 5.8 5.1
Rank #115 #135
Reliability 10.0 10.0
Consistency 9.2 9.7
Tests Correct
Attempt pass rate 36.5% 27.0%
Flaky tests 2 1
Total Runs 63 63
Cost per result 1.740 0.165
Total Cost $0.122 $0.009
Input Price $2.500 / 1M $0.110 / 1M
Output Price $15.000 / 1M $0.800 / 1M
Total Input Tokens 34,212 47,507
Output Tokens 2,417 3,584
Reasoning Tokens 0 0
Response Time (avg) 1.42s 8.62s
Response Time (max) 2.95s 45.14s
Response Time (total) 29.87s 129.37s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#115 GPT-5.4

none
Cost
$0.026
Time
18.1s
Tokens
1,792 tok

#135 Qwen3 Coder Next

none
Invalid SVG
Cost
$0.058
Time
246.3s
Tokens
64,126 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.2 8.0 8.3% 1 1.21s 606 406 0
Qwen3 Coder Next 3.6 10.0 0.0% 0 3.31s 645 1,321 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 5.5 10.0 33.3% 0 1.62s 7,305 516 0
Qwen3 Coder Next 4.6 7.9 22.2% 1 2.22s 7,442 621 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.0 10.0 0.0% 0 2.89s 11,019 291 0
Qwen3 Coder Next 3.0 10.0 0.0% 0 45.14s 20,469 317 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 1.04s 7,140 222 0
Qwen3 Coder Next 6.5 10.0 50.0% 0 1.32s 7,758 246 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 5.3 7.2 44.4% 1 1.07s 723 50 0
Qwen3 Coder Next 5.3 10.0 33.3% 0 962ms 753 26 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 4.4 9.9 0.0% 0 1.78s 477 184 0
Qwen3 Coder Next 10.0 10.0 100.0% 0 1.34s 498 152 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 6.5 10.0 50.0% 0 1.07s 660 81 0
Qwen3 Coder Next 6.3 10.0 50.0% 0 7.78s 684 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 5.6 9.8 33.3% 0 1.44s 642 381 0
Qwen3 Coder Next 3.0 10.0 0.0% 0 24.34s 678 571 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 2.75s 5,445 246 0
Qwen3 Coder Next 10.0 10.0 100.0% 0 2.47s 8,364 255 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.0 10.0 0.0% 0 990ms 195 40 0
Qwen3 Coder Next 3.0 10.0 0.0% 0 601ms 216 12 0

Quick Compare

Switch Comparison Pair

Mistral Small 4mediumvsQwen3 Coder NextnoneMiniMax M2.7mediumvsQwen3 Coder NextnoneNorth Mini CodemediumFree AvailablevsGPT-5.4noneCobuddymediumvsQwen3 Coder NextnoneGemini 3.1 Flash LiteminimalvsGPT-5.4noneMiniMax M2.5mediumvsQwen3 Coder NextnoneGPT-5.4nonevsQwen3.5-35B-A3BmediumGemma 4 31BmediumFree AvailablevsGPT-5.4noneNemotron 3 SupermediumFree AvailablevsGPT-5.4noneMiniMax M2.7mediumvsGPT-5.4noneGemini 3.1 Flash LitelowvsGPT-5.4noneMistral Small 4mediumvsGPT-5.4none