Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.4 vs Qwen: Qwen3 Coder Next

Last updated at: 2026-06-03

Metric GPT-5.4 GPT-5.4 none Release: 2026-03-05 Qwen3 Coder Next Qwen3 Coder Next medium Release: 2026-02-03
Score 5.6 4.7
Rank #121 #147
Reliability 10.0 10.0
Consistency 9.1 8.9
Tests Correct
Attempt pass rate 38.3% 30.0%
Flaky tests 2 3
Total Runs 60 60
Cost per result 1.644 0.193
Total Cost $0.116 $0.008
Input Price $2.500 / 1M $0.110 / 1M
Output Price $15.000 / 1M $0.800 / 1M
Total Input Tokens 31,593 44,607
Output Tokens 2,402 3,310
Reasoning Tokens 0 0
Response Time (avg) 1.45s 9.16s
Response Time (max) 2.95s 81.80s
Response Time (total) 29.00s 128.25s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.2 8.0 8.3% 1 1.21s 606 406 0
Qwen3 Coder Next 3.5 8.1 16.7% 1 8.64s 645 1,252 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 6.8 10.0 50.0% 0 1.99s 4,686 501 0
Qwen3 Coder Next 4.1 5.8 33.3% 1 1.17s 4,542 327 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.0 10.0 0.0% 0 2.89s 11,019 291 0
Qwen3 Coder Next 3.0 10.0 0.0% 0 4.28s 20,469 317 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 1.04s 7,140 222 0
Qwen3 Coder Next 6.5 10.0 50.0% 0 81.80s 7,758 246 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 5.3 7.2 44.4% 1 1.07s 723 50 0
Qwen3 Coder Next 5.3 10.0 33.3% 0 638ms 753 25 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 4.4 9.9 0.0% 0 1.78s 477 184 0
Qwen3 Coder Next 6.3 3.4 66.7% 1 1.39s 498 142 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 6.5 10.0 50.0% 0 1.07s 660 81 0
Qwen3 Coder Next 6.3 10.0 50.0% 0 7.49s 684 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 5.6 9.8 33.3% 0 1.44s 642 381 0
Qwen3 Coder Next 3.0 10.0 0.0% 0 1.25s 678 671 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 2.75s 5,445 246 0
Qwen3 Coder Next 10.0 10.0 100.0% 0 2.64s 8,364 255 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.0 10.0 0.0% 0 990ms 195 40 0
Qwen3 Coder Next 3.0 10.0 0.0% 0 399ms 216 12 0

Quick Compare

Switch Comparison Pair

Trinity Large PreviewnonevsQwen3 Coder NextmediumGPT-5.4 NanononevsQwen3 Coder NextmediumQwen3 Coder NextmediumvsMiMo-V2-FlashnoneMiniMax M2.5mediumvsGPT-5.4noneGPT-4o-mininonevsQwen3 Coder NextmediumMercury 2nonevsQwen3 Coder NextmediumCobuddymediumvsGPT-5.4noneMiniMax M2.7mediumvsGPT-5.4noneMistral Small 4mediumvsGPT-5.4noneGPT-5.4 MininonevsQwen3 Coder NextmediumQwen3 Coder NextmediumvsMiMo-V2.5noneMistral Small 4nonevsQwen3 Coder Nextmedium