Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-4o-mini vs Qwen: Qwen3 Coder Next

Last updated at: 2026-04-14

Metric GPT-4o-mini GPT-4o-mini none Release: 2024-07-18 Qwen3 Coder Next Qwen3 Coder Next medium Release: 2026-02-03
Score 4.9 4.7
Rank #85 #88
Consistency 9.9 8.7
Tests Correct
Attempt pass rate 22.2% 27.8%
Flaky tests 0 3
Total Runs 54 54
Cost per result 0.122 0.240
Total Cost $0.005 $0.008
Input Price $0.150 / 1M $0.150 / 1M
Output Price $0.600 / 1M $0.800 / 1M
Output Tokens 1,947 3,241
Reasoning Tokens 0 0
Response Time (avg) 2.00s 10.75s
Response Time (max) 7.58s 81.80s
Response Time (total) 21.99s 129.01s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 4.8 10.0 25.0% 0 1.34s 186 0
Qwen3 Coder Next 3.5 8.1 16.7% 1 8.64s 1,252 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.0 8.7 0.0% 0 2.55s 347 0
Qwen3 Coder Next 4.7 1.6 66.7% 1 1.69s 300 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.0 10.0 0.0% 0 7.58s 568 0
Qwen3 Coder Next 3.0 10.0 0.0% 0 4.28s 317 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 10.0 10.0 100.0% 0 1.27s 183 0
Qwen3 Coder Next 6.5 10.0 50.0% 0 81.80s 246 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.0 10.0 0.0% 0 637ms 15 0
Qwen3 Coder Next 5.3 10.0 33.3% 0 638ms 25 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 4.0 10.0 0.0% 0 909ms 66 0
Qwen3 Coder Next 6.3 3.4 66.7% 1 1.39s 142 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 4.8 10.0 0.0% 0 1.27s 69 0
Qwen3 Coder Next 4.8 10.0 0.0% 0 7.34s 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.7 10.0 0.0% 0 1.30s 308 0
Qwen3 Coder Next 3.1 10.0 0.0% 0 2.30s 641 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 10.0 10.0 100.0% 0 2.51s 205 0
Qwen3 Coder Next 10.0 10.0 100.0% 0 2.64s 255 0

Quick Compare

Switch Comparison Pair

Mercury 2nonevsQwen3 Coder NextmediumQwen3 Coder NextmediumvsMiMo-V2-FlashnoneQwen3 Coder NextmediumvsGrok 4.1 FastnoneGPT-5.4 NanononevsQwen3 Coder NextmediumGPT-4o-mininonevsGLM 4.7 FlashmediumNemotron 3 SupernoneFree AvailablevsQwen3 Coder NextmediumGPT-4o-mininonevsElephantmediumMiniMax M2.7mediumvsGPT-4o-mininoneGPT-5.4 MininonevsQwen3 Coder NextmediumElephantnonevsQwen3 Coder Nextmediumgpt-oss-120bnoneFree AvailablevsQwen3 Coder NextmediumMistral Small 4nonevsQwen3 Coder Nextmedium