Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-4o-mini vs Qwen: Qwen3 Coder Next

Last updated at: 2026-05-29

Metric GPT-4o-mini GPT-4o-mini none Release: 2024-07-18 Qwen3 Coder Next Qwen3 Coder Next medium Release: 2026-02-03
Score 4.9 4.7
Rank #144 #147
Reliability 10.0 10.0
Consistency 9.9 8.9
Tests Correct
Attempt pass rate 25.0% 30.0%
Flaky tests 0 3
Total Runs 60 60
Cost per result 0.111 0.193
Total Cost $0.006 $0.008
Input Price $0.150 / 1M $0.110 / 1M
Output Price $0.600 / 1M $0.800 / 1M
Output Tokens 1,977 3,310
Reasoning Tokens 0 0
Response Time (avg) 1.85s 9.16s
Response Time (max) 7.58s 81.80s
Response Time (total) 24.00s 128.25s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 4.8 10.0 25.0% 0 1.34s 186 0
Qwen3 Coder Next 3.5 8.1 16.7% 1 8.64s 1,252 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.2 9.3 0.0% 0 2.05s 362 0
Qwen3 Coder Next 4.1 5.8 33.3% 1 1.17s 327 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.0 10.0 0.0% 0 7.58s 568 0
Qwen3 Coder Next 3.0 10.0 0.0% 0 4.28s 317 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 10.0 10.0 100.0% 0 1.27s 183 0
Qwen3 Coder Next 6.5 10.0 50.0% 0 81.80s 246 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.0 10.0 0.0% 0 637ms 15 0
Qwen3 Coder Next 5.3 10.0 33.3% 0 638ms 25 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 4.0 10.0 0.0% 0 909ms 66 0
Qwen3 Coder Next 6.3 3.4 66.7% 1 1.39s 142 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 6.3 10.0 50.0% 0 1.11s 69 0
Qwen3 Coder Next 6.3 10.0 50.0% 0 7.49s 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.5 10.0 0.0% 0 1.21s 308 0
Qwen3 Coder Next 3.0 10.0 0.0% 0 1.25s 671 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 10.0 10.0 100.0% 0 2.51s 205 0
Qwen3 Coder Next 10.0 10.0 100.0% 0 2.64s 255 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.0 10.0 0.0% 0 794ms 15 0
Qwen3 Coder Next 3.0 10.0 0.0% 0 399ms 12 0

Quick Compare

Switch Comparison Pair

GPT-5.4 NanononevsQwen3 Coder NextmediumQwen3 Coder NextmediumvsMiMo-V2-FlashnoneTrinity Large PreviewnonevsQwen3 Coder NextmediumMercury 2nonevsQwen3 Coder NextmediumGPT-5.4 MininonevsQwen3 Coder NextmediumQwen3 Coder NextmediumvsMiMo-V2.5noneLing-2.6-1TnonevsQwen3 Coder NextmediumMistral Small 4nonevsQwen3 Coder NextmediumNemotron 3 SupernoneFree AvailablevsQwen3 Coder NextmediumDeepSeek V4 FlashnoneFree AvailablevsQwen3 Coder NextmediumGPT-4o-mininonevsGLM 4.7 FlashmediumElephant AlphanonevsQwen3 Coder Nextmedium