Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Mistral: Mistral Small 4 vs Qwen: Qwen3 Coder Next

Last updated at: 2026-05-01

Metric Mistral Small 4 Mistral Small 4 none Release: 2026-03-16 Qwen3 Coder Next Qwen3 Coder Next medium Release: 2026-02-03
Score 5.2 4.9
Rank #115 #123
Reliability N/A N/A
Consistency 9.5 8.7
Tests Correct
Attempt pass rate 31.5% 33.3%
Flaky tests 1 3
Total Runs 54 54
Cost per result 0.118 0.180
Total Cost $0.006 $0.008
Input Price $0.150 / 1M $0.140 / 1M
Output Price $0.600 / 1M $0.800 / 1M
Output Tokens 2,207 3,241
Reasoning Tokens 0 0
Response Time (avg) 665ms 10.75s
Response Time (max) 1.72s 81.80s
Response Time (total) 11.97s 129.01s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.4 7.9 16.7% 1 395ms 182 0
Qwen3 Coder Next 3.5 8.1 16.7% 1 8.64s 1,252 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 4.5 9.0 0.0% 0 1.28s 583 0
Qwen3 Coder Next 4.7 1.6 66.7% 1 1.69s 300 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 1.72s 496 0
Qwen3 Coder Next 3.0 10.0 0.0% 0 4.28s 317 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 822ms 261 0
Qwen3 Coder Next 6.5 10.0 50.0% 0 81.80s 246 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 5.3 10.0 33.3% 0 367ms 28 0
Qwen3 Coder Next 5.3 10.0 33.3% 0 638ms 25 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 4.0 10.0 0.0% 0 729ms 205 0
Qwen3 Coder Next 6.3 3.4 66.7% 1 1.39s 142 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 6.5 10.0 50.0% 0 380ms 69 0
Qwen3 Coder Next 6.3 10.0 50.0% 0 7.34s 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.1 9.9 0.0% 0 589ms 170 0
Qwen3 Coder Next 3.1 10.0 0.0% 0 2.30s 641 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 1.40s 213 0
Qwen3 Coder Next 10.0 10.0 100.0% 0 2.64s 255 0

Quick Compare

Switch Comparison Pair

Mistral Small 4nonevsNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailableMistral Small 4nonevsElephant AlphamediumMiniMax M2.7mediumvsMistral Small 4noneMercury 2nonevsQwen3 Coder NextmediumLaguna Xs.2noneFree AvailablevsQwen3 Coder NextmediumLaguna M.1noneFree AvailablevsQwen3 Coder NextmediumGPT-4o-mininonevsQwen3 Coder NextmediumQwen3 Coder NextmediumvsMiMo-V2.5noneQwen3 Coder NextmediumvsHY3 PreviewnoneFree AvailableGPT-5.4 MininonevsQwen3 Coder NextmediumGPT-5.4 NanononevsQwen3 Coder NextmediumElephant AlphanonevsQwen3 Coder Nextmedium