Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Mistral: Mistral Small 4 vs Qwen: Qwen3 Coder Next

Last updated at: 2026-03-17

Metric Mistral Small 4 Mistral Small 4 none Release: 2026-03-16 Qwen3 Coder Next Qwen3 Coder Next medium Release: 2026-02-03
Rank #61 #68
Score 5.3 4.8
Consistency 9.5 9.2
Cost per result 0.108 0.230
Total Cost $0.006 $0.007
Tests Correct
Attempt pass rate 33.3% 25.5%
Flaky tests 1 2
Total Runs 51 51
Output Tokens 1,624 2,941
Reasoning Tokens 0 0
Response Time (avg) 629ms 11.57s
Response Time (max) 1.72s 81.80s
Response Time (total) 10.70s 127.32s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.4 7.9 16.7% 1 395ms 182 0
Qwen3 Coder Next 3.5 8.1 16.7% 1 8.64s 1,252 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 1.72s 496 0
Qwen3 Coder Next 3.0 10.0 0.0% 0 4.28s 317 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 822ms 261 0
Qwen3 Coder Next 6.5 10.0 50.0% 0 81.80s 246 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 5.3 10.0 33.3% 0 367ms 28 0
Qwen3 Coder Next 5.3 10.0 33.3% 0 638ms 25 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 4.0 10.0 0.0% 0 729ms 205 0
Qwen3 Coder Next 6.3 3.4 66.7% 1 1.39s 142 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 6.5 10.0 50.0% 0 380ms 69 0
Qwen3 Coder Next 4.8 10.0 0.0% 0 7.34s 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.1 9.9 0.0% 0 589ms 170 0
Qwen3 Coder Next 3.1 10.0 0.0% 0 2.30s 641 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 1.40s 213 0
Qwen3 Coder Next 10.0 10.0 100.0% 0 2.64s 255 0

Quick Compare

Switch Comparison Pair

GPT-5.4 MininonevsQwen3 Coder NextmediumMercury 2nonevsQwen3 Coder NextmediumGPT-4o-mininonevsQwen3 Coder NextmediumQwen3 Coder NextmediumvsGrok 4.1 FastnoneQwen3 Coder NextmediumvsMiMo-V2-FlashnoneNemotron 3 Super 120b A12bnoneFree AvailablevsQwen3 Coder NextmediumGPT-5.4 NanononevsQwen3 Coder NextmediumTrinity Large PreviewnoneFree AvailablevsQwen3 Coder NextmediumKimi K2.5nonevsQwen3 Coder NextmediumQwen3 Coder NextmediumvsGrok 4.20 BetanoneMistral Small 4nonevsGLM 4.7 FlashmediumMiniMax M2.5mediumFree AvailablevsMistral Small 4none