AI BENCHY Compare

Mistral: Mistral Small 4 vs Qwen: Qwen3 Coder Next

Last updated at: 2026-05-01

Metric	Mistral Small 4 Mistral Small 4 medium Release: 2026-03-16	Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03

Metric	Mistral Small 4 Mistral Small 4 medium Release: 2026-03-16	Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03
Score	5.7	5.3
Rank	#99	#108
Reliability	N/A	N/A
Consistency	6.8	9.7
Tests Correct
Attempt pass rate	50.0%	31.5%
Flaky tests	7	1
Total Runs	54	54
Cost per result	0.674	0.150
Total Cost	$0.034	$0.008
Input Price	$0.150 / 1M	$0.140 / 1M
Output Price	$0.600 / 1M	$0.800 / 1M
Output Tokens	15,084	3,617
Reasoning Tokens	39,408	0
Response Time (avg)	5.64s	10.18s
Response Time (max)	30.49s	45.14s
Response Time (total)	101.52s	122.13s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Mistral Small 4	5.6	3.8	66.7%	3		2.67s	4,055	4,778
Qwen3 Coder Next	3.6	10.0	0.0%	0		3.31s	1,321	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Mistral Small 4	6.7	3.5	66.7%	1		30.49s	2,796	11,296
Qwen3 Coder Next	7.3	3.7	66.7%	1		3.14s	585	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Mistral Small 4	3.0	10.0	0.0%	0		25.25s	2,612	10,700
Qwen3 Coder Next	3.0	10.0	0.0%	0		45.14s	317	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Mistral Small 4	7.3	5.9	83.3%	1		1.23s	335	723
Qwen3 Coder Next	6.5	10.0	50.0%	0		1.32s	246	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Mistral Small 4	5.3	7.2	44.4%	1		6.11s	2,621	6,904
Qwen3 Coder Next	5.3	10.0	33.3%	0		962ms	26	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Mistral Small 4	4.8	10.0	0.0%	0		2.05s	821	828
Qwen3 Coder Next	10.0	10.0	100.0%	0		1.34s	152	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Mistral Small 4	7.3	5.8	83.3%	1		1.38s	540	1,031
Qwen3 Coder Next	6.3	10.0	50.0%	0		7.71s	63	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Mistral Small 4	3.4	9.7	0.0%	0		2.00s	983	2,338
Qwen3 Coder Next	3.2	10.0	0.0%	0		22.86s	652	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Mistral Small 4	10.0	10.0	100.0%	0		3.50s	321	810
Qwen3 Coder Next	10.0	10.0	100.0%	0		2.47s	255	0

Quick Compare

Switch Comparison Pair

MiniMax M2.7mediumvsQwen3 Coder Nextnone Elephant AlphamediumvsQwen3 Coder Nextnone Mistral Small 4mediumvsGLM 4.7 Flashnone Nemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsQwen3 Coder Nextnone Mistral Small 4mediumvsKimi K2.5none Mistral Small 4mediumvsGLM 5.1none Mistral Small 4mediumvsQwen3.6 Flashnone Mistral Small 4mediumvsGLM 5 Turbonone Mistral Small 4mediumvsMiMo-V2.5-Pronone Mistral Small 4mediumvsQwen3.5 Plus 2026-04-20none Mistral Small 4mediumvsKimi K2.6none Mistral Small 4mediumvsGPT-5.4none