Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Mistral: Mistral Small 4 vs Qwen: Qwen3.5-9B

Last updated at: 2026-04-26

Metric Mistral Small 4 Mistral Small 4 none Release: 2026-03-16 Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02
Score 5.2 4.8
Rank #97 #105
Reliability N/A N/A
Consistency 9.5 9.6
Tests Correct
Attempt pass rate 31.5% 24.1%
Flaky tests 1 1
Total Runs 54 54
Cost per result 0.118 0.116
Total Cost $0.006 $0.005
Input Price $0.150 / 1M $0.100 / 1M
Output Price $0.600 / 1M $0.150 / 1M
Output Tokens 2,207 3,951
Reasoning Tokens 0 0
Response Time (avg) 665ms 1.47s
Response Time (max) 1.72s 5.91s
Response Time (total) 11.97s 26.43s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.4 7.9 16.7% 1 395ms 182 0
Qwen3.5-9B 3.1 9.9 0.0% 0 1.71s 582 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 4.5 9.0 0.0% 0 1.28s 583 0
Qwen3.5-9B 5.2 3.4 33.3% 1 5.69s 1,006 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 1.72s 496 0
Qwen3.5-9B 3.0 10.0 0.0% 0 5.91s 1,255 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 822ms 261 0
Qwen3.5-9B 10.0 10.0 100.0% 0 847ms 249 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 5.3 10.0 33.3% 0 367ms 28 0
Qwen3.5-9B 3.0 10.0 0.0% 0 464ms 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 4.0 10.0 0.0% 0 729ms 205 0
Qwen3.5-9B 4.4 9.9 0.0% 0 552ms 99 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 6.5 10.0 50.0% 0 380ms 69 0
Qwen3.5-9B 6.5 10.0 50.0% 0 514ms 75 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.1 9.9 0.0% 0 589ms 170 0
Qwen3.5-9B 3.2 9.9 0.0% 0 683ms 388 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 1.40s 213 0
Qwen3.5-9B 10.0 10.0 100.0% 0 1.27s 273 0

Quick Compare

Switch Comparison Pair

Mistral Small 4nonevsElephant AlphamediumMiniMax M2.7mediumvsMistral Small 4noneQwen3.5-9BnonevsGLM 4.7 FlashmediumElephant AlphamediumvsQwen3.5-9BnoneMiniMax M2.7mediumvsQwen3.5-9BnoneMiniMax M2.5mediumFree AvailablevsMistral Small 4noneMistral Small 4nonevsQwen3 Coder NextmediumMistral Small 4nonevsGLM 4.7 FlashmediumMistral Small 4nonevsgpt-oss-120bmediumFree AvailableMistral Small 4nonevsQwen3.5-9BmediumMistral Small 4mediumvsQwen3.5-9BnoneMiniMax M2.5mediumFree AvailablevsQwen3.5-9Bnone