Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Mistral: Mistral Small 4 vs Qwen: Qwen3.5-122B-A10B

Last updated at: 2026-03-17

Metric Mistral Small 4 Mistral Small 4 medium Release: 2026-03-16 Qwen3.5-122B-A10B Qwen3.5-122B-A10B none Release: 2026-02-24
Rank #55 #52
Score 5.6 5.8
Consistency 7.0 9.6
Cost per result 0.502 0.333
Total Cost $0.026 $0.020
Tests Correct
Attempt pass rate 49.0% 37.3%
Flaky tests 6 1
Total Runs 51 51
Output Tokens 12,288 2,682
Reasoning Tokens 28,112 0
Response Time (avg) 4.18s 3.71s
Response Time (max) 25.25s 46.00s
Response Time (total) 71.03s 63.06s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 5.6 3.8 66.7% 3 2.67s 4,055 4,778
Qwen3.5-122B-A10B 4.8 10.0 25.0% 0 1.59s 312 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 25.25s 2,612 10,700
Qwen3.5-122B-A10B 3.0 10.0 0.0% 0 46.00s 1,137 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 7.3 5.9 83.3% 1 1.23s 335 723
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 1.01s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 5.3 7.2 44.4% 1 6.11s 2,621 6,904
Qwen3.5-122B-A10B 5.3 10.0 33.3% 0 465ms 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 4.8 10.0 0.0% 0 2.05s 821 828
Qwen3.5-122B-A10B 5.0 10.0 0.0% 0 1.12s 66 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 7.3 5.8 83.3% 1 1.38s 540 1,031
Qwen3.5-122B-A10B 4.5 6.8 16.7% 1 585ms 70 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.4 9.7 0.0% 0 2.00s 983 2,338
Qwen3.5-122B-A10B 5.4 10.0 33.3% 0 982ms 575 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 3.50s 321 810
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 2.04s 264 0

Quick Compare

Switch Comparison Pair