Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Mistral: Mistral Small 4 vs Qwen: Qwen3.5-35B-A3B

Summary

Mistral Small 4 vs Qwen3.5-35B-A3B benchmark comparison: Qwen3.5-35B-A3B leads on average score with 5.9 vs 5.1. Mistral Small 4 has the lower benchmark cost at $0.007 vs $0.012. Mistral Small 4 is faster at 630ms vs 3.37s, with pass rates of 27.0% vs 42.9%.

Recommended model: Mistral Small 4 - Its score stays close to the best score here (5.1 vs 5.9), while costing about 1.6x less than Qwen3.5-35B-A3B.

Last updated at: 2026-06-12

Metric Mistral Small 4 Mistral Small 4 none Release: 2026-03-16 Qwen3.5-35B-A3B Qwen3.5-35B-A3B none Release: 2026-02-24
Score 5.1 5.9
Rank #136 #108
Reliability 10.0 10.0
Consistency 9.5 8.9
Tests Correct
Attempt pass rate 27.0% 42.9%
Flaky tests 1 3
Total Runs 63 63
Cost per result 0.139 0.230
Total Cost $0.007 $0.012
Input Price $0.150 / 1M $0.140 / 1M
Output Price $0.600 / 1M $1.000 / 1M
Total Input Tokens 37,309 48,194
Output Tokens 2,201 4,343
Reasoning Tokens 0 0
Response Time (avg) 630ms 3.37s
Response Time (max) 1.72s 47.43s
Response Time (total) 13.22s 70.75s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#136 Mistral Small 4

none
Cost
$0.002
Time
10.4s
Tokens
2,370 tok

#108 Qwen3.5-35B-A3B

none
Cost
$0.005
Time
28.4s
Tokens
4,518 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.4 7.9 16.7% 1 395ms 708 182 0
Qwen3.5-35B-A3B 3.4 7.9 16.7% 1 1.43s 696 574 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.7 9.7 0.0% 0 901ms 7,636 619 0
Qwen3.5-35B-A3B 5.5 10.0 33.3% 0 1.39s 7,808 571 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 1.72s 11,640 496 0
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 47.43s 20,739 1,833 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 822ms 7,914 261 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 1.16s 7,794 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 5.3 10.0 33.3% 0 367ms 798 28 0
Qwen3.5-35B-A3B 7.7 10.0 66.7% 0 485ms 789 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 4.0 10.0 0.0% 0 729ms 519 205 0
Qwen3.5-35B-A3B 6.5 3.4 66.7% 1 1.19s 522 114 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 6.5 10.0 50.0% 0 380ms 729 69 0
Qwen3.5-35B-A3B 6.3 10.0 50.0% 0 809ms 711 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.1 9.9 0.0% 0 399ms 735 111 0
Qwen3.5-35B-A3B 3.7 7.4 22.2% 1 1.35s 714 655 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 1.40s 6,420 213 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.30s 8,211 264 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 397ms 210 17 0
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 493ms 210 11 0

Quick Compare

Switch Comparison Pair

MiniMax M2.7mediumvsMistral Small 4noneGemini 3.1 Flash LiteminimalvsQwen3.5-35B-A3BnoneCobuddymediumvsMistral Small 4noneDeepSeek V4 ProhighvsQwen3.5-35B-A3BnoneGemma 4 31BmediumFree AvailablevsQwen3.5-35B-A3BnoneNemotron 3 SupermediumFree AvailablevsQwen3.5-35B-A3BnoneMiniMax M2.5mediumvsMistral Small 4noneMistral Small 4nonevsQwen3 Coder NextmediumGemini 3.1 Flash LitelowvsQwen3.5-35B-A3BnoneGemini 3.1 Flash Lite PreviewlowvsQwen3.5-35B-A3BnoneGPT-5 NanomediumvsQwen3.5-35B-A3BnoneMiniMax M2.7mediumvsQwen3.5-35B-A3Bnone