Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Mistral: Mistral Small 4 vs Qwen: Qwen3.5-35B-A3B

Last updated at: 2026-05-01

Metric Mistral Small 4 Mistral Small 4 medium Release: 2026-03-16 Qwen3.5-35B-A3B Qwen3.5-35B-A3B none Release: 2026-02-24
Score 5.7 6.1
Rank #99 #82
Reliability N/A N/A
Consistency 6.8 8.7
Tests Correct
Attempt pass rate 50.0% 50.0%
Flaky tests 7 3
Total Runs 54 54
Cost per result 0.674 0.215
Total Cost $0.034 $0.016
Input Price $0.150 / 1M $0.163 / 1M
Output Price $0.600 / 1M $1.300 / 1M
Output Tokens 15,084 4,300
Reasoning Tokens 39,408 0
Response Time (avg) 5.64s 3.82s
Response Time (max) 30.49s 47.43s
Response Time (total) 101.52s 68.74s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 5.6 3.8 66.7% 3 2.67s 4,055 4,778
Qwen3.5-35B-A3B 3.4 7.9 16.7% 1 1.43s 574 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 6.7 3.5 66.7% 1 30.49s 2,796 11,296
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.67s 539 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 25.25s 2,612 10,700
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 47.43s 1,833 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 7.3 5.9 83.3% 1 1.23s 335 723
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 1.16s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 5.3 7.2 44.4% 1 6.11s 2,621 6,904
Qwen3.5-35B-A3B 7.7 10.0 66.7% 0 485ms 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 4.8 10.0 0.0% 0 2.05s 821 828
Qwen3.5-35B-A3B 6.5 3.4 66.7% 1 1.19s 114 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 7.3 5.8 83.3% 1 1.38s 540 1,031
Qwen3.5-35B-A3B 6.3 10.0 50.0% 0 809ms 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.4 9.7 0.0% 0 2.00s 983 2,338
Qwen3.5-35B-A3B 3.9 7.4 22.2% 1 1.34s 655 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 3.50s 321 810
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.30s 264 0

Quick Compare

Switch Comparison Pair

Laguna Xs.2mediumFree AvailablevsQwen3.5-35B-A3BnoneMistral Small 4mediumvsGLM 4.7 FlashnoneMistral Small 4mediumvsKimi K2.5noneMistral Small 4mediumvsGLM 5.1noneMistral Small 4mediumvsQwen3.6 FlashnoneMistral Small 4mediumvsGLM 5 TurbononeMistral Small 4mediumvsMiMo-V2.5-PrononeMistral Small 4mediumvsQwen3.5 Plus 2026-04-20noneMistral Small 4mediumvsKimi K2.6noneLaguna M.1mediumFree AvailablevsQwen3.5-35B-A3BnoneMistral Small 4mediumvsGPT-5.4noneMistral Small 4mediumvsQwen3.5-122B-A10Bnone