Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Mistral: Mistral Small 4 vs GLM 5v Turbo X Ai/grok 4.20 Google/gemma 4 31b IT

Last updated at: 2026-04-02

Metric Mistral Small 4 Mistral Small 4 medium Release: 2026-03-16 GLM 5v Turbo X Ai/grok 4.20 Google/gemma 4 31b IT GLM 5v Turbo X Ai/grok 4.20 Google/gemma 4 31b IT none Release: Unknown release date
Score 5.6 3.0
Rank #66 #88
Consistency 7.0 10.0
Tests Correct
Attempt pass rate 49.0% 0.0%
Flaky tests 6 0
Total Runs 51 48
Cost per result 0.502 0.000
Total Cost $0.026 $0.000
Input Price $0.150 / 1M $0.000 / 1M
Output Price $0.600 / 1M $0.000 / 1M
Output Tokens 12,288 0
Reasoning Tokens 28,112 0
Response Time (avg) 4.18s 0ms
Response Time (max) 25.25s 0ms
Response Time (total) 71.03s 0ms

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 5.6 3.8 66.7% 3 2.67s 4,055 4,778
GLM 5v Turbo X Ai/grok 4.20 Google/gemma 4 31b IT 3.0 10.0 0.0% 0 0ms 0 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 25.25s 2,612 10,700
GLM 5v Turbo X Ai/grok 4.20 Google/gemma 4 31b IT 3.0 10.0 0.0% 0 0ms 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 7.3 5.9 83.3% 1 1.23s 335 723
GLM 5v Turbo X Ai/grok 4.20 Google/gemma 4 31b IT 3.0 10.0 0.0% 0 0ms 0 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 5.3 7.2 44.4% 1 6.11s 2,621 6,904
GLM 5v Turbo X Ai/grok 4.20 Google/gemma 4 31b IT 3.0 10.0 0.0% 0 0ms 0 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 4.8 10.0 0.0% 0 2.05s 821 828
GLM 5v Turbo X Ai/grok 4.20 Google/gemma 4 31b IT 3.0 10.0 0.0% 0 0ms 0 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 7.3 5.8 83.3% 1 1.38s 540 1,031
GLM 5v Turbo X Ai/grok 4.20 Google/gemma 4 31b IT 3.0 10.0 0.0% 0 0ms 0 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.4 9.7 0.0% 0 2.00s 983 2,338
GLM 5v Turbo X Ai/grok 4.20 Google/gemma 4 31b IT 3.0 10.0 0.0% 0 0ms 0 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 3.50s 321 810
GLM 5v Turbo X Ai/grok 4.20 Google/gemma 4 31b IT 3.0 10.0 0.0% 0 0ms 0 0

Quick Compare

Switch Comparison Pair

Mistral Small 4mediumvsGLM 5 TurbononeMistral Small 4mediumvsGLM 4.7 FlashnoneMistral Small 4mediumvsQwen3.5-27BnoneMistral Small 4mediumvsGPT-5.4noneMistral Small 4mediumvsMiMo-V2-PrononeMistral Small 4mediumvsQwen3.5-122B-A10BnoneMistral Small 4mediumvsGrok 4.20noneMistral Small 4mediumvsGrok 4.20 BetanoneMistral Small 4mediumvsKimi K2.5noneMistral Small 4mediumvsHunter AlphanoneTrinity Large PreviewnoneFree AvailablevsMistral Small 4mediumMistral Small 4mediumvsQwen3.5-35B-A3Bnone