Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Mistral: Mistral Small 4 vs Z.ai: GLM 4.7 Flash

Last updated at: 2026-05-01

Metric Mistral Small 4 Mistral Small 4 medium Release: 2026-03-16 GLM 4.7 Flash GLM 4.7 Flash none Release: 2026-01-19
Score 5.7 5.6
Rank #99 #101
Reliability N/A N/A
Consistency 6.8 8.6
Tests Correct
Attempt pass rate 50.0% 37.0%
Flaky tests 7 3
Total Runs 54 54
Cost per result 0.674 0.059
Total Cost $0.034 $0.003
Input Price $0.150 / 1M $0.060 / 1M
Output Price $0.600 / 1M $0.400 / 1M
Output Tokens 15,084 2,489
Reasoning Tokens 39,408 0
Response Time (avg) 5.64s 3.35s
Response Time (max) 30.49s 7.05s
Response Time (total) 101.52s 36.90s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 5.6 3.8 66.7% 3 2.67s 4,055 4,778
GLM 4.7 Flash 5.2 7.9 41.7% 1 5.51s 438 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 6.7 3.5 66.7% 1 30.49s 2,796 11,296
GLM 4.7 Flash 6.4 9.9 0.0% 0 5.57s 626 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 25.25s 2,612 10,700
GLM 4.7 Flash 3.0 10.0 0.0% 0 3.22s 704 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 7.3 5.9 83.3% 1 1.23s 335 723
GLM 4.7 Flash 7.3 5.8 83.3% 1 4.82s 196 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 5.3 7.2 44.4% 1 6.11s 2,621 6,904
GLM 4.7 Flash 7.7 10.0 66.7% 0 744ms 19 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 4.8 10.0 0.0% 0 2.05s 821 828
GLM 4.7 Flash 4.0 10.0 0.0% 0 1.59s 134 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 7.3 5.8 83.3% 1 1.38s 540 1,031
GLM 4.7 Flash 6.5 10.0 50.0% 0 888ms 62 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.4 9.7 0.0% 0 2.00s 983 2,338
GLM 4.7 Flash 4.4 10.0 0.0% 0 1.00s 98 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 3.50s 321 810
GLM 4.7 Flash 2.8 1.6 33.3% 1 7.05s 212 0

Quick Compare

Switch Comparison Pair

MiniMax M2.5mediumFree AvailablevsGLM 4.7 FlashnoneMistral Small 4mediumvsKimi K2.5noneMistral Small 4mediumvsGLM 5.1noneMistral Small 4mediumvsQwen3.6 FlashnoneMistral Small 4mediumvsGLM 5 TurbononeMistral Small 4mediumvsMiMo-V2.5-PrononeMistral Small 4mediumvsQwen3.5 Plus 2026-04-20noneMistral Small 4mediumvsKimi K2.6noneMistral Small 4mediumvsGPT-5.4noneMistral Small 4mediumvsQwen3.5-122B-A10BnoneMistral Small 4mediumvsGrok 4.20noneOwl AlphamediumvsGLM 4.7 Flashnone