Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Mistral: Mistral Small 4 vs Z.ai: GLM 4.7 Flash

Last updated at: 2026-03-17

Metric Mistral Small 4 Mistral Small 4 none Release: 2026-03-16 GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Rank #61 #69
Score 5.3 4.7
Consistency 9.5 6.6
Cost per result 0.108 1.046
Total Cost $0.006 $0.042
Tests Correct
Attempt pass rate 33.3% 39.2%
Flaky tests 1 7
Total Runs 51 51
Output Tokens 1,624 38,719
Reasoning Tokens 0 65,465
Response Time (avg) 629ms 33.44s
Response Time (max) 1.72s 174.55s
Response Time (total) 10.70s 334.39s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.4 7.9 16.7% 1 395ms 182 0
GLM 4.7 Flash 4.7 5.9 41.7% 2 14.95s 1,122 6,110
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 1.72s 496 0
GLM 4.7 Flash 2.8 2.1 33.3% 1 65.57s 2,585 20,648
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 822ms 261 0
GLM 4.7 Flash 6.3 10.0 50.0% 0 1.51s 584 2,755
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 5.3 10.0 33.3% 0 367ms 28 0
GLM 4.7 Flash 3.5 4.4 33.3% 2 174.55s 33,000 25,394
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 4.0 10.0 0.0% 0 729ms 205 0
GLM 4.7 Flash 3.6 9.7 0.0% 0 18.14s 18 2,138
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 6.5 10.0 50.0% 0 380ms 69 0
GLM 4.7 Flash 6.2 5.8 66.7% 1 2.97s 388 2,181
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.1 9.9 0.0% 0 589ms 170 0
GLM 4.7 Flash 2.9 7.2 11.1% 1 12.90s 798 5,225
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 1.40s 213 0
GLM 4.7 Flash 10.0 10.0 100.0% 0 15.95s 224 1,014

Quick Compare

Switch Comparison Pair

Qwen3.5-9BnonevsGLM 4.7 FlashmediumGPT-5.4 MininonevsGLM 4.7 FlashmediumMercury 2nonevsGLM 4.7 FlashmediumGrok 4.1 FastnonevsGLM 4.7 FlashmediumMiMo-V2-FlashnonevsGLM 4.7 FlashmediumQwen3 Coder NextnonevsGLM 4.7 FlashmediumGPT-4o-mininonevsGLM 4.7 FlashmediumGPT-5.4 NanononevsGLM 4.7 FlashmediumMistral Small 4nonevsQwen3 Coder NextmediumNemotron 3 Super 120b A12bnoneFree AvailablevsGLM 4.7 FlashmediumTrinity Large PreviewnoneFree AvailablevsGLM 4.7 FlashmediumMiniMax M2.5mediumFree AvailablevsMistral Small 4none