Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Mistral: Mistral Small 4 vs Z.ai: GLM 4.7 Flash

Summary

Mistral Small 4 vs GLM 4.7 Flash benchmark comparison: Mistral Small 4 leads on average score with 5.1 vs 4.3. Mistral Small 4 has the lower benchmark cost at $0.007 vs $0.054. Mistral Small 4 is faster at 630ms vs 35.10s, with pass rates of 27.0% vs 33.3%.

Recommended model: Mistral Small 4 - It has the best score here (5.1), while costing about 7.7x less than GLM 4.7 Flash.

Last updated at: 2026-06-12

Metric Mistral Small 4 Mistral Small 4 none Release: 2026-03-16 GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score 5.1 4.3
Rank #136 #159
Reliability 10.0 6.7
Consistency 9.5 6.8
Tests Correct
Attempt pass rate 27.0% 33.3%
Flaky tests 1 8
Total Runs 63 63
Cost per result 0.139 1.337
Total Cost $0.007 $0.054
Input Price $0.150 / 1M $0.060 / 1M
Output Price $0.600 / 1M $0.400 / 1M
Total Input Tokens 37,309 37,206
Output Tokens 2,201 43,754
Reasoning Tokens 0 89,079
Response Time (avg) 630ms 35.10s
Response Time (max) 1.72s 174.55s
Response Time (total) 13.22s 456.24s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#136 Mistral Small 4

none
Cost
$0.002
Time
10.4s
Tokens
2,370 tok

#159 GLM 4.7 Flash

medium
Invalid SVG
Cost
$0.000
Time
186.2s
Tokens
12,112 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.4 7.9 16.7% 1 395ms 708 182 0
GLM 4.7 Flash 4.7 5.9 41.7% 2 14.95s 555 1,122 6,110
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.7 9.7 0.0% 0 901ms 7,636 619 0
GLM 4.7 Flash 3.2 7.4 11.1% 1 55.33s 3,106 4,981 22,387
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 1.72s 11,640 496 0
GLM 4.7 Flash 2.8 2.1 33.3% 1 65.57s 17,185 2,585 20,648
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 822ms 7,914 261 0
GLM 4.7 Flash 6.3 10.0 50.0% 0 1.51s 7,107 584 2,755
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 5.3 10.0 33.3% 0 367ms 798 28 0
GLM 4.7 Flash 3.5 4.4 33.3% 2 174.55s 643 33,000 25,394
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 4.0 10.0 0.0% 0 729ms 519 205 0
GLM 4.7 Flash 3.6 9.7 0.0% 0 18.14s 318 18 2,138
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 6.5 10.0 50.0% 0 380ms 729 69 0
GLM 4.7 Flash 6.2 5.8 66.7% 1 2.97s 636 388 2,181
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.1 9.9 0.0% 0 399ms 735 111 0
GLM 4.7 Flash 2.9 7.2 11.1% 1 12.93s 521 781 5,255
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 1.40s 6,420 213 0
GLM 4.7 Flash 10.0 10.0 100.0% 0 15.95s 6,949 224 1,014
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 397ms 210 17 0
GLM 4.7 Flash 3.0 10.0 0.0% 0 11.13s 186 71 1,197

Quick Compare

Switch Comparison Pair

MiMo-V2-FlashnonevsGLM 4.7 FlashmediumMiniMax M2.7mediumvsMistral Small 4noneCobuddymediumvsMistral Small 4noneGranite 4.1 8BnonevsGLM 4.7 FlashmediumMercury 2nonevsGLM 4.7 FlashmediumLing-2.6-1TnonevsGLM 4.7 FlashmediumMiniMax M2.5mediumvsMistral Small 4noneMistral Small 4nonevsQwen3 Coder Nextmediumgpt-oss-120bnoneFree AvailablevsGLM 4.7 FlashmediumGPT-5.4 NanononevsGLM 4.7 FlashmediumRing-2.6-1TnonevsGLM 4.7 FlashmediumLing-2.6-flashnonevsGLM 4.7 Flashmedium