Navigate
Advertise here

Mistral Small 4 (medium) vs MiMo-V2.5-Pro

The average score is effectively tied at 5.1 vs 5.1. Mistral Small 4 (medium) has the lower benchmark cost at $0.126 vs $0.135. MiMo-V2.5-Pro is faster at 6.21s vs 12.68s, with pass rates of 42.0% vs 31.9%.

Last updated at: 2026-11-13

Compared models

Rank
#389
Total Output Tokens
127,970
Response Time (avg)
12.68s
Total Cost
$0.126
Rank
#393
Total Output Tokens
17,069
Response Time (avg)
6.21s
Total Cost
$0.135
Recommended model MiMo-V2.5-Pro

It has the best score here (5.1), while responding about 2.0x faster than Mistral Small 4 (medium).

Detailed comparison

Metric Mistral Small 4 Mistral Small 4 medium Release: 2026-03-16 MiMo-V2.5-Pro MiMo-V2.5-Pro none Release: 2026-04-22
Score 5.1 5.1
Rank #389 #393
Reliability 9.7 10.0
Consistency 7.1 8.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 42.0% 31.9%
Flaky tests 8 4
Total Runs 69 69
Cost per result 2.502 3.128
Total Cost $0.126 $0.135
Input Price $0.150 / 1M $0.435 / 1M
Output Price $0.600 / 1M $0.870 / 1M
Cache Read Price $0.015 / 1M $0.004 / 1M
Cache Write Price N/A N/A
Total Input Tokens 321,955 273,075
Output Tokens 41,555 17,069
Reasoning Tokens 94,946 0
Response Time (avg) 12.68s 6.21s
Response Time (max) 59.15s 53.13s
Response Time (total) 291.66s 142.89s
Parameters 119B total (6B active) 1.02T total (42B active)
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#389 Mistral Small 4

medium
Cost
$0.006
Time
47.9s
Tokens
9,857 tok

#393 MiMo-V2.5-Pro

none
Cost
$0.004
Time
46.4s
Tokens
4,025 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 4.4 5.1 33.3% 2 39.98s 7,636 11,635 54,715
MiMo-V2.5-Pro 4.3 7.8 22.2% 1 1.41s 6,559 485 0

Switch Comparison Pair