Advertise here
#352

Mistral Small 4

Mistral Release: 2026-03-16 Tested on: 2026-10-01 01:29 mistralai/mistral-small-2603::medium
119B total (6B active)MoEOpen source
(medium) (none)

Summary

Mistral Small 4 scores 5.1 on AI BENCHY and ranks #352. It has 9.7 reliability, a 42.0% pass rate, $0.126 total cost, and 12.68s average response time.

Model facts

Researched on 2026-08-12

Reported
Parameters
119B total (6B active)
Architecture
MoE
Availability
Open source
License
Apache-2.0

The vendor also reports 8B active when embeddings are included; UI uses routed active parameters.

Parameter source Availability source

Score

5.1

Consistency

7.1

Reliability

9.7

Total Cost (Current Price)

$0.126 ↑ +0.5%

Tested at: $0.126

Total Output Tokens

127,970

Total Input Tokens

321,955

Input Price

$0.150 / 1M

Output Price

$0.600 / 1M

Cache Read Price

$0.015 / 1M

Cache Write Price

N/A

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Tests Correct

Wrong Tests: 18

Attempt pass rate: 42.0%

Flaky tests

8

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

12.68s

Response Time (max): 59.15s

Response Time (total): 291.66s

Wrong answer: 14 Did not follow instructions: 2 API error: 1 No answer: 1

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#352 Mistral Small 4

medium
Cost
$0.006
Time
47.9s
Tokens
9,857 tok

Run history

Tested on Score Reliability Tests Correct Total Cost Compare
2026-10-01 01:29 Re-test 5.1 9.7 $0.126 ↑ Current run
2026-07-16 22:23 New test added 5.1 10.0 $0.096 Compare
2026-06-04 13:43 New test added 5.3 10.0 $0.068 Compare
2026-05-22 00:16 Suite changed 5.4 10.0 $0.056 Compare
2026-04-11 01:44 First recorded run 5.7 N/A $0.034 Compare

This run used a different benchmark suite. Keep suite changes in mind when reading historical movement.

Run comparison

RunBenchmark coverageScoreConsistencyReliabilityTests CorrectFlaky testsTotal Output TokensTotal Input TokensTotal CostResponse Time (avg)
2026-10-01 01:29 · Current run69/69 attempts5.17.19.75/238127,970321,955$0.12612.68s
2026-06-04 13:43 · New test added63/63 attempts5.36.910.05/218108,86242,576$0.0689.40s
Difference—-0.2+0.2-0.300+19108+279379+$0.059+3281ms

Benchmark coverage differs: 69/69 attempts (Target: 3 repeats per test) versus 63/63 attempts (Target: 3 repeats per test). Totals and repeat-sensitive metrics are not directly comparable.

These two runs used different benchmark suites, so the deltas reflect both model changes and suite changes.

Price History

Historical pricing data for this model from OpenRouter.

Date Input Price Output Price Cache Read Price Cache Write Price
2026-08-14 12:51 $0.150 / 1M $0.600 / 1M N/A N/A
2026-10-01 18:33 $0.150 / 1M $0.600 / 1M $0.015 / 1M N/A

Charts

Choose the first model, then click a second model to open a side-by-side page.

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Mistral Small 4mediumvsKAT Coder AIR V2.5highMistral Small 4mediumvsMistral Small 4noneMistral Small 4mediumvsNemotron 3.5 LightninghighFree AvailableMistral Small 4mediumvsMercury 2.5lowMistral Small 4mediumvsLing 3.0 FlashnoneMistral Small 4mediumvsKAT Coder AIR V2.5mediumMistral Small 4mediumvsInkling SmalllowFree AvailableMistral Small 4mediumvsMiMo-V2.5-PrononeMistral Small 4mediumvsQwen3.6 35B A3BnoneMistral Small 4mediumvsApodex 1.1 MinidefaultFree Available

Category Breakdown

Category Score Consistency Tests Correct
Agentic 5.0 10.0
Anti-AI Tricks 5.6 3.8
Coding 4.4 5.1
Combined 3.0 10.0
Data parsing and extraction 7.3 5.9
Domain specific 5.9 7.2
General Intelligence 4.8 10.0
Instructions following 7.3 5.8
Puzzle Solving 3.4 9.7
Tool Calling 10.0 10.0
Trivia 3.0 10.0

Compared models