Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Mistral Small 4 (medium) vs Inkling 2 Mini (max)

The average score is effectively tied at 5.1 vs 5.1. Mistral Small 4 (medium) has the lower benchmark cost at $0.126 vs $0.807. Mistral Small 4 (medium) is faster at 12.68s vs 101.15s, with pass rates of 42.0% vs 44.9%.

Last updated at: 2026-11-22

Compared models

Rank
#420
Total Output Tokens
127,970
Response Time (avg)
12.68s
Total Cost
$0.126
Rank
#422
Total Output Tokens
1,905,544
Response Time (avg)
101.15s
Total Cost
$0.807
Recommended model Mistral Small 4 (medium)

It has the best score here (5.1), while costing about 6.4x less than Inkling 2 Mini (max).

Detailed comparison

Metric Mistral Small 4 Mistral Small 4 medium Release: 2026-03-16 Inkling 2 Mini Inkling 2 Mini max Release: 2026-11-20
Score 5.1 5.1
Rank #420 #422
Reliability 9.7 10.0
Consistency 7.1 8.8
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 42.0% 44.9%
Flaky tests 8 3
Total Runs 69 69
Cost per result 2.502 8.966
Total Cost $0.126 $0.807
Input Price $0.150 / 1M $0.100 / 1M
Output Price $0.600 / 1M $0.400 / 1M
Cache Read Price $0.015 / 1M $0.020 / 1M
Cache Write Price N/A N/A
Total Input Tokens 321,955 447,169
Output Tokens 41,555 13,089
Reasoning Tokens 94,946 1,892,455
Response Time (avg) 12.68s 101.15s
Response Time (max) 59.15s 329.72s
Response Time (total) 291.66s 2326.39s
Parameters 119B total (6B active) 26.4B total (3.4B active)
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#420 Mistral Small 4

medium
Cost
$0.006
Time
47.9s
Tokens
9,857 tok

#422 Thinking Machines: Inkling 2 Mini

max
Cost
$0.003
Time
48.7s
Tokens
7,967 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 4.4 5.1 33.3% 2 39.98s 7,636 11,635 54,715
Inkling 2 Mini 2.9 10.0 0.0% 0 222.76s 8,814 0 589,824

Switch Comparison Pair