#55
Mistral · Release: 2026-03-16 · mistralai/mistral-small-2603::medium
Flaky tests
6
Flaky tests had mixed outcomes across runs (at least one pass and one fail).
Charts
Choose the first model, then click a second model to open a side-by-side page.
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Quick Compare
Mistral Small 4mediumvsGPT-5.4noneMistral Small 4mediumvsQwen3.5-122B-A10BnoneMistral Small 4mediumvsGLM 5 TurbononeMistral Small 4mediumvsHunter AlphanoneMistral Small 4mediumvsGLM 4.7 FlashnoneMistral Small 4mediumvsGemini 3 Flash PreviewmediumMistral Small 4mediumvsGemini 3.1 Pro PreviewmediumMistral Small 4mediumvsStep 3.5 FlashmediumFree Available
Category Breakdown
| Category | Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 5.6 | 3.8 | |
| Combined | 3.0 | 10.0 | |
| Data parsing and extraction | 7.3 | 5.9 | |
| Domain specific | 5.3 | 7.2 | |
| General Intelligence | 4.8 | 10.0 | |
| Instructions following | 7.3 | 5.8 | |
| Puzzle Solving | 3.4 | 9.7 | |
| Tool Calling | 10.0 | 10.0 |