- Rank
- #230
- Total Output Tokens
- 180,597
- Response Time (avg)
- 7.61s
- Total Cost
- $0.040
Mercury 2.5 Preview (high) vs Minimax M3.1 Flash (high)
The average score is effectively tied at 6.5 vs 6.5. Minimax M3.1 Flash (high) has the lower benchmark cost at $0.000 vs $0.040. Mercury 2.5 Preview (high) is faster at 7.61s vs 34.00s, with pass rates of 65.2% vs 56.5%.
Compared models
- Rank
- #228
- Total Output Tokens
- 279,438
- Response Time (avg)
- 34.00s
- Total Cost
- $0.000
Recommended model
Mercury 2.5 Preview (high)
It has the best score here (6.5), while responding about 4.5x faster than Minimax M3.1 Flash (high).
Detailed comparison
| Metric | Mercury 2.5 Preview Mercury 2.5 Preview high | Minimax M3.1 Flash Minimax M3.1 Flash high Free Available |
|---|---|---|
| Score | 6.5 | 6.5 |
| Rank | #230 | #228 |
| Reliability | 9.9 | 10.0 |
| Consistency | 8.0 | 7.2 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 65.2% | 56.5% |
| Flaky tests | 6 | 8 |
| Total Runs | 69 | 69 |
| Cost per result | 0.319 | 0.000 |
| Total Cost | $0.040 | $0.000 |
| Input Price | $0.040 / 1M | $0.000 / 1M |
| Output Price | $0.150 / 1M | $0.000 / 1M |
| Cache Read Price | N/A | N/A |
| Cache Write Price | N/A | N/A |
| Total Input Tokens | 298,512 | 357,984 |
| Output Tokens | 3,178 | 70,004 |
| Reasoning Tokens | 177,419 | 209,434 |
| Response Time (avg) | 7.61s | 34.00s |
| Response Time (max) | 86.84s | 280.72s |
| Response Time (total) | 175.08s | 781.92s |
| Parameters | ~100B | - |
| Availability | Closed | Closed |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#230 Mercury 2.5 Preview
high- Cost
- $0.001
- Time
- 4.5s
- Tokens
- 3,851 tok
#228 Minimax M3.1 Flash
high- Cost
- $0.000
- Time
- 75.4s
- Tokens
- 9,436 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 6.1 | 3.1 | 66.7% | 1 | 86.84s | 182,753 | 616 | 16,476 | |
| Minimax M3.1 Flash | 6.1 | 3.1 | 66.7% | 1 | 70.45s | 201,388 | 2,187 | 15,284 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.09s | 785 | 181 | 7,008 | |
| Minimax M3.1 Flash | 6.4 | 7.9 | 58.3% | 1 | 2.71s | 2,838 | 154 | 2,428 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 6.7 | 7.8 | 55.6% | 1 | 6.13s | 7,751 | 485 | 42,569 | |
| Minimax M3.1 Flash | 5.6 | 4.7 | 55.6% | 2 | 36.78s | 9,024 | 60,602 | 13,024 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.8 | 1.6 | 50.0% | 2 | 14.36s | 95,789 | 765 | 54,789 | |
| Minimax M3.1 Flash | 10.0 | 10.0 | 100.0% | 0 | 34.77s | 124,090 | 6,299 | 25,610 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 2.24s | 8,292 | 560 | 8,522 | |
| Minimax M3.1 Flash | 6.5 | 10.0 | 50.0% | 0 | 1.00s | 2,802 | 111 | 224 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 2.9 | 4.4 | 22.2% | 2 | 5.68s | 857 | 67 | 25,958 | |
| Minimax M3.1 Flash | 5.9 | 7.2 | 55.6% | 1 | 134.49s | 2,400 | 17 | 119,910 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 5.1 | 10.0 | 0.0% | 0 | 1.88s | 542 | 94 | 3,300 | |
| Minimax M3.1 Flash | 4.6 | 9.8 | 0.0% | 0 | 5.16s | 1,032 | 88 | 1,122 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 9.8 | 10.0 | 100.0% | 0 | 1.05s | 741 | 94 | 3,777 | |
| Minimax M3.1 Flash | 5.3 | 2.6 | 50.0% | 2 | 1.65s | 1,779 | 60 | 610 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.21s | 774 | 292 | 6,066 | |
| Minimax M3.1 Flash | 6.0 | 7.1 | 55.6% | 1 | 3.48s | 2,313 | 166 | 2,004 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 2.25s | 0 | 0 | 0 | |
| Minimax M3.1 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.38s | 9,565 | 306 | 76 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 5.41s | 228 | 24 | 8,954 | |
| Minimax M3.1 Flash | 3.0 | 10.0 | 0.0% | 0 | 93.01s | 753 | 14 | 29,142 |
Quick Compare
Switch Comparison Pair
Minimax M3.1 FlashhighFree AvailablevsQwen3.6 35B A3BmediumClaude Sonnet 5.5mediumvsMinimax M3.1 FlashhighFree AvailableMercury 2.5 PreviewhighvsQwen3.6 35B A3BmediumMercury 2.5 PreviewhighvsBeam 1.0 501B A23BxhighMercury 2.5 PreviewhighvsGLM 5.3lowClaude Sonnet 5.5mediumvsMercury 2.5 PreviewhighMinimax M3.1 FlashhighFree AvailablevsBeam 1.0 501B A23BxhighMinimax M3.1 FlashhighFree AvailablevsGLM 5.3lowMercury 2.5 PreviewhighvsGLM 5.1noneMercury 2.5 PreviewhighvsGrok 4.3mediumKAT-Coder-Pro V2.5lowvsMinimax M3.1 FlashhighFree AvailableMinimax M3.1 FlashhighFree AvailablevsGLM 5.1none