- Rank
- #197
- Total Output Tokens
- 277,315
- Response Time (avg)
- 78.76s
- Total Cost
- $0.144
Gemma 4 31B (medium) vs Minimax M3.1 Flash (max)
Minimax M3.1 Flash (max) leads on average score with 6.9 vs 6.9. Minimax M3.1 Flash (max) has the lower benchmark cost at $0.000 vs $0.144. Minimax M3.1 Flash (max) is faster at 40.94s vs 78.76s, with pass rates of 66.7% vs 59.4%.
Compared models
- Rank
- #194
- Total Output Tokens
- 311,683
- Response Time (avg)
- 40.94s
- Total Cost
- $0.000
Recommended model
Gemma 4 31B (medium)
It has the best overall balance of score, reliability, cost, and response time in this comparison.
Detailed comparison
| Metric | Gemma 4 31B Gemma 4 31B medium Free Available | Minimax M3.1 Flash Minimax M3.1 Flash max Free Available |
|---|---|---|
| Score | 6.9 | 6.9 |
| Rank | #197 | #194 |
| Reliability | 10.0 | 10.0 |
| Consistency | 8.7 | 8.0 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 66.7% | 59.4% |
| Flaky tests | 3 | 6 |
| Total Runs | 69 | 69 |
| Cost per result | 1.195 | 0.000 |
| Total Cost | $0.144 | $0.000 |
| Input Price | $0.090 / 1M | $0.000 / 1M |
| Output Price | $0.340 / 1M | $0.000 / 1M |
| Cache Read Price | $0.050 / 1M | N/A |
| Cache Write Price | N/A | N/A |
| Total Input Tokens | 251,164 | 398,523 |
| Output Tokens | 36,112 | 7,992 |
| Reasoning Tokens | 241,203 | 303,691 |
| Response Time (avg) | 78.76s | 40.94s |
| Response Time (max) | 437.40s | 256.57s |
| Response Time (total) | 1653.96s | 941.68s |
| Parameters | 30.7B | - |
| Availability | Open source | Closed |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#197 Gemma 4 31B
medium- Cost
- $0.002
- Time
- 45.7s
- Tokens
- 2,696 tok
#194 Minimax M3.1 Flash
max- Cost
- $0.000
- Time
- 174.6s
- Tokens
- 20,628 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 10.0 | 10.0 | 100.0% | 0 | 82.13s | 156,195 | 1,713 | 8,181 | |
| Minimax M3.1 Flash | 5.2 | 3.2 | 33.3% | 1 | 123.99s | 255,765 | 2,446 | 38,872 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 10.0 | 10.0 | 100.0% | 0 | 12.89s | 816 | 962 | 2,046 | |
| Minimax M3.1 Flash | 6.4 | 5.8 | 66.7% | 2 | 2.98s | 2,838 | 141 | 2,356 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 4.3 | 5.8 | 22.2% | 1 | 219.76s | 5,568 | 11,098 | 33,212 | |
| Minimax M3.1 Flash | 10.0 | 10.0 | 100.0% | 0 | 25.67s | 9,024 | 340 | 27,539 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 2.9 | 5.8 | 16.7% | 1 | 433.11s | 77,035 | 12,112 | 157,552 | |
| Minimax M3.1 Flash | 6.4 | 5.8 | 66.7% | 1 | 39.89s | 110,209 | 4,254 | 36,178 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 10.0 | 10.0 | 100.0% | 0 | 21.11s | 8,334 | 1,822 | 2,951 | |
| Minimax M3.1 Flash | 6.5 | 10.0 | 50.0% | 0 | 909ms | 2,802 | 111 | 329 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 5.3 | 7.2 | 44.4% | 1 | 59.92s | 853 | 4,280 | 18,729 | |
| Minimax M3.1 Flash | 5.9 | 7.2 | 55.6% | 1 | 186.27s | 2,400 | 15 | 173,143 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 10.0 | 10.0 | 100.0% | 0 | 9.57s | 567 | 105 | 888 | |
| Minimax M3.1 Flash | 5.1 | 10.0 | 0.0% | 0 | 5.30s | 1,032 | 99 | 1,217 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 10.0 | 10.0 | 100.0% | 0 | 12.76s | 777 | 533 | 2,035 | |
| Minimax M3.1 Flash | 5.0 | 6.8 | 33.3% | 1 | 1.73s | 1,779 | 63 | 718 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 9.9 | 10.0 | 100.0% | 0 | 26.91s | 801 | 1,795 | 5,595 | |
| Minimax M3.1 Flash | 7.7 | 10.0 | 66.7% | 0 | 3.34s | 2,313 | 205 | 2,016 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 3.0 | 10.0 | 0.0% | 0 | 0ms | 0 | 0 | 0 | |
| Minimax M3.1 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.78s | 9,608 | 308 | 119 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 3.0 | 10.0 | 0.0% | 0 | 90.14s | 218 | 1,692 | 10,014 | |
| Minimax M3.1 Flash | 3.0 | 10.0 | 0.0% | 0 | 66.79s | 753 | 10 | 21,204 |
Quick Compare
Switch Comparison Pair
Gemma 4 31BmediumFree AvailablevsGPT-5.6 LunalowMuse Glimmer 30BlowvsMinimax M3.1 FlashmaxFree AvailableClaude Sonnet 5.5lowvsGemma 4 31BmediumFree AvailableClaude Opus 4.8nonevsGemma 4 31BmediumFree AvailableGemini 3 Flash PreviewlowvsMinimax M3.1 FlashmaxFree AvailableMinimax M3.1 FlashmaxFree AvailablevsGrok 4.6lowEmber-1highvsGemma 4 31BmediumFree AvailableMinimax M3.1 FlashmaxFree AvailablevsQwen3.5-122B-A10BmediumMinimax M3.1 FlashmaxFree AvailablevsStep 5 PreviewhighEmber-1lowvsMinimax M3.1 FlashmaxFree AvailableGemma 4 31BmediumFree AvailablevsInklinglowFree AvailableGemini 3.1 Flash LitemediumvsMinimax M3.1 FlashmaxFree Available