- Rank
- #77
- Total Output Tokens
- 246,012
- Response Time (avg)
- 18.59s
- Total Cost
- $2.737
Gemini 3.5 Flash (high) vs GPT-5 Mini (medium)
GPT-5 Mini (medium) leads on average score with 8.4 vs 8.3. GPT-5 Mini (medium) has the lower benchmark cost at $0.293 vs $2.737. Gemini 3.5 Flash (high) is faster at 18.59s vs 29.42s, with pass rates of 85.5% vs 66.7%.
Compared models
- Rank
- #69
- Total Output Tokens
- 119,211
- Response Time (avg)
- 29.42s
- Total Cost
- $0.293
Recommended model
Gemini 3.5 Flash (high)
Its score stays close to the best score here (8.3 vs 8.4), while responding about 1.6x faster than GPT-5 Mini (medium).
Detailed comparison
| Metric | Gemini 3.5 Flash Gemini 3.5 Flash high | GPT-5 Mini GPT-5 Mini medium |
|---|---|---|
| Score | 8.3 | 8.4 |
| Rank | #77 | #69 |
| Reliability | 10.0 | 10.0 |
| Consistency | 9.3 | 8.5 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 85.5% | 66.7% |
| Flaky tests | 2 | 4 |
| Total Runs | 69 | 69 |
| Cost per result | 14.402 | 2.247 |
| Total Cost | $2.737 | $0.293 |
| Input Price | $1.500 / 1M | $0.250 / 1M |
| Output Price | $9.000 / 1M | $2.000 / 1M |
| Total Input Tokens | 348,103 | 214,645 |
| Output Tokens | 11,045 | 15,532 |
| Reasoning Tokens | 234,967 | 103,679 |
| Response Time (avg) | 18.59s | 29.42s |
| Response Time (max) | 145.92s | 111.48s |
| Response Time (total) | 427.52s | 676.56s |
| Parameters | ~500B total (~20B active) | ~400B total (~17B active) |
| Availability | Closed | Closed |
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#77 Gemini 3.5 Flash
high- Cost
- $0.208
- Time
- 118.2s
- Tokens
- 23,158 tok
#69 GPT-5 Mini
medium- Cost
- $0.007
- Time
- 42.9s
- Tokens
- 3,432 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 3.4 | 9.6 | 0.0% | 0 | 87.32s | 240,957 | 2,268 | 38,262 | |
| GPT-5 Mini | 10.0 | 10.0 | 100.0% | 0 | 68.54s | 116,262 | 1,123 | 10,069 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.57s | 492 | 174 | 4,997 | |
| GPT-5 Mini | 7.1 | 7.6 | 66.7% | 1 | 13.86s | 606 | 1,715 | 6,378 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 22.96s | 8,118 | 456 | 47,129 | |
| GPT-5 Mini | 10.0 | 10.0 | 100.0% | 0 | 27.63s | 7,302 | 658 | 17,152 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 8.2 | 6.9 | 66.7% | 1 | 84.14s | 82,416 | 7,153 | 93,585 | |
| GPT-5 Mini | 7.3 | 5.8 | 83.3% | 1 | 99.82s | 75,392 | 8,387 | 35,328 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 6.43s | 7,548 | 279 | 8,466 | |
| GPT-5 Mini | 10.0 | 10.0 | 100.0% | 0 | 12.58s | 7,140 | 453 | 3,200 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 5.3 | 7.2 | 44.4% | 1 | 16.99s | 642 | 12 | 28,526 | |
| GPT-5 Mini | 3.5 | 4.4 | 33.3% | 2 | 44.66s | 524 | 268 | 16,128 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.63s | 486 | 115 | 1,650 | |
| GPT-5 Mini | 4.5 | 10.0 | 0.0% | 0 | 13.50s | 477 | 349 | 1,856 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.35s | 615 | 70 | 3,799 | |
| GPT-5 Mini | 10.0 | 10.0 | 100.0% | 0 | 11.59s | 660 | 310 | 3,968 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.23s | 558 | 241 | 4,940 | |
| GPT-5 Mini | 5.6 | 9.8 | 33.3% | 0 | 15.20s | 642 | 1,622 | 6,144 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 9.8 | 10.0 | 100.0% | 0 | 4.96s | 6,115 | 265 | 1,608 | |
| GPT-5 Mini | 10.0 | 10.0 | 100.0% | 0 | 18.64s | 5,445 | 487 | 1,600 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.94s | 156 | 12 | 2,005 | |
| GPT-5 Mini | 3.0 | 10.0 | 0.0% | 0 | 9.99s | 195 | 160 | 1,856 |
Quick Compare
Switch Comparison Pair
Muse Glimmer 30BxhighvsGPT-5 MinimediumGPT-5 MinimediumvsQwen3.8 2.4T A95BlowGemini 3.5 FlashhighvsKimi K3maxGPT-5 MinimediumvsInklinghighFree AvailableMuse Spark 1.1highvsGPT-5 MinimediumGemini 3.5 FlashhighvsGPT-6 LunamediumClaude Opus 4.8mediumvsGemini 3.5 FlashhighGemini 3.5 FlashhighvsQwen3.7 PlusmediumDeepSeek V4 Flash 0731highvsGPT-5 MinimediumGPT-5 MinimediumvsGLM 5.2highGemini 3.5 FlashhighvsGLM 5.2mediumGemini 3.5 FlashhighvsGPT-5.6 Terramedium