AI BENCHY Compare
Inception: Mercury 2 vs MiniMax: MiniMax M2.5
Vergelijken:
Benchmarks gegenereerd uit AI BENCHY-testsuites op: 2026-03-05
| Metriek | Inception: Mercury 2 none Releasedatum: 2026-02-24 | MiniMax: MiniMax M2.5 medium Releasedatum: 2026-02-12 |
|---|---|---|
| Rang | #50 | #42 |
| Gem. score | 3.4 | 4.8 |
| Correcte tests | ||
| Consistentie | 8.9 | 5.8 |
| Kosten per resultaat | 0.147 | 4.937 |
| Totale kosten | $0.006 | $0.247 |
| Slaagpercentage per poging | 33.3% | 62.2% |
| Instabiele tests | 2 | 8 |
| common.totalAttempts | 45 (15 x 3) | 45 (15 x 3) |
| Uitvoer-tokens | 1,144 | 107,019 |
| Redeneer-tokens | 0 | 204,504 |
| Responstijd (gem.) | 594ms | 47.58s |
| Responstijd (max) | 1.27s | 237.27s |
| Responstijd (totaal) | 8.91s | 380.62s |
Responstijd (gem.)
Score vs totale kosten
Gem. score vs Responstijd (gem.)
Categorie-uitsplitsing
| Anti-AI-trucs | Score | Consistentie | Slaagpercentage per poging | Instabiele tests | Correcte tests | Responstijd (gem.) | Uitvoer-tokens | Redeneer-tokens |
|---|---|---|---|---|---|---|---|---|
| Inception: Mercury 2 | 10.0 | 10.0 | 0.0% | 0 | 466ms | 274 | 0 | |
| MiniMax: MiniMax M2.5 | 9.3 | 7.9 | 88.9% | 1 | 32.42s | 286 | 45,112 |
| Gecombineerd | Score | Consistentie | Slaagpercentage per poging | Instabiele tests | Correcte tests | Responstijd (gem.) | Uitvoer-tokens | Redeneer-tokens |
|---|---|---|---|---|---|---|---|---|
| Inception: Mercury 2 | 10.0 | 10.0 | 0.0% | 0 | 606ms | 131 | 0 | |
| MiniMax: MiniMax M2.5 | 10.0 | 2.1 | 66.7% | 1 | 60.39s | 740 | 9,713 |
| Gegevensparsering en extractie | Score | Consistentie | Slaagpercentage per poging | Instabiele tests | Correcte tests | Responstijd (gem.) | Uitvoer-tokens | Redeneer-tokens |
|---|---|---|---|---|---|---|---|---|
| Inception: Mercury 2 | 5.5 | 5.9 | 83.3% | 1 | 667ms | 180 | 0 | |
| MiniMax: MiniMax M2.5 | 10.0 | 1.7 | 66.7% | 2 | 7.48s | 266 | 3,835 |
| Domeinspecifiek | Score | Consistentie | Slaagpercentage per poging | Instabiele tests | Correcte tests | Responstijd (gem.) | Uitvoer-tokens | Redeneer-tokens |
|---|---|---|---|---|---|---|---|---|
| Inception: Mercury 2 | 4.0 | 7.2 | 44.4% | 1 | 534ms | 46 | 0 | |
| MiniMax: MiniMax M2.5 | 10.0 | 4.4 | 22.2% | 2 | 237.27s | 105,047 | 133,487 |
| Instructies opvolgen | Score | Consistentie | Slaagpercentage per poging | Instabiele tests | Correcte tests | Responstijd (gem.) | Uitvoer-tokens | Redeneer-tokens |
|---|---|---|---|---|---|---|---|---|
| Inception: Mercury 2 | 5.5 | 10.0 | 50.0% | 0 | 551ms | 82 | 0 | |
| MiniMax: MiniMax M2.5 | 8.0 | 6.8 | 83.3% | 1 | 4.64s | 252 | 1,873 |
| Puzzle Solving | Score | Consistentie | Slaagpercentage per poging | Instabiele tests | Correcte tests | Responstijd (gem.) | Uitvoer-tokens | Redeneer-tokens |
|---|---|---|---|---|---|---|---|---|
| Inception: Mercury 2 | 10.0 | 10.0 | 0.0% | 0 | 533ms | 234 | 0 | |
| MiniMax: MiniMax M2.5 | 4.0 | 7.2 | 44.4% | 1 | 11.54s | 159 | 9,547 |
| Toolaanroepen | Score | Consistentie | Slaagpercentage per poging | Instabiele tests | Correcte tests | Responstijd (gem.) | Uitvoer-tokens | Redeneer-tokens |
|---|---|---|---|---|---|---|---|---|
| Inception: Mercury 2 | 10.0 | 10.0 | 100.0% | 0 | 1.27s | 197 | 0 | |
| MiniMax: MiniMax M2.5 | 10.0 | 10.0 | 100.0% | 0 | 15.35s | 269 | 937 |
Snelle vergelijking
Vergelijkingspaar wisselen
MiniMax M2.5mediumvsQwen3.5-35B-A3BnoneMercury 2nonevsQwen3 Coder NextmediumMercury 2nonevsGLM 4.7 FlashmediumMiniMax M2.5mediumvsQwen3.5-27BnoneMiniMax M2.5mediumvsQwen3.5-FlashnoneMiniMax M2.5mediumvsGPT-5.4noneMiniMax M2.5mediumvsQwen3.5-122B-A10BnoneDeepSeek V3.2nonevsMiniMax M2.5mediumGemini 2.5 FlashnonevsMiniMax M2.5mediumTrinity Large Preview (free)noneGratis beschikbaarvsMiniMax M2.5mediumMiniMax M2.5mediumvsGPT-4o-mininoneMiniMax M2.5mediumvsGLM 4.7 Flashnone