#47
X AI · Release: 2026-03-12 · x-ai/grok-4.20-multi-agent-beta::medium
Flaky tests
6
Flaky tests had mixed outcomes across runs (at least one pass and one fail).
Charts
Choose the first model, then click a second model to open a side-by-side page.
Avg Score vs Total Cost
Response Time (avg)
Avg Score vs Response Time (avg)
Total Output Tokens
Avg Score vs Total Output Tokens
Quick Compare
Grok 4.20 Multi-Agent BetamediumvsSeed-2.0-LitenoneGrok 4.20 Multi-Agent BetamediumvsQwen3.5-122B-A10BnoneGrok 4.20 Multi-Agent BetamediumvsQwen3.5-35B-A3BnoneGrok 4.20 Multi-Agent Betamediumvsgpt-oss-120bmediumFree AvailableGrok 4.20 Multi-Agent BetamediumvsMiniMax M2.5mediumGrok 4.20 Multi-Agent BetamediumvsGemini 3 Flash PreviewmediumGrok 4.20 Multi-Agent BetamediumvsGemini 3.1 Pro PreviewmediumGrok 4.20 Multi-Agent BetamediumvsStep 3.5 FlashmediumFree Available
Category Breakdown
| Category | Avg Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 4.0 | 4.4 | |
| Combined | 10.0 | 10.0 | |
| Data parsing and extraction | 9.9 | 10.0 | |
| Domain specific | 10.0 | 7.2 | |
| General Intelligence | 4.0 | 2.8 | |
| Instructions following | 9.0 | 10.0 | |
| Puzzle Solving | 6.3 | 5.1 | |
| Tool Calling | 10.0 | 10.0 |