#31

Grok 4.20 Beta

X AI Release: 2026-03-12 Tested on: 2026-04-25 22:06 x-ai/grok-4.20-beta::medium

(medium) (none)

Archived model: this model is no longer updated or tested on new tests.

Identity note

Grok 4.20 Beta was the preview version of xAI: Grok 4.20.

8.0

Consistency

9.1

N/A

$0.633

Total Output Tokens

93,477

Input Price

$0.000 / 1M

Output Price

$0.000 / 1M

Wrong Tests: 6

Attempt pass rate: 74.1%

Flaky tests

2

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

9.81s

Response Time (max): 31.36s

Response Time (total): 176.62s

Did not follow instructions: 3 Wrong answer: 3

Charts

Choose the first model, then click a second model to open a side-by-side page.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Grok 4.20 BetamediumvsGemini 3 Flash Previewmedium Grok 4.20 BetamediumvsGemini 3.1 Pro Previewmedium Grok 4.20 BetamediumvsHY3 PreviewhighFree Available

Category Breakdown

Category	Score	Consistency	Tests Correct
Anti-AI Tricks	8.7	7.9
Coding	10.0	10.0
Combined	10.0	10.0
Data parsing and extraction	10.0	10.0
Domain specific	5.3	10.0
General Intelligence	10.0	10.0
Instructions following	8.3	10.0
Puzzle Solving	8.2	7.2
Tool Calling	3.0	10.0

Compared models