Navigate
Advertise here

Classify-1 (default) vs Grok 4.20

Grok 4.20 leads on average score with 3.4 vs 2.2. Classify-1 (default) has the lower benchmark cost at $0.008 vs $0.057. Grok 4.20 is faster at 1.11s vs 4.58s, with pass rates of 18.8% vs 26.1%.

Last updated at: 2026-10-13

Compared models

Rank
#411
Total Output Tokens
164
Response Time (avg)
4.58s
Total Cost
$0.008
Rank
#393
Total Output Tokens
1,923
Response Time (avg)
1.11s
Total Cost
$0.057
Recommended model Grok 4.20

It has the best score here (3.4), while responding about 4.1x faster than Classify-1 (default).

Detailed comparison

Metric Classify-1 Classify-1 default Release: 2026-10-13 Grok 4.20 Grok 4.20 none Release: 2026-03-31
Score 2.2 3.4
Rank #411 #393
Reliability 9.4 N/A
Consistency 4.5 7.8
Attempts 36/69 54/69
Tests Correct
Attempt pass rate 18.8% 26.1%
Flaky tests 2 0
Total Runs 36 54
Cost per result 0.261 1.570
Total Cost $0.008 $0.057
Input Price $0.040 / 1M $1.250 / 1M
Output Price $0.000 / 1M $2.500 / 1M
Cache Read Price N/A $0.200 / 1M
Cache Write Price N/A N/A
Total Input Tokens 195,645 41,313
Output Tokens 164 1,923
Reasoning Tokens 0 0
Response Time (avg) 4.58s 1.11s
Response Time (max) 13.35s 6.04s
Response Time (total) 55.01s 19.96s
Parameters ~1B ~1T total (~100B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#411 Classify-1

default
No showcase result has been generated for this model yet.
Cost
N/A
Time
-
Tokens
0 tok

#393 xAI: Grok 4.20

none
Cost
$0.004
Time
6.5s
Tokens
1,367 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Classify-1 2.7 3.7 22.2% 1 12.73s 105,738 50 0
Grok 4.20 1.1 3.1 0.0% 0 1.22s 1,074 312 0

Quick Compare

Switch Comparison Pair

Command A+mediumvsGrok 4.20noneCommand A+highvsGrok 4.20noneLing 3.0 TinymediumvsGrok 4.20noneLing 3.0 TinylowvsGrok 4.20noneLing 3.0 TinyhighvsGrok 4.20noneGemini 3 Flash PreviewhighvsClassify-1defaultCommand A+lowvsGrok 4.20noneGranite 4.1 8bdefaultvsGrok 4.20noneLing 3.0 TinydefaultvsGrok 4.20noneQwen3.5-9BmediumvsGrok 4.20noneJev 1.13defaultvsGrok 4.20noneCommand A+lowvsClassify-1default