AI BENCHY
Compare
❤️ Made by XCS

Model Name

xAI: Grok 4.1 Fast

Last updated at : Feb 19, 2026

Metric xAI: Grok 4.1 Fast
Rank#8
CompanyX Ai
Score 6.42
Consistency 8.60
Cost per result 0.4800
Total Cost $0.03360
Tests Correct 7/12
Attempt pass rate 66.7%
Flaky tests 2
Output Tokens 437
Reasoning Tokens 61,090

Category Breakdown

Category Fully passed tests Score Consistency Attempt pass rate Flaky tests Reasoning score Cost
Anti-AI Tricks 2/2 10.00 10.00 100.0% 0 4.00 $0.00151
Data parsing and extraction 2/2 10.00 10.00 100.0% 0 9.00 $0.00438
Domain specific 1/3 4.00 7.21 55.6% 1 5.00 $0.02064
Instructions following 1/2 5.50 10.00 50.0% 0 3.25 $0.00191
Puzzle Solving 1/3 4.67 7.20 44.4% 1 8.50 $0.00518

Compared models

Compare xAI: Grok 4.1 Fast against...

#7 · Z.ai

Z.ai: GLM 5

Reasoning (medium)

Score: 6.83

Consistency: 7.86

Attempt pass rate: 80.6%

Flaky tests: 3

Cost per result: 1.3424

Tests Correct: 8/12

Total Cost: $0.10740

Compare

#9 · MoonshotAI

MoonshotAI: Kimi K2.5

Reasoning (medium)

Score: 6.42

Consistency: 8.00

Attempt pass rate: 72.2%

Flaky tests: 3

Cost per result: 2.4097

Tests Correct: 7/12

Total Cost: $0.16868

Compare

#6 · Anthropic

Anthropic: Claude Sonnet 4.6

Reasoning (medium)

Score: 7.00

Consistency: 9.30

Attempt pass rate: 69.4%

Flaky tests: 1

Cost per result: 9.3797

Tests Correct: 8/12

Total Cost: $0.75038

Compare

Quick Compare

Compare xAI: Grok 4.1 Fast against...