AI BENCHY
Compare
❤️ Made by XCS

Model Name

xAI: Grok 4.1 Fast

Last updated at : Feb 19, 2026

Metric xAI: Grok 4.1 Fast
Rank#24
CompanyX Ai
Score 3.25
Consistency 9.17
Cost per result 0.1074
Total Cost $0.00323
Tests Correct 3/12
Attempt pass rate 30.6%
Flaky tests 1
Output Tokens 500
Reasoning Tokens 0

Category Breakdown

Category Fully passed tests Score Consistency Attempt pass rate Flaky tests Reasoning score Cost
Anti-AI Tricks 0/2 1.00 10.00 0.0% 0 - $0.00026
Data parsing and extraction 2/2 10.00 10.00 100.0% 0 - $0.00166
Domain specific 1/3 4.00 7.21 55.6% 1 - $0.00044
Instructions following 0/2 1.00 10.00 0.0% 0 - $0.00036
Puzzle Solving 0/3 1.00 9.48 0.0% 0 - $0.00053

Compared models

Compare xAI: Grok 4.1 Fast against...

#23 · Z.ai

Z.ai: GLM 4.7 Flash

No Reasoning

Score: 3.25

Consistency: 8.75

Attempt pass rate: 27.8%

Flaky tests: 2

Cost per result: 0.0351

Tests Correct: 2/12

Total Cost: $0.00071

Compare

#25 · Qwen

Qwen: Qwen3 Coder Next

Reasoning (medium)

Score: 3.08

Consistency: 8.80

Attempt pass rate: 22.2%

Flaky tests: 2

Cost per result: 0.0944

Tests Correct: 2/12

Total Cost: $0.00189

Compare

#22 · MoonshotAI

MoonshotAI: Kimi K2.5

No Reasoning

Score: 3.42

Consistency: 9.28

Attempt pass rate: 30.6%

Flaky tests: 1

Cost per result: 0.2049

Tests Correct: 3/12

Total Cost: $0.00615

Compare

Quick Compare

Compare xAI: Grok 4.1 Fast against...