Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

MoonshotAI: Kimi K2.5 vs xAI: Grok 4.20

Last updated at: 2026-04-02

Metric Kimi K2.5 Kimi K2.5 medium Release: 2026-01-27 Grok 4.20 Grok 4.20 medium Release: 2026-03-31
Score 7.2 7.1
Rank #39 #40
Consistency 7.2 8.2
Tests Correct
Attempt pass rate 72.6% 66.7%
Flaky tests 6 4
Total Runs 51 51
Cost per result 2.232 7.358
Total Cost $0.201 $0.663
Input Price $0.383 / 1M $2.000 / 1M
Output Price $1.909 / 1M $6.000 / 1M
Output Tokens 40,907 1,494
Reasoning Tokens 75,121 97,078
Response Time (avg) 64.59s 9.50s
Response Time (max) 137.29s 29.87s
Response Time (total) 645.93s 161.54s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 7.3 5.8 83.3% 2 51.38s 2,789 8,880
Grok 4.20 8.2 7.9 83.3% 1 3.36s 280 8,476
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 10.0 10.0 100.0% 0 71.37s 703 3,713
Grok 4.20 10.0 10.0 100.0% 0 17.40s 232 9,556
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 10.0 10.0 100.0% 0 49.78s 563 7,940
Grok 4.20 10.0 10.0 100.0% 0 4.17s 180 5,333
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 3.5 4.4 33.3% 2 137.29s 20,753 30,564
Grok 4.20 5.3 10.0 33.3% 0 27.03s 375 49,339
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 6.5 3.4 66.7% 1 69.73s 3,815 4,262
Grok 4.20 5.8 2.8 66.7% 1 7.09s 47 4,252
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 10.0 10.0 100.0% 0 92.47s 5,371 6,547
Grok 4.20 7.3 5.9 83.3% 1 4.42s 40 5,474
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 5.3 7.3 44.4% 1 45.40s 6,671 12,403
Grok 4.20 6.4 7.7 55.6% 1 3.89s 143 8,028
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 10.0 10.0 100.0% 0 31.74s 242 812
Grok 4.20 3.0 10.0 0.0% 0 13.68s 197 6,620

Quick Compare

Switch Comparison Pair

Claude Sonnet 4.6nonevsKimi K2.5mediumClaude Sonnet 4.6nonevsGrok 4.20mediumQwen3.5 Plus 2026-02-15nonevsGrok 4.20mediumKimi K2.5mediumvsGPT-5.3 ChatnoneGemma 4 31BnonevsGrok 4.20mediumGrok 4.20mediumvsGLM 5noneKimi K2.5mediumvsQwen3.5 Plus 2026-02-15noneGPT-5.3 ChatnonevsGrok 4.20mediumGemma 4 31BnonevsKimi K2.5mediumKimi K2.5mediumvsGLM 5noneKimi K2.5mediumvsGPT-5.2 ChatnoneGemini 3.1 Flash Lite PreviewnonevsKimi K2.5medium