Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

MoonshotAI: Kimi K2.5 vs OpenAI: GPT-5.4

Last updated at: 2026-04-16

Metric Kimi K2.5 Kimi K2.5 medium Release: 2026-01-27 GPT-5.4 GPT-5.4 none Release: 2026-03-05
Score 7.0 5.9
Rank #45 #65
Consistency 6.8 9.1
Tests Correct
Attempt pass rate 72.2% 42.6%
Flaky tests 7 2
Total Runs 54 54
Cost per result 2.444 1.477
Total Cost $0.220 $0.104
Input Price $0.383 / 1M $2.500 / 1M
Output Price $1.720 / 1M $15.000 / 1M
Output Tokens 42,176 2,317
Reasoning Tokens 84,870 0
Response Time (avg) 72.43s 1.51s
Response Time (max) 150.77s 2.95s
Response Time (total) 796.70s 27.21s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 7.3 5.8 83.3% 2 51.38s 2,789 8,880
GPT-5.4 3.2 8.0 8.3% 1 1.21s 406 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 4.7 1.6 66.7% 1 150.77s 1,269 9,749
GPT-5.4 10.0 10.0 100.0% 0 2.95s 480 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 10.0 10.0 100.0% 0 71.37s 703 3,713
GPT-5.4 3.0 10.0 0.0% 0 2.89s 291 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 10.0 10.0 100.0% 0 49.78s 563 7,940
GPT-5.4 10.0 10.0 100.0% 0 1.04s 222 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 3.5 4.4 33.3% 2 137.29s 20,753 30,564
GPT-5.4 5.3 7.2 44.4% 1 1.07s 50 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 6.5 3.4 66.7% 1 69.73s 3,815 4,262
GPT-5.4 4.4 9.9 0.0% 0 1.78s 184 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 10.0 10.0 100.0% 0 92.47s 5,371 6,547
GPT-5.4 6.5 10.0 50.0% 0 1.07s 81 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 5.3 7.3 44.4% 1 45.40s 6,671 12,403
GPT-5.4 5.6 9.8 33.3% 0 1.52s 357 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.5 10.0 10.0 100.0% 0 31.74s 242 812
GPT-5.4 10.0 10.0 100.0% 0 2.75s 246 0

Quick Compare

Switch Comparison Pair

Gemma 4 31BnoneFree AvailablevsKimi K2.5mediumMiniMax M2.5mediumFree AvailablevsGPT-5.4noneKimi K2.5mediumvsQwen3.5 Plus 2026-02-15noneMistral Small 4mediumvsGPT-5.4noneKimi K2.5mediumvsGLM 5noneClaude Sonnet 4.6nonevsKimi K2.5mediumKimi K2.5mediumvsMiMo-V2-OmninoneMercury 2mediumvsGPT-5.4noneMiniMax M2.7mediumvsGPT-5.4noneGPT-5.4nonevsElephantmediumKimi K2.5mediumvsGPT-5.3 ChatnoneGPT-5.4nonevsGrok 4.1 Fastmedium