Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

MoonshotAI: Kimi K2.6 vs OpenAI: GPT-5.4

Last updated at: 2026-04-20

Metric Kimi K2.6 Kimi K2.6 none Release: 2026-04-20 GPT-5.4 GPT-5.4 none Release: 2026-03-05
Score 5.8 5.9
Rank #69 #66
Consistency 9.1 9.1
Tests Correct
Attempt pass rate 42.6% 42.6%
Flaky tests 2 2
Total Runs 54 54
Cost per result 0.543 1.477
Total Cost $0.038 $0.104
Input Price $0.950 / 1M $2.500 / 1M
Output Price $4.000 / 1M $15.000 / 1M
Output Tokens 2,973 2,317
Reasoning Tokens 0 0
Response Time (avg) 2.05s 1.51s
Response Time (max) 6.65s 2.95s
Response Time (total) 36.93s 27.21s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.6 4.6 10.0 25.0% 0 1.39s 471 0
GPT-5.4 3.2 8.0 8.3% 1 1.21s 406 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.6 10.0 10.0 100.0% 0 6.65s 1,176 0
GPT-5.4 10.0 10.0 100.0% 0 2.95s 480 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.6 3.0 10.0 0.0% 0 3.38s 290 0
GPT-5.4 3.0 10.0 0.0% 0 2.89s 291 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.6 10.0 10.0 100.0% 0 1.32s 201 0
GPT-5.4 10.0 10.0 100.0% 0 1.04s 222 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.6 5.3 7.2 44.4% 1 1.48s 42 0
GPT-5.4 5.3 7.2 44.4% 1 1.07s 50 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.6 5.4 3.5 33.3% 1 1.55s 138 0
GPT-5.4 4.4 9.9 0.0% 0 1.78s 184 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.6 6.5 10.0 50.0% 0 1.64s 72 0
GPT-5.4 6.5 10.0 50.0% 0 1.07s 81 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.6 3.4 9.7 0.0% 0 1.66s 343 0
GPT-5.4 5.6 9.8 33.3% 0 1.52s 357 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Kimi K2.6 10.0 10.0 100.0% 0 4.46s 240 0
GPT-5.4 10.0 10.0 100.0% 0 2.75s 246 0

Quick Compare

Switch Comparison Pair

Kimi K2.6nonevsgpt-oss-120bmediumFree AvailableMiniMax M2.5mediumFree AvailablevsKimi K2.6noneMistral Small 4mediumvsKimi K2.6noneMiniMax M2.5mediumFree AvailablevsGPT-5.4noneMistral Small 4mediumvsGPT-5.4noneKimi K2.6nonevsGPT-5 NanomediumMiniMax M2.7mediumvsKimi K2.6noneKimi K2.6nonevsElephantmediumMercury 2mediumvsGPT-5.4noneMiniMax M2.7mediumvsGPT-5.4noneGPT-5.4nonevsElephantmediumMercury 2mediumvsKimi K2.6none