Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Inception: Mercury 2 vs MoonshotAI: Kimi K2.6

Summary

Mercury 2 vs Kimi K2.6 benchmark comparison: Kimi K2.6 leads on average score with 5.8 vs 4.6. Mercury 2 has the lower benchmark cost at $0.011 vs $0.079. Mercury 2 is faster at 653ms vs 13.27s, with pass rates of 23.8% vs 36.5%.

Recommended model: Mercury 2 - It offers the best overall trade-off: a competitive score (4.6), lower cost than Kimi K2.6, and balanced response time.

Last updated at: 2026-06-18

Metric Mercury 2 Mercury 2 none Release: 2026-02-24 Kimi K2.6 Kimi K2.6 none Release: 2026-04-20 Free Available
Score 4.6 5.8
Rank #151 #111
Reliability 10.0 10.0
Consistency 9.2 9.2
Tests Correct
Attempt pass rate 23.8% 36.5%
Flaky tests 2 2
Total Runs 63 63
Cost per result 0.259 1.267
Total Cost $0.011 $0.079
Input Price $0.250 / 1M $0.680 / 1M
Output Price $0.750 / 1M $3.410 / 1M
Total Input Tokens 28,113 32,916
Output Tokens 4,439 16,410
Reasoning Tokens 0 0
Response Time (avg) 653ms 13.27s
Response Time (max) 1.43s 238.89s
Response Time (total) 13.72s 278.57s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#151 Mercury 2

none
Cost
$0.002
Time
1.8s
Tokens
1,514 tok

#111 MoonshotAI: Kimi K2.6

none
Cost
$0.020
Time
127.4s
Tokens
4,429 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 483ms 631 286 0
Kimi K2.6 4.6 10.0 25.0% 0 1.39s 618 471 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.4 9.6 0.0% 0 1.03s 7,229 3,088 0
Kimi K2.6 5.5 9.8 33.3% 0 82.57s 5,986 14,754 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 606ms 4,821 131 0
Kimi K2.6 3.0 10.0 0.0% 0 3.38s 11,269 290 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 7.3 5.9 83.3% 1 667ms 6,362 180 0
Kimi K2.6 10.0 10.0 100.0% 0 1.32s 7,014 201 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 5.3 7.2 44.4% 1 534ms 784 46 0
Kimi K2.6 5.3 7.2 44.4% 1 1.48s 732 42 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 4.8 10.0 0.0% 0 628ms 495 159 0
Kimi K2.6 5.4 3.5 33.3% 1 1.55s 477 138 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 6.5 10.0 50.0% 0 551ms 691 82 0
Kimi K2.6 6.5 10.0 50.0% 0 1.64s 669 72 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.1 10.0 0.0% 0 535ms 694 251 0
Kimi K2.6 3.1 9.9 0.0% 0 1.40s 651 185 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.27s 6,193 197 0
Kimi K2.6 10.0 10.0 100.0% 0 4.46s 5,286 240 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 548ms 213 19 0
Kimi K2.6 3.0 10.0 0.0% 0 1.36s 214 17 0

Quick Compare

Switch Comparison Pair