Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

ByteDance Seed: Seed-2.0-Mini vs Kwaipilot: KAT-Coder-Pro V2.5

Summary

KAT-Coder-Pro V2.5 (high) leads on average score with 7.7 vs 7.4. Seed-2.0-Mini (medium) has the lower benchmark cost at $0.044 vs $0.246. KAT-Coder-Pro V2.5 (high) is faster at 12.30s vs 80.22s, with pass rates of 57.1% vs 63.5%.

Recommended modelKAT-Coder-Pro V2.5 (high)It has the best score here (7.7), while responding about 6.5x faster than Seed-2.0-Mini (medium).

Last updated at: 2026-07-14

Metric Seed-2.0-Mini Seed-2.0-Mini medium Release: 2026-02-14 KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 high Release: 2026-07-14
Score 7.4 7.7
Rank #66 #53
Reliability 6.7 10.0
Consistency 9.3 8.1
Tests Correct
Attempt pass rate 57.1% 63.5%
Flaky tests 2 5
Total Runs 63 63
Cost per result 0.397 2.228
Total Cost $0.044 $0.246
Input Price $0.100 / 1M $0.740 / 1M
Output Price $0.400 / 1M $2.960 / 1M
Total Input Tokens 41,904 42,750
Output Tokens 2,555 2,509
Reasoning Tokens 95,974 69,594
Response Time (avg) 80.22s 12.30s
Response Time (max) 262.83s 95.65s
Response Time (total) 1363.72s 258.34s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#66 Seed-2.0-Mini

medium
Cost
$0.002
Time
161.7s
Tokens
4,379 tok

#53 KAT-Coder-Pro V2.5

high
Cost
$0.009
Time
26.4s
Tokens
3,117 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Seed-2.0-Mini 5.5 9.8 33.3% 0 220.48s 3,823 464 34,964
KAT-Coder-Pro V2.5 6.4 7.9 44.4% 1 22.00s 7,893 422 20,461

Quick Compare

Switch Comparison Pair