Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

ByteDance Seed: Seed-2.0-Lite vs Kwaipilot: KAT-Coder-Air V2.5

Summary

The average score is effectively tied at 6.2 vs 6.2. Seed-2.0-Lite has the lower benchmark cost at $0.019 vs $0.045. Seed-2.0-Lite is faster at 2.49s vs 8.28s, with pass rates of 46.0% vs 47.6%.

Recommended modelSeed-2.0-LiteIt has the best score here (6.2), while costing about 2.5x less than KAT-Coder-Air V2.5 (medium).

Last updated at: 2026-07-14

Metric Seed-2.0-Lite Seed-2.0-Lite none Release: 2026-02-14 KAT-Coder-Air V2.5 KAT-Coder-Air V2.5 medium Release: 2026-07-14
Score 6.2 6.2
Rank #112 #115
Reliability 10.0 9.7
Consistency 8.4 8.8
Tests Correct
Attempt pass rate 46.0% 47.6%
Flaky tests 4 3
Total Runs 63 63
Cost per result 0.228 0.562
Total Cost $0.019 $0.045
Input Price $0.250 / 1M $0.150 / 1M
Output Price $2.000 / 1M $0.600 / 1M
Total Input Tokens 46,573 42,750
Output Tokens 3,259 7,759
Reasoning Tokens 0 56,357
Response Time (avg) 2.49s 8.28s
Response Time (max) 6.70s 48.19s
Response Time (total) 52.26s 173.80s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#112 Seed-2.0-Lite

none
Cost
$0.005
Time
83.8s
Tokens
2,311 tok

#115 KAT-Coder-Air V2.5

medium
Cost
$0.003
Time
23.7s
Tokens
4,924 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Seed-2.0-Lite 5.6 10.0 33.3% 0 2.83s 8,215 410 0
KAT-Coder-Air V2.5 3.6 7.0 22.2% 1 23.37s 7,893 5,199 29,973

Quick Compare

Switch Comparison Pair