Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

North Mini Code vs Kwaipilot: KAT-Coder-Air V2.5

Summary

North Mini Code (medium) leads on average score with 5.8 vs 4.9. North Mini Code (medium) has the lower benchmark cost at $0.000 vs $0.037. KAT-Coder-Air V2.5 is faster at 6.99s vs 106.18s, with pass rates of 50.8% vs 38.1%.

Recommended modelNorth Mini Code (medium)It has the strongest score in this comparison (5.8) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-07-14

Metric North Mini Code North Mini Code medium Release: 2026-06-18 Free Available KAT-Coder-Air V2.5 KAT-Coder-Air V2.5 none Release: 2026-07-14
Score 5.8 4.9
Rank #131 #168
Reliability 8.5 10.0
Consistency 8.5 7.1
Tests Correct
Attempt pass rate 50.8% 38.1%
Flaky tests 4 7
Total Runs 55 63
Cost per result 0.000 0.724
Total Cost $0.000 $0.037
Input Price $0.000 / 1M $0.150 / 1M
Output Price $0.000 / 1M $0.600 / 1M
Total Input Tokens 32,891 41,328
Output Tokens 424,772 49,933
Reasoning Tokens 1,021,489 0
Response Time (avg) 106.18s 6.99s
Response Time (max) 357.05s 24.94s
Response Time (total) 2229.70s 146.78s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#131 North Mini Code

medium
Cost
$0.000
Time
51.8s
Tokens
12,460 tok

#168 KAT-Coder-Air V2.5

none
Cost
$0.002
Time
14.5s
Tokens
2,619 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
North Mini Code 4.5 4.9 33.3% 2 320.43s 7,119 219,891 561,569
KAT-Coder-Air V2.5 3.3 9.6 0.0% 0 14.31s 6,472 16,918 0

Quick Compare

Switch Comparison Pair