Navigate
Advertise here

Trinity Large Preview (default) vs KAT Coder AIR V2.5 (default)

The average score is effectively tied at 4.4 vs 4.4. Trinity Large Preview (default) has the lower benchmark cost at $0.008 vs $0.070. Trinity Large Preview (default) is faster at 2.83s vs 11.96s, with pass rates of 20.3% vs 34.8%.

Last updated at: 2026-10-12

Compared models

Rank
#357
Total Output Tokens
2,169
Response Time (avg)
2.83s
Total Cost
$0.008
Rank
#356
Total Output Tokens
97,752
Response Time (avg)
11.96s
Total Cost
$0.070
Recommended model Trinity Large Preview (default)

It has the best score here (4.4), while costing about 8.9x less than KAT Coder AIR V2.5 (default).

Detailed comparison

Metric Trinity Large Preview Trinity Large Preview default Release: 2026-01-27 Free Available KAT Coder AIR V2.5 KAT Coder AIR V2.5 default Release: 2026-07-14
Score 4.4 4.4
Rank #357 #356
Reliability 10.0 10.0
Consistency 9.0 7.4
Attempts 66/69 69/69
Tests Correct
Attempt pass rate 20.3% 34.8%
Flaky tests 2 7
Total Runs 66 69
Cost per result 0.017 1.382
Total Cost $0.008 $0.070
Input Price $0.243 / 1M $0.150 / 1M
Output Price $0.243 / 1M $0.600 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 29,828 69,376
Output Tokens 2,169 7,792
Reasoning Tokens 0 89,960
Response Time (avg) 2.83s 11.96s
Response Time (max) 14.34s 121.05s
Response Time (total) 56.65s 275.18s
Parameters 398B total (13B active) ~35B total (~3B active)
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#357 Trinity Large Preview

default
No endpoints found for arcee-ai/trinity-large-preview:free.
Cost
$0.000
Time
0.0s
Tokens
0 tok

#356 KAT Coder AIR V2.5

default
Cost
$0.002
Time
14.5s
Tokens
2,619 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Trinity Large Preview 3.7 7.7 11.1% 1 14.34s 738 397 0
KAT Coder AIR V2.5 3.3 9.6 0.0% 0 14.31s 6,472 2,032 14,886

Switch Comparison Pair