Navigate
Advertise here

Gemini 3.1 Flash Lite Preview vs KAT-Coder-Pro V2.5 (medium)

The average score is effectively tied at 6.2 vs 6.2. Gemini 3.1 Flash Lite Preview has the lower benchmark cost at $0.090 vs $0.669. Gemini 3.1 Flash Lite Preview is faster at 3.60s vs 23.94s, with pass rates of 55.1% vs 62.3%.

Last updated at: 2026-11-13

Compared models

Rank
#312
Total Output Tokens
15,760
Response Time (avg)
3.60s
Total Cost
$0.090
Rank
#309
Total Output Tokens
139,375
Response Time (avg)
23.94s
Total Cost
$0.669
Recommended model Gemini 3.1 Flash Lite Preview

It has the best score here (6.2), while costing about 7.5x less than KAT-Coder-Pro V2.5 (medium).

Detailed comparison

Metric Gemini 3.1 Flash Lite Preview Gemini 3.1 Flash Lite Preview none Release: 2026-03-03 KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 medium Release: 2026-07-14
Score 6.2 6.2
Rank #312 #309
Reliability 10.0 10.0
Consistency 9.7 7.2
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 55.1% 62.3%
Flaky tests 1 8
Total Runs 69 69
Cost per result 0.743 4.342
Total Cost $0.090 $0.669
Input Price $0.250 / 1M $0.740 / 1M
Output Price $1.500 / 1M $2.960 / 1M
Cache Read Price $0.025 / 1M $0.150 / 1M
Cache Write Price $0.084 / 1M N/A
Total Input Tokens 261,962 87,916
Output Tokens 12,799 7,213
Reasoning Tokens 2,961 132,162
Response Time (avg) 3.60s 23.94s
Response Time (max) 48.59s 257.00s
Response Time (total) 82.91s 550.52s
Parameters ~150B total (~10B active) ~700B total (~72B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#312 Gemini 3.1 Flash Lite Preview

none
Cost
$0.003
Time
4.7s
Tokens
1,827 tok

#309 KAT-Coder-Pro V2.5

medium
Cost
$0.009
Time
25.6s
Tokens
2,939 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 5.5 10.0 33.3% 0 967ms 8,128 670 0
KAT-Coder-Pro V2.5 7.8 10.0 66.7% 0 33.10s 7,893 416 33,658

Switch Comparison Pair