Gemini 3.1 Flash Lite (medium) vs KAT-Coder-Pro V2.5 (low)

Recommended model Gemini 3.1 Flash Lite (medium)

It has the best score here (7.3), while costing about 3.3x less than KAT-Coder-Pro V2.5 (low).

Detailed comparison

Metric	Gemini 3.1 Flash Lite Gemini 3.1 Flash Lite medium Release: 2026-05-08	KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 low Release: 2026-07-14

Metric	Gemini 3.1 Flash Lite Gemini 3.1 Flash Lite medium Release: 2026-05-08	KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 low Release: 2026-07-14
Score	7.3	7.3
Rank	#103	#101
Reliability	10.0	10.0
Consistency	9.2	7.0
Attempts	66/66	66/66
Tests Correct
Attempt pass rate	62.1%	68.2%
Flaky tests	2	8
Total Runs	66	66
Cost per result	0.922	3.636
Total Cost	$0.120	$0.400
Input Price	$0.250 / 1M	$0.740 / 1M
Output Price	$1.500 / 1M	$2.960 / 1M
Total Input Tokens	104,925	87,682
Output Tokens	9,168	7,166
Reasoning Tokens	53,188	106,027
Response Time (avg)	4.38s	20.20s
Response Time (max)	26.22s	209.15s
Response Time (total)	96.32s	444.35s
Parameters	~150B total (~10B active)	~700B total (~72B active)
Availability	Closed	Closed

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

low

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	9.1	10.0	75.0%	0		2.39s	502	604	4,201
KAT-Coder-Pro V2.5	6.9	5.8	75.0%	2		4.20s	672	277	4,228

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	5.5	10.0	33.3%	0		3.81s	8,134	459	8,978
KAT-Coder-Pro V2.5	7.8	10.0	66.7%	0		24.87s	7,893	402	24,945

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	7.2	9.1	50.0%	0		18.55s	80,983	7,241	20,231
KAT-Coder-Pro V2.5	6.4	5.8	66.7%	1		111.87s	60,055	5,393	43,732

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	10.0	10.0	100.0%	0		2.60s	7,362	279	2,845
KAT-Coder-Pro V2.5	10.0	10.0	100.0%	0		4.19s	7,776	288	1,917

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	2.9	7.2	11.1%	1		3.93s	650	15	7,223
KAT-Coder-Pro V2.5	3.5	4.4	33.3%	2		22.86s	780	35	21,430

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	10.0	10.0	100.0%	0		2.60s	488	84	1,142
KAT-Coder-Pro V2.5	4.1	2.7	33.3%	1		2.32s	516	99	412

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	9.9	10.0	100.0%	0		2.59s	623	75	3,320
KAT-Coder-Pro V2.5	10.0	10.0	100.0%	0		2.53s	699	83	1,008

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	7.6	7.2	77.8%	1		1.95s	568	165	2,450
KAT-Coder-Pro V2.5	6.4	4.4	77.8%	2		3.11s	696	289	1,820

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	10.0	10.0	100.0%	0		4.55s	5,457	234	921
KAT-Coder-Pro V2.5	10.0	10.0	100.0%	0		18.45s	8,391	282	834

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	3.0	10.0	0.0%	0		3.08s	158	12	1,877
KAT-Coder-Pro V2.5	3.0	10.0	0.0%	0		17.06s	204	18	5,701

Switch Comparison Pair