Gemini 3.8 Flash (low) vs Qwen3.6 27B (medium)

Compared models

Recommended model Gemini 3.8 Flash (low)

It has the best score here (7.2), while costing about 3.1x less than Qwen3.6 27B (medium).

Metric	Gemini 3.8 Flash Gemini 3.8 Flash low Release: 2026-09-02	Qwen3.6 27B Qwen3.6 27B medium Release: 2026-04-20

Metric	Gemini 3.8 Flash Gemini 3.8 Flash low Release: 2026-09-02	Qwen3.6 27B Qwen3.6 27B medium Release: 2026-04-20
Score	7.2	7.2
Rank	#142	#148
Reliability	9.9	10.0
Consistency	8.2	7.7
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	81.2%	62.3%
Flaky tests	5	7
Total Runs	69	69
Cost per result	2.014	7.677
Total Cost	$0.323	$1.006
Input Price	$0.750 / 1M	$0.320 / 1M
Output Price	$3.750 / 1M	$3.200 / 1M
Total Input Tokens	215,836	264,147
Output Tokens	9,452	34,419
Reasoning Tokens	33,289	253,480
Response Time (avg)	7.54s	107.79s
Response Time (max)	67.18s	1085.11s
Response Time (total)	173.36s	2479.26s
Parameters	~500B total (~20B active)	27B
Availability	Closed	Open source

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

low

medium

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.8 Flash	6.1	3.1	66.7%	1		67.18s	104,063	1,417	0
Qwen3.6 27B	10.0	10.0	100.0%	0		145.90s	157,971	1,406	13,920

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.8 Flash	10.0	10.0	100.0%	0		1.96s	492	171	1,054
Qwen3.6 27B	8.3	10.0	75.0%	0		12.62s	453	582	4,311

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.8 Flash	5.4	7.2	44.4%	1		4.31s	8,118	449	5,706
Qwen3.6 27B	7.7	10.0	66.7%	0		142.99s	5,051	7,968	43,367

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.8 Flash	3.8	5.8	33.3%	1		19.61s	87,701	6,571	14,001
Qwen3.6 27B	6.7	3.7	50.0%	2		584.09s	81,895	18,788	133,471

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.8 Flash	10.0	10.0	100.0%	0		2.34s	7,548	279	1,000
Qwen3.6 27B	3.5	1.4	50.0%	2		37.30s	7,778	568	9,404

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.8 Flash	5.8	4.4	66.7%	2		6.50s	642	12	7,051
Qwen3.6 27B	2.9	4.4	22.2%	2		71.47s	671	3,634	18,609

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.8 Flash	10.0	10.0	100.0%	0		1.89s	486	72	316
Qwen3.6 27B	6.5	3.4	66.7%	1		39.53s	516	81	3,045

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.8 Flash	10.0	10.0	100.0%	0		2.79s	615	72	1,873
Qwen3.6 27B	10.0	10.0	100.0%	0		37.96s	699	346	6,548

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.8 Flash	10.0	10.0	100.0%	0		2.25s	558	165	1,458
Qwen3.6 27B	7.7	10.0	66.7%	0		61.14s	696	255	12,044

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.8 Flash	10.0	10.0	100.0%	0		5.51s	5,457	233	224
Qwen3.6 27B	10.0	10.0	100.0%	0		16.88s	8,213	390	2,954

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.8 Flash	10.0	10.0	100.0%	0		2.29s	156	11	606
Qwen3.6 27B	3.0	10.0	0.0%	0		80.99s	204	401	5,807

Switch Comparison Pair