Gemma 4 26B A4B vs Qwen3.8 27B

Compared models

Rank: #366
Total Output Tokens: 17,306
Response Time (avg): 10.55s
Total Cost: $0.031

Rank: #370
Total Output Tokens: 13,791
Response Time (avg): 5.05s
Total Cost: ~$0.010

Recommended model Qwen3.8 27B

It has the best score here (5.4), while costing about 3.2x less than Gemma 4 26B A4B.

Detailed comparison

Metric	Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Free Available	Qwen3.8 27B Qwen3.8 27B none Release: 2026-08-14 Free Available

Metric	Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Free Available	Qwen3.8 27B Qwen3.8 27B none Release: 2026-08-14 Free Available
Score	5.5	5.4
Rank	#366	#370
Reliability	10.0	10.0
Consistency	9.6	10.0
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	42.0%	39.1%
Flaky tests	1	0
Total Runs	69	69
Cost per result	0.339	~0.107
Total Cost	$0.031	~$0.010
Input Price	$0.090 / 1M	N/A
Output Price	$0.300 / 1M	N/A
Cache Read Price	$0.050 / 1M	N/A
Cache Write Price	N/A	N/A
Total Input Tokens	280,126	281,460
Output Tokens	17,306	13,791
Reasoning Tokens	0	0
Response Time (avg)	10.55s	5.05s
Response Time (max)	75.76s	47.42s
Response Time (total)	242.57s	116.11s
Parameters	25.2B total (3.8B active)	27.3B
Availability	Open source	Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#366 Gemma 4 26B A4B

none

Cost: $0.001
Time: 39.5s
Tokens: 790 tok

#370 Qwen3.8 27B

none

Cost: ~$0.001
Time: 23.9s
Tokens: 1,922 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	5.0	10.0	0.0%	0		75.76s	148,869	1,525	0
Qwen3.8 27B	5.0	10.0	0.0%	0		47.42s	158,997	2,346	0

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	8.3	10.0	75.0%	0		1.28s	852	230	0
Qwen3.8 27B	6.5	10.0	50.0%	0		828ms	696	267	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	3.7	7.2	22.2%	1		4.16s	7,736	476	0
Qwen3.8 27B	5.5	10.0	33.3%	0		1.19s	7,911	408	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	3.0	10.0	0.0%	0		37.23s	104,894	14,266	0
Qwen3.8 27B	3.0	10.0	0.0%	0		24.10s	95,181	9,588	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	10.0	10.0	100.0%	0		1.70s	8,352	285	0
Qwen3.8 27B	6.5	10.0	50.0%	0		1.14s	7,788	246	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	5.3	10.0	33.3%	0		2.10s	878	27	0
Qwen3.8 27B	7.7	10.0	66.7%	0		552ms	798	27	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	4.0	10.0	0.0%	0		3.54s	576	85	0
Qwen3.8 27B	4.2	9.9	0.0%	0		1.31s	522	126	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	6.3	10.0	50.0%	0		690ms	795	75	0
Qwen3.8 27B	6.3	10.0	50.0%	0		582ms	711	72	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	6.2	10.0	33.3%	0		744ms	828	114	0
Qwen3.8 27B	6.0	10.0	33.3%	0		1.25s	714	411	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	10.0	10.0	100.0%	0		57.10s	6,123	210	0
Qwen3.8 27B	10.0	10.0	100.0%	0		2.75s	7,932	273	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	3.0	10.0	0.0%	0		778ms	223	13	0
Qwen3.8 27B	3.0	10.0	0.0%	0		703ms	210	27	0

Switch Comparison Pair

North Mini CodemediumFree AvailablevsQwen3.8 27BnoneFree Available Qwen3.8 27BnoneFree AvailablevsHy4 previewlow Gemma 4 26B A4BnoneFree AvailablevsNemotron 3 SupermediumFree Available Qwen3.8 27BnoneFree AvailablevsStep 3.5 Flashmedium North Mini CodemediumFree AvailablevsGemma 4 26B A4BnoneFree Available Gemma 4 26B A4BnoneFree AvailablevsHy4 previewlow Nemotron 3 SupermediumFree AvailablevsQwen3.8 27BnoneFree Available Granite 4.2 8BlowvsQwen3.8 27BnoneFree Available Gemma 4 26B A4BnoneFree AvailablevsStep 3.5 Flashmedium Gemma 4 26B A4BnoneFree AvailablevsStep 5 Previewlow Gemma 4 26B A4BnoneFree AvailablevsGranite 4.2 8Blow Gemma 4 26B A4BnoneFree AvailablevsSpace Bunny Alphalow