AI BENCHY Compare

Google: Gemini 3 Flash Preview vs Elephant Alpha

Summary

Gemini 3 Flash Preview (medium) leads on average score with 9.6 vs 4.6. Elephant Alpha has the lower benchmark cost at $0.000 vs $0.667. Elephant Alpha is faster at 1.22s vs 18.64s, with pass rates of 98.4% vs 27.0%.

Recommended modelGemini 3 Flash Preview (medium)It has the strongest score in this comparison (9.6) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-07-14

Metric	Gemini 3 Flash Preview Gemini 3 Flash Preview medium Release: 2025-12-17	Elephant Alpha Elephant Alpha none Release: 2026-04-14

Metric	Gemini 3 Flash Preview Gemini 3 Flash Preview medium Release: 2025-12-17	Elephant Alpha Elephant Alpha none Release: 2026-04-14
Score	9.6	4.6
Rank	#2	#180
Reliability	10.0	N/A
Consistency	9.7	9.7
Tests Correct
Attempt pass rate	98.4%	27.0%
Flaky tests	1	1
Total Runs	63	63
Cost per result	3.335	0.000
Total Cost	$0.667	$0.000
Input Price	$0.500 / 1M	$0.000 / 1M
Output Price	$3.000 / 1M	$0.000 / 1M
Total Input Tokens	37,017	33,743
Output Tokens	2,006	2,573
Reasoning Tokens	214,153	0
Response Time (avg)	18.64s	1.22s
Response Time (max)	117.26s	3.81s
Response Time (total)	391.35s	22.03s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#2 Gemini 3 Flash Preview

medium

Cost: $0.010
Time: 17.9s
Tokens: 3,236 tok

#180 Elephant Alpha

none

Elephant Alpha was a stealth model revealed on April 21st as Ling-2.6-flash. Find it here: https://openrouter.ai/inclusionai/ling-2.6-flash:free

Cost: $0.000
Time: 0.1s
Tokens: 0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		3.88s	494	330	3,216
Elephant Alpha	6.6	10.0	50.0%	0		963ms	726	610	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	8.6	7.6	88.9%	1		84.40s	8,122	462	161,084
Elephant Alpha	4.2	7.8	22.2%	1		1.39s	813	375	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		22.42s	12,873	351	10,485
Elephant Alpha	3.0	10.0	0.0%	0		3.81s	14,046	731	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		5.43s	7,548	279	4,893
Elephant Alpha	6.5	10.0	50.0%	0		1.04s	8,004	246	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		15.27s	633	12	21,684
Elephant Alpha	3.0	10.0	0.0%	0		927ms	810	24	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		5.19s	486	72	1,905
Elephant Alpha	4.0	10.0	0.0%	0		854ms	540	106	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		4.04s	615	72	2,709
Elephant Alpha	9.8	10.0	100.0%	0		1.03s	732	81	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		4.05s	558	183	4,365
Elephant Alpha	4.2	10.0	0.0%	0		807ms	729	170	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		12.60s	5,532	234	1,487
Elephant Alpha	3.0	10.0	0.0%	0		2.79s	7,343	230	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		5.50s	156	11	2,325
Elephant Alpha	3.0	10.0	0.0%	0		0ms	0	0	0

Quick Compare

Switch Comparison Pair