AI BENCHY Compare

Google: Gemini 3 Flash Preview vs Elephant Alpha

Summary

Gemini 3 Flash Preview (medium) leads on average score with 9.6 vs 4.5. Elephant Alpha (medium) has the lower benchmark cost at $0.000 vs $0.667. Elephant Alpha (medium) is faster at 1.27s vs 18.64s, with pass rates of 98.4% vs 30.2%.

Recommended modelGemini 3 Flash Preview (medium)It has the strongest score in this comparison (9.6) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-07-14

Metric	Gemini 3 Flash Preview Gemini 3 Flash Preview medium Release: 2025-12-17	Elephant Alpha Elephant Alpha medium Release: 2026-04-14

Metric	Gemini 3 Flash Preview Gemini 3 Flash Preview medium Release: 2025-12-17	Elephant Alpha Elephant Alpha medium Release: 2026-04-14
Score	9.6	4.5
Rank	#2	#181
Reliability	10.0	N/A
Consistency	9.7	9.7
Tests Correct
Attempt pass rate	98.4%	30.2%
Flaky tests	1	1
Total Runs	63	63
Cost per result	3.335	0.000
Total Cost	$0.667	$0.000
Input Price	$0.500 / 1M	$0.000 / 1M
Output Price	$3.000 / 1M	$0.000 / 1M
Total Input Tokens	37,017	33,744
Output Tokens	2,006	2,596
Reasoning Tokens	214,153	0
Response Time (avg)	18.64s	1.27s
Response Time (max)	117.26s	3.70s
Response Time (total)	391.35s	22.82s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#2 Gemini 3 Flash Preview

medium

Cost: $0.010
Time: 17.9s
Tokens: 3,236 tok

#181 Elephant Alpha

medium

Elephant Alpha was a stealth model revealed on April 21st as Ling-2.6-flash. Find it here: https://openrouter.ai/inclusionai/ling-2.6-flash:free

Cost: $0.000
Time: 0.1s
Tokens: 0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		3.88s	494	330	3,216
Elephant Alpha	6.6	10.0	50.0%	0		1.19s	726	815	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	8.6	7.6	88.9%	1		84.40s	8,122	462	161,084
Elephant Alpha	3.7	7.8	11.1%	1		1.30s	813	365	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		22.42s	12,873	351	10,485
Elephant Alpha	3.0	10.0	0.0%	0		3.70s	14,046	562	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		5.43s	7,548	279	4,893
Elephant Alpha	6.5	10.0	50.0%	0		979ms	8,004	246	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		15.27s	633	12	21,684
Elephant Alpha	3.0	10.0	0.0%	0		925ms	810	24	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		5.19s	486	72	1,905
Elephant Alpha	4.3	10.0	0.0%	0		920ms	540	105	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		4.04s	615	72	2,709
Elephant Alpha	9.8	10.0	100.0%	0		987ms	732	82	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		4.05s	558	183	4,365
Elephant Alpha	5.3	10.0	33.3%	0		868ms	729	166	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		12.60s	5,532	234	1,487
Elephant Alpha	3.0	10.0	0.0%	0		2.83s	7,344	231	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3 Flash Preview	10.0	10.0	100.0%	0		5.50s	156	11	2,325
Elephant Alpha	3.0	10.0	0.0%	0		0ms	0	0	0

Quick Compare

Switch Comparison Pair