Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

ByteDance Seed: Seed-2.0-Mini vs Google: Gemini 3 Flash Preview

Summary

Gemini 3 Flash Preview (medium) leads on average score with 9.6 vs 7.4. Seed-2.0-Mini (medium) has the lower benchmark cost at $0.044 vs $0.667. Gemini 3 Flash Preview (medium) is faster at 18.64s vs 80.22s, with pass rates of 57.1% vs 98.4%.

Recommended modelGemini 3 Flash Preview (medium)It has the best score here (9.6), while responding about 4.3x faster than Seed-2.0-Mini (medium).

Last updated at: 2026-07-14

Metric Seed-2.0-Mini Seed-2.0-Mini medium Release: 2026-02-14 Gemini 3 Flash Preview Gemini 3 Flash Preview medium Release: 2025-12-17
Score 7.4 9.6
Rank #66 #2
Reliability 6.7 10.0
Consistency 9.3 9.7
Tests Correct
Attempt pass rate 57.1% 98.4%
Flaky tests 2 1
Total Runs 63 63
Cost per result 0.397 3.335
Total Cost $0.044 $0.667
Input Price $0.100 / 1M $0.500 / 1M
Output Price $0.400 / 1M $3.000 / 1M
Total Input Tokens 41,904 37,017
Output Tokens 2,555 2,006
Reasoning Tokens 95,974 214,153
Response Time (avg) 80.22s 18.64s
Response Time (max) 262.83s 117.26s
Response Time (total) 1363.72s 391.35s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#66 Seed-2.0-Mini

medium
Cost
$0.002
Time
161.7s
Tokens
4,379 tok

#2 Gemini 3 Flash Preview

medium
Cost
$0.010
Time
17.9s
Tokens
3,236 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Seed-2.0-Mini 5.5 9.8 33.3% 0 220.48s 3,823 464 34,964
Gemini 3 Flash Preview 8.6 7.6 88.9% 1 84.40s 8,122 462 161,084

Quick Compare

Switch Comparison Pair