Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

ByteDance Seed: Seed-2.0-Mini vs Google: Gemini 3.5 Flash

Summary

Gemini 3.5 Flash (high) leads on average score with 9.8 vs 7.4. Seed-2.0-Mini (medium) has the lower benchmark cost at $0.044 vs $1.115. Gemini 3.5 Flash (high) is faster at 8.84s vs 80.22s, with pass rates of 57.1% vs 96.8%.

Recommended modelGemini 3.5 Flash (high)It has the best score here (9.8), while responding about 9.1x faster than Seed-2.0-Mini (medium).

Last updated at: 2026-07-14

Metric Seed-2.0-Mini Seed-2.0-Mini medium Release: 2026-02-14 Gemini 3.5 Flash Gemini 3.5 Flash high Release: 2026-05-19
Score 7.4 9.8
Rank #66 #1
Reliability 6.7 10.0
Consistency 9.3 9.6
Tests Correct
Attempt pass rate 57.1% 96.8%
Flaky tests 2 1
Total Runs 63 63
Cost per result 0.397 5.575
Total Cost $0.044 $1.115
Input Price $0.100 / 1M $1.500 / 1M
Output Price $0.400 / 1M $9.000 / 1M
Total Input Tokens 41,904 37,594
Output Tokens 2,555 1,975
Reasoning Tokens 95,974 115,638
Response Time (avg) 80.22s 8.84s
Response Time (max) 262.83s 34.82s
Response Time (total) 1363.72s 185.57s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#66 Seed-2.0-Mini

medium
Cost
$0.002
Time
161.7s
Tokens
4,379 tok

#1 Gemini 3.5 Flash

high
Cost
$0.208
Time
118.2s
Tokens
23,158 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Seed-2.0-Mini 5.5 9.8 33.3% 0 220.48s 3,823 464 34,964
Gemini 3.5 Flash 10.0 10.0 100.0% 0 22.96s 8,118 456 47,129

Quick Compare

Switch Comparison Pair