AI BENCHY Compare

ByteDance Seed: Seed-2.0-Mini vs OpenAI: GPT-5.6 Terra

Summary

GPT-5.6 Terra (low) leads on average score with 7.7 vs 7.4. Seed-2.0-Mini (medium) has the lower benchmark cost at $0.044 vs $0.343. GPT-5.6 Terra (low) is faster at 4.88s vs 80.22s, with pass rates of 57.1% vs 74.6%.

Recommended modelGPT-5.6 Terra (low)It has the best score here (7.7), while responding about 16.4x faster than Seed-2.0-Mini (medium).

Last updated at: 2026-07-14

Metric	Seed-2.0-Mini Seed-2.0-Mini medium Release: 2026-02-14	GPT-5.6 Terra GPT-5.6 Terra low Release: 2026-07-09

Metric	Seed-2.0-Mini Seed-2.0-Mini medium Release: 2026-02-14	GPT-5.6 Terra GPT-5.6 Terra low Release: 2026-07-09
Score	7.4	7.7
Rank	#66	#49
Reliability	6.7	10.0
Consistency	9.3	8.1
Tests Correct
Attempt pass rate	57.1%	74.6%
Flaky tests	2	5
Total Runs	63	63
Cost per result	0.397	2.637
Total Cost	$0.044	$0.343
Input Price	$0.100 / 1M	$2.500 / 1M
Output Price	$0.400 / 1M	$15.000 / 1M
Total Input Tokens	41,904	34,226
Output Tokens	2,555	1,943
Reasoning Tokens	95,974	15,201
Response Time (avg)	80.22s	4.88s
Response Time (max)	262.83s	19.85s
Response Time (total)	1363.72s	102.53s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#66 Seed-2.0-Mini

medium

Cost: $0.002
Time: 161.7s
Tokens: 4,379 tok

#49 GPT-5.6 Terra

low

Cost: $0.034
Time: 16.8s
Tokens: 2,348 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Seed-2.0-Mini	6.6	10.0	50.0%	0		74.75s	791	360	9,520
GPT-5.6 Terra	8.3	10.0	75.0%	0		2.36s	606	171	602

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Seed-2.0-Mini	5.5	9.8	33.3%	0		220.48s	3,823	464	34,964
GPT-5.6 Terra	6.6	4.6	77.8%	2		9.56s	7,302	429	6,821

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Seed-2.0-Mini	10.0	10.0	100.0%	0		262.83s	16,533	404	29,806
GPT-5.6 Terra	10.0	10.0	100.0%	0		5.07s	11,019	312	349

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Seed-2.0-Mini	10.0	10.0	100.0%	0		24.27s	8,568	246	2,743
GPT-5.6 Terra	10.0	10.0	100.0%	0		919ms	7,140	222	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Seed-2.0-Mini	3.0	10.0	0.0%	0		0ms	0	0	0
GPT-5.6 Terra	5.3	7.2	44.4%	1		8.34s	723	72	4,086

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Seed-2.0-Mini	5.1	3.4	33.3%	1		36.65s	585	213	4,210
GPT-5.6 Terra	4.8	3.2	33.3%	1		3.52s	477	105	249

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Seed-2.0-Mini	10.0	10.0	100.0%	0		17.47s	840	69	2,050
GPT-5.6 Terra	10.0	10.0	100.0%	0		1.48s	660	87	134

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Seed-2.0-Mini	8.2	7.2	88.9%	1		31.79s	903	527	5,667
GPT-5.6 Terra	10.0	10.0	100.0%	0		4.46s	642	259	1,506

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Seed-2.0-Mini	10.0	10.0	100.0%	0		88.68s	9,585	222	5,235
GPT-5.6 Terra	4.7	1.6	66.7%	1		6.69s	5,462	257	226

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Seed-2.0-Mini	3.0	10.0	0.0%	0		56.76s	276	50	1,779
GPT-5.6 Terra	3.0	10.0	0.0%	0		5.95s	195	29	1,228

Quick Compare

Switch Comparison Pair

GPT-5.6 TerralowvsGrok 4.3medium Claude Opus 4.6mediumvsGPT-5.6 Terralow GPT-5.6 TerralowvsQwen3.5-122B-A10Bmedium Seed-2.0-MinimediumvsGemini 3 Flash Previewlow Kimi K2.6mediumFree AvailablevsGPT-5.6 Terralow KAT-Coder-Pro V2.5highvsGPT-5.6 Terralow Gemini 3.1 Flash LitemediumvsGPT-5.6 Terralow GPT-5.6 TerralowvsQwen3.5 Plus 2026-04-20medium Gemini 3.1 Flash Lite PreviewmediumvsGPT-5.6 Terralow Seed-2.0-MinimediumvsGPT-5.3 Chatnone MiniMax M3mediumvsGPT-5.6 Terralow DeepSeek V4 ProhighvsGPT-5.6 Terralow