Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

ByteDance Seed: Seed-2.0-Mini vs OpenAI: GPT-5.6 Luna

Summary

GPT-5.6 Luna (high) leads on average score with 7.7 vs 7.4. Seed-2.0-Mini (medium) has the lower benchmark cost at $0.044 vs $0.924. GPT-5.6 Luna (high) is faster at 18.39s vs 80.22s, with pass rates of 57.1% vs 71.4%.

Recommended modelGPT-5.6 Luna (high)It has the best score here (7.7), while responding about 4.4x faster than Seed-2.0-Mini (medium).

Last updated at: 2026-07-14

Metric Seed-2.0-Mini Seed-2.0-Mini medium Release: 2026-02-14 GPT-5.6 Luna GPT-5.6 Luna high Release: 2026-07-09
Score 7.4 7.7
Rank #66 #52
Reliability 6.7 10.0
Consistency 9.3 8.8
Tests Correct
Attempt pass rate 57.1% 71.4%
Flaky tests 2 3
Total Runs 63 63
Cost per result 0.397 6.594
Total Cost $0.044 $0.924
Input Price $0.100 / 1M $1.000 / 1M
Output Price $0.400 / 1M $6.000 / 1M
Total Input Tokens 41,904 35,699
Output Tokens 2,555 2,079
Reasoning Tokens 95,974 145,816
Response Time (avg) 80.22s 18.39s
Response Time (max) 262.83s 111.09s
Response Time (total) 1363.72s 386.24s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#66 Seed-2.0-Mini

medium
Cost
$0.002
Time
161.7s
Tokens
4,379 tok

#52 GPT-5.6 Luna

high
Cost
$0.033
Time
34.2s
Tokens
5,484 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Seed-2.0-Mini 5.5 9.8 33.3% 0 220.48s 3,823 464 34,964
GPT-5.6 Luna 5.5 4.7 55.6% 2 15.63s 7,302 510 17,746

Quick Compare

Switch Comparison Pair