Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.6 Sol vs OpenAI: GPT-5.6 Terra

Summary

GPT-5.6 Sol vs GPT-5.6 Terra benchmark comparison: GPT-5.6 Sol leads on average score with 6.3 vs 6.0. GPT-5.6 Terra has the lower benchmark cost at $0.130 vs $0.225. GPT-5.6 Terra is faster at 1.25s vs 1.66s, with pass rates of 57.1% vs 42.9%.

Recommended model: GPT-5.6 Terra - Its score stays close to the best score here (6.0 vs 6.3), while costing about 1.7x less than GPT-5.6 Sol.

Last updated at: 2026-07-09

Metric GPT-5.6 Sol GPT-5.6 Sol none Release: 2026-07-09 GPT-5.6 Terra GPT-5.6 Terra none Release: 2026-07-09
Score 6.3 6.0
Rank #101 #116
Reliability 10.0 10.0
Consistency 9.0 9.3
Tests Correct
Attempt pass rate 57.1% 42.9%
Flaky tests 3 2
Total Runs 63 63
Cost per result 2.244 1.623
Total Cost $0.225 $0.130
Input Price $5.000 / 1M $2.500 / 1M
Output Price $30.000 / 1M $15.000 / 1M
Total Input Tokens 34,218 39,552
Output Tokens 1,776 2,060
Reasoning Tokens 0 0
Response Time (avg) 1.66s 1.25s
Response Time (max) 3.93s 3.97s
Response Time (total) 34.81s 26.21s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#101 GPT-5.6 Sol

none
Cost
$0.116
Time
78.7s
Tokens
3,944 tok

#116 GPT-5.6 Terra

none
Cost
$0.030
Time
14.7s
Tokens
2,082 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 8.3 10.0 75.0% 0 1.27s 606 154 0
GPT-5.6 Terra 4.8 10.0 25.0% 0 942ms 606 191 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 5.5 10.0 33.3% 0 1.39s 7,302 390 0
GPT-5.6 Terra 5.5 10.0 33.3% 0 1.00s 7,302 336 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 3.0 10.0 0.0% 0 3.93s 11,019 300 0
GPT-5.6 Terra 3.0 10.0 0.0% 0 3.97s 14,961 437 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 1.53s 7,140 222 0
GPT-5.6 Terra 10.0 10.0 100.0% 0 1.13s 7,140 222 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 3.6 7.2 22.2% 1 1.43s 723 54 0
GPT-5.6 Terra 5.3 7.2 44.4% 1 757ms 723 68 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 6.5 3.4 66.7% 1 1.52s 477 91 0
GPT-5.6 Terra 5.0 10.0 0.0% 0 1.03s 477 102 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 8.5 6.8 83.3% 1 1.33s 660 84 0
GPT-5.6 Terra 8.5 6.8 83.3% 1 1.15s 660 101 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 7.7 10.0 66.7% 0 1.49s 642 211 0
GPT-5.6 Terra 5.3 10.0 33.3% 0 1.23s 642 235 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 3.70s 5,454 246 0
GPT-5.6 Terra 9.6 10.0 100.0% 0 3.10s 6,846 344 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 3.0 10.0 0.0% 0 1.95s 195 24 0
GPT-5.6 Terra 3.0 10.0 0.0% 0 787ms 195 24 0

Quick Compare

Switch Comparison Pair