Navigate
AI BENCHY
Advertise here

GPT-5.6 Terra (low) vs Qwen3.5-27B (medium)

The average score is effectively tied at 7.5 vs 7.5. GPT-5.6 Terra (low) has the lower benchmark cost at $0.420 vs $0.982. GPT-5.6 Terra (low) is faster at 5.45s vs 113.28s, with pass rates of 74.2% vs 75.8%.

Last updated at: 2026-08-20

Rank
#83
Total Output Tokens
21,586
Response Time (avg)
5.45s
Total Cost
$0.420
Rank
#87
Total Output Tokens
614,909
Response Time (avg)
113.28s
Total Cost
$0.982
Recommended model GPT-5.6 Terra (low)

It has the best score here (7.5), while costing about 2.3x less than Qwen3.5-27B (medium).

Detailed comparison

Metric GPT-5.6 Terra GPT-5.6 Terra low Release: 2026-07-09 Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24
Score 7.5 7.5
Rank #83 #87
Reliability 10.0 10.0
Consistency 7.9 7.8
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 74.2% 75.8%
Flaky tests 6 6
Total Runs 66 66
Cost per result 3.954 8.217
Total Cost $0.420 $0.982
Input Price $2.000 / 1M $0.195 / 1M
Output Price $12.000 / 1M $1.560 / 1M
Total Input Tokens 80,304 111,644
Output Tokens 4,714 16,113
Reasoning Tokens 16,872 598,796
Response Time (avg) 5.45s 113.28s
Response Time (max) 19.85s 1026.43s
Response Time (total) 119.83s 2492.26s
Parameters ~1T total (~60B active) 27B
Availability Closed Open source

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#83 GPT-5.6 Terra

low
Cost
$0.034
Time
16.8s
Tokens
2,348 tok

#87 Qwen3.5-27B

medium
Cost
$0.008
Time
62.0s
Tokens
3,099 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Terra 6.6 4.6 77.8% 2 9.56s 7,302 429 6,821
Qwen3.5-27B 6.2 7.1 55.6% 1 160.69s 7,895 6,381 89,388

Quick Compare

Switch Comparison Pair