Navigate
Advertise here

GPT-6.2 Sol (low) vs Qwen3.8 2.4T A95B (low)

The average score is effectively tied at 8.4 vs 8.4. GPT-6.2 Sol (low) has the lower benchmark cost at $0.354 vs $4.016. GPT-6.2 Sol (low) is faster at 4.44s vs 120.40s, with pass rates of 84.1% vs 73.9%.

Last updated at: 2026-11-17

Compared models

Rank
#125
Total Output Tokens
5,820
Response Time (avg)
4.44s
Total Cost
$0.354
Rank
#126
Total Output Tokens
424,019
Response Time (avg)
120.40s
Total Cost
$4.016
Recommended model GPT-6.2 Sol (low)

It has the best score here (8.4), while costing about 11.4x less than Qwen3.8 2.4T A95B (low).

Detailed comparison

Metric GPT-6.2 Sol GPT-6.2 Sol low Release: 2026-11-17 Qwen3.8 2.4T A95B Qwen3.8 2.4T A95B low Release: 2026-08-12
Score 8.4 8.4
Rank #125 #126
Reliability 10.0 9.6
Consistency 8.9 9.2
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 84.1% 73.9%
Flaky tests 3 2
Total Runs 69 69
Cost per result 1.963 19.825
Total Cost $0.354 $4.016
Input Price $2.000 / 1M $2.000 / 1M
Output Price $10.000 / 1M $6.000 / 1M
Cache Read Price $0.100 / 1M $0.250 / 1M
Cache Write Price $2.500 / 1M N/A
Total Input Tokens 147,521 313,881
Output Tokens 4,652 123,706
Reasoning Tokens 1,168 388,328
Response Time (avg) 4.44s 120.40s
Response Time (max) 42.86s 534.21s
Response Time (total) 102.02s 2769.16s
Parameters ~2T total (~150B active) 2.4T total (95B active)
Availability Closed Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#125 GPT-6.2 Sol

low
Cost
$0.018
Time
20.3s
Tokens
1,872 tok

#126 Qwen3.8 2.4T A95B

low
Cost
$0.100
Time
193.2s
Tokens
16,767 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-6.2 Sol 5.4 7.2 44.4% 1 1.65s 7,302 372 0
Qwen3.8 2.4T A95B 7.8 9.3 66.7% 0 172.53s 6,716 21,405 57,399

Switch Comparison Pair