Navigate
Advertise here

Compared models

Qwen3.8 2.4T A95B (low) vs Qwen3.8 2.4T A95B (high) vs Grok 4.6 (high) benchmark comparison: Grok 4.6 (high) leads on Score with 8.5. Grok 4.6 (high) leads on Reliability with 10.0. Grok 4.6 (high) has the lowest Total Cost at $2.629. Grok 4.6 (high) is fastest at 87.48s.

Last updated at: 2026-11-22

Compared models

Rank
#132
Total Output Tokens
424,019
Response Time (avg)
120.40s
Total Cost
$4.016
Rank
#180
Total Output Tokens
368,836
Response Time (avg)
120.88s
Total Cost
$2.949
Rank
#124
Total Output Tokens
312,614
Response Time (avg)
87.48s
Total Cost
$2.629
Recommended model Grok 4.6 (high)

It has the strongest score in this comparison (8.5) and the best overall balance of cost and response time across 3 models.

Detailed comparison

Metric Qwen3.8 2.4T A95B Qwen3.8 2.4T A95B low Release: 2026-08-12 Qwen3.8 2.4T A95B Qwen3.8 2.4T A95B high Release: 2026-08-12 Grok 4.6 Grok 4.6 high Release: 2026-08-12
Score 8.4 7.9 8.5
Rank #132 #180 #124
Reliability 9.6 9.6 10.0
Consistency 9.2 8.4 10.0
Attempts 69/69 69/69 69/69
Tests Correct
Attempt pass rate 73.9% 75.4% 82.6%
Flaky tests 2 4 0
Total Runs 69 69 69
Cost per result 19.825 18.696 13.833
Total Cost $4.016 $2.949 $2.629
Input Price $2.000 / 1M $2.000 / 1M $2.000 / 1M
Output Price $6.000 / 1M $6.000 / 1M $6.000 / 1M
Cache Read Price $0.250 / 1M $0.250 / 1M $0.500 / 1M
Cache Write Price N/A N/A N/A
Total Input Tokens 313,881 295,642 376,233
Output Tokens 123,706 115,041 6,687
Reasoning Tokens 388,328 353,398 305,927
Response Time (avg) 120.40s 120.88s 87.48s
Response Time (max) 534.21s 532.28s 618.49s
Response Time (total) 2769.16s 2780.16s 2012.15s
Parameters 2.4T total (95B active) 2.4T total (95B active) ~1.7T total (~170B active)
Availability Weights available Weights available Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#132 Qwen3.8 2.4T A95B

low
Cost
$0.100
Time
193.2s
Tokens
16,767 tok

#180 Qwen3.8 2.4T A95B

high
Reached the allocated time limit (600 seconds) without receiving showcase output.
Cost
$0.000
Time
600.0s
Tokens
0 tok

#124 SpaceXAI: Grok 4.6

high
Cost
$0.107
Time
265.1s
Tokens
18,001 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.8 2.4T A95B 7.8 9.3 66.7% 0 172.53s 6,716 21,405 57,399
Qwen3.8 2.4T A95B 5.9 6.3 55.6% 1 160.52s 6,399 3,310 48,078
Grok 4.6 10.0 10.0 100.0% 0 102.20s 9,579 379 51,829

Switch Comparison Pair