Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.5 vs xAI: Grok 4.5

Summary

GPT-5.5 (low) vs Grok 4.5 (medium) benchmark comparison: GPT-5.5 (low) leads on average score with 9.3 vs 8.3. GPT-5.5 (low) has the lower benchmark cost at $0.907 vs $1.696. GPT-5.5 (low) is faster at 9.76s vs 62.63s, with pass rates of 85.7% vs 77.8%.

Recommended model: GPT-5.5 (low) - It has the best score here (9.3), while costing about 1.9x less than Grok 4.5 (medium).

Last updated at: 2026-07-08

Metric GPT-5.5 GPT-5.5 low Release: 2026-04-24 Grok 4.5 Grok 4.5 medium Release: 2026-07-08
Score 9.3 8.3
Rank #4 #23
Reliability 10.0 9.9
Consistency 10.0 8.9
Tests Correct
Attempt pass rate 85.7% 77.8%
Flaky tests 0 3
Total Runs 63 63
Cost per result 5.035 11.304
Total Cost $0.907 $1.696
Input Price $5.000 / 1M $2.000 / 1M
Output Price $30.000 / 1M $6.000 / 1M
Total Input Tokens 34,209 53,500
Output Tokens 2,046 1,621
Reasoning Tokens 22,460 263,127
Response Time (avg) 9.76s 62.63s
Response Time (max) 56.19s 436.38s
Response Time (total) 204.92s 1315.20s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#4 GPT-5.5

low
Cost
$0.068
Time
37.0s
Tokens
2,339 tok

#23 xAI: Grok 4.5

medium
Cost
$0.044
Time
59.4s
Tokens
7,512 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.41s 606 238 1,020
Grok 4.5 10.0 10.0 100.0% 0 23.50s 2,991 147 4,018
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 15.04s 7,302 423 6,402
Grok 4.5 7.6 7.2 77.8% 1 155.69s 9,579 390 104,634
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 9.56s 11,019 303 717
Grok 4.5 10.0 10.0 100.0% 0 15.65s 15,084 261 4,254
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.28s 7,140 228 157
Grok 4.5 10.0 10.0 100.0% 0 6.29s 8,937 225 3,657
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 5.3 10.0 33.3% 0 28.05s 723 69 11,609
Grok 4.5 2.9 7.2 11.1% 1 198.89s 2,212 11 121,922
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 5.17s 477 133 245
Grok 4.5 6.5 3.4 66.7% 1 12.84s 1,077 71 2,384
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 9.9 10.0 100.0% 0 3.74s 660 93 415
Grok 4.5 9.8 10.0 100.0% 0 6.06s 1,857 57 2,728
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.74s 642 279 954
Grok 4.5 10.0 10.0 100.0% 0 7.75s 2,430 254 3,641
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.96s 5,445 250 101
Grok 4.5 10.0 10.0 100.0% 0 6.57s 8,544 192 968
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 3.0 10.0 0.0% 0 10.06s 195 30 840
Grok 4.5 3.0 10.0 0.0% 0 74.44s 789 13 14,921

Quick Compare

Switch Comparison Pair

GPT-5.5lowvsQwen3.7 MaxmediumDeepSeek V4 FlashhighvsGrok 4.5mediumClaude Fable 5mediumvsGPT-5.5lowGemini 3.1 Pro PreviewmediumvsGPT-5.5lowGPT-5.2 ChatnonevsGrok 4.5mediumGemini 3.5 FlashmediumvsGPT-5.5lowGemini 3 Flash PreviewmediumvsGPT-5.5lowGPT-5.5lowvsQwen3.6 Max PreviewmediumClaude Opus 4.8mediumvsGPT-5.5lowGemini 3.5 FlashhighvsGPT-5.5lowClaude Opus 4.8lowvsGrok 4.5mediumClaude Opus 4.7mediumvsGPT-5.5low