Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.7 Max vs xAI: Grok 4.3

Last updated at: 2026-05-22

Metric Qwen3.7 Max Qwen3.7 Max none Release: 2026-05-22 Grok 4.3 Grok 4.3 medium Release: 2026-05-01
Score 7.9 7.8
Rank #27 #33
Reliability 10.0 10.0
Consistency 10.0 8.4
Tests Correct
Attempt pass rate 70.0% 75.0%
Flaky tests 0 4
Total Runs 60 60
Cost per result 0.719 4.562
Total Cost $0.101 $0.593
Input Price $2.500 / 1M $1.250 / 1M
Output Price $7.500 / 1M $2.500 / 1M
Output Tokens 1,988 1,485
Reasoning Tokens 0 214,928
Response Time (avg) 1.30s 49.23s
Response Time (max) 3.92s 216.69s
Response Time (total) 25.95s 984.54s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 6.5 10.0 50.0% 0 1.08s 242 0
Grok 4.3 10.0 10.0 100.0% 0 8.83s 88 8,207
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 6.8 10.0 50.0% 0 1.39s 576 0
Grok 4.3 7.4 6.5 66.7% 1 55.26s 532 24,554
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 3.0 10.0 0.0% 0 2.17s 171 0
Grok 4.3 10.0 10.0 100.0% 0 63.99s 234 15,301
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 1.35s 243 0
Grok 4.3 10.0 10.0 100.0% 0 18.97s 180 9,546
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 7.7 10.0 66.7% 0 975ms 15 0
Grok 4.3 5.3 7.2 44.4% 1 181.74s 14 111,300
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 1.04s 120 0
Grok 4.3 5.4 2.5 66.7% 1 24.70s 70 5,020
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 943ms 72 0
Grok 4.3 9.8 10.0 100.0% 0 18.58s 57 8,713
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 1.13s 314 0
Grok 4.3 5.9 7.2 55.6% 1 22.53s 128 14,686
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 3.92s 222 0
Grok 4.3 10.0 10.0 100.0% 0 17.66s 168 4,615
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 3.0 10.0 0.0% 0 856ms 13 0
Grok 4.3 3.0 10.0 0.0% 0 44.47s 14 12,986

Quick Compare

Switch Comparison Pair

GPT-5.4mediumvsQwen3.7 MaxnoneQwen3.7 MaxnonevsGLM 5 TurbomediumGemini 3.5 FlashminimalvsQwen3.7 MaxnoneQwen3.7 MaxnonevsMiMo-V2.5mediumGemma 4 31BmediumFree AvailablevsQwen3.7 MaxnoneGemini 3 Flash PreviewnonevsGrok 4.3mediumSeed-2.0-LitemediumvsQwen3.7 MaxnoneGemini 3.1 Flash Lite PreviewlowvsGrok 4.3mediumGPT-5.2 ChatnonevsGrok 4.3mediumGemini 3.5 FlashminimalvsGrok 4.3mediumGemini 3.1 Flash Lite PreviewmediumvsQwen3.7 MaxnoneGemini 3.1 Flash LitemediumvsQwen3.7 Maxnone