Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.7 Plus vs xAI: Grok Build 0.1

Summary

Qwen3.7 Plus vs Grok Build 0.1 benchmark comparison: Grok Build 0.1 leads on average score with 7.6 vs 7.2. Qwen3.7 Plus has the lower benchmark cost at $0.023 vs $0.927. Qwen3.7 Plus is faster at 2.85s vs 49.90s, with pass rates of 47.6% vs 61.9%.

Recommended model: Qwen3.7 Plus - Its score stays close to the best score here (7.2 vs 7.6), while costing about 42.0x less than Grok Build 0.1.

Last updated at: 2026-07-02

Metric Qwen3.7 Plus Qwen3.7 Plus none Release: 2026-06-03 Grok Build 0.1 Grok Build 0.1 medium Release: 2026-05-21
Score 7.2 7.6
Rank #62 #44
Reliability 10.0 10.0
Consistency 10.0 9.9
Tests Correct
Attempt pass rate 47.6% 61.9%
Flaky tests 0 0
Total Runs 63 63
Cost per result 0.276 7.124
Total Cost $0.023 $0.927
Input Price $0.320 / 1M $1.000 / 1M
Output Price $1.280 / 1M $2.000 / 1M
Total Input Tokens 42,510 44,418
Output Tokens 6,578 2,782
Reasoning Tokens 0 438,018
Response Time (avg) 2.85s 49.90s
Response Time (max) 29.38s 252.69s
Response Time (total) 59.86s 1047.92s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#62 Qwen3.7 Plus

none
Cost
$0.019
Time
213.5s
Tokens
11,960 tok

#44 xAI: Grok Build 0.1

medium
Cost
$0.028
Time
81.3s
Tokens
14,009 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.7 Plus 6.5 10.0 50.0% 0 1.38s 696 349 0
Grok Build 0.1 8.3 10.0 75.0% 0 7.43s 2,010 220 12,162
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.7 Plus 5.5 10.0 33.3% 0 2.15s 7,911 639 0
Grok Build 0.1 5.7 9.7 33.3% 0 108.46s 8,304 1,138 161,452
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.7 Plus 10.0 10.0 100.0% 0 29.38s 14,952 4,505 0
Grok Build 0.1 10.0 10.0 100.0% 0 32.81s 12,909 231 16,917
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.7 Plus 10.0 10.0 100.0% 0 1.43s 7,794 243 0
Grok Build 0.1 10.0 10.0 100.0% 0 10.72s 7,761 180 8,876
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.7 Plus 3.0 10.0 0.0% 0 868ms 789 18 0
Grok Build 0.1 5.3 10.0 33.3% 0 158.00s 1,764 492 175,294
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.7 Plus 5.3 10.0 0.0% 0 1.33s 522 78 0
Grok Build 0.1 4.4 9.9 0.0% 0 18.41s 825 76 6,345
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.7 Plus 6.3 10.0 50.0% 0 929ms 711 72 0
Grok Build 0.1 9.8 10.0 100.0% 0 12.36s 1,362 57 9,599
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.7 Plus 7.7 10.0 66.7% 0 1.71s 714 443 0
Grok Build 0.1 7.7 10.0 66.7% 0 18.26s 1,689 195 20,841
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.7 Plus 10.0 10.0 100.0% 0 3.54s 8,211 222 0
Grok Build 0.1 10.0 10.0 100.0% 0 13.12s 7,263 180 4,969
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.7 Plus 3.0 10.0 0.0% 0 1.21s 210 9 0
Grok Build 0.1 3.0 10.0 0.0% 0 53.51s 531 13 21,563

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BmediumFree AvailablevsQwen3.7 PlusnoneDeepSeek V4 ProhighvsGrok Build 0.1mediumQwen3.7 PlusnonevsStep 3.7 FlashhighQwen3.7 PlusnonevsGLM 5.1mediumGPT-5.3 ChatnonevsGrok Build 0.1mediumStep 3.7 FlashlowvsGrok Build 0.1mediumLaguna XS 2.1mediumFree AvailablevsQwen3.7 PlusnoneClaude Opus 4.8lowvsGrok Build 0.1mediumKimi K2.7 CodemediumvsQwen3.7 PlusnoneQwen3.7 PlusnonevsGrok 4.20mediumGemini 3 Flash PreviewlowvsQwen3.7 PlusnoneGemini 3 Flash PreviewlowvsGrok Build 0.1medium