Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.5-35B-A3B vs xAI: Grok 4.20

Last updated at: 2026-05-10

Metric Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24 Grok 4.20 Grok 4.20 medium Release: 2026-03-31
Score 7.2 6.9
Rank #59 #68
Reliability 6.7 10.0
Consistency 6.9 8.3
Tests Correct
Attempt pass rate 75.4% 63.2%
Flaky tests 7 4
Total Runs 57 57
Cost per result 4.806 7.559
Total Cost $0.481 $0.756
Input Price $0.140 / 1M $1.250 / 1M
Output Price $1.000 / 1M $2.500 / 1M
Output Tokens 21,056 1,784
Reasoning Tokens 280,814 128,233
Response Time (avg) 51.50s 14.53s
Response Time (max) 177.35s 63.48s
Response Time (total) 978.57s 276.06s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 21.13s 798 42,652
Grok 4.20 8.2 7.9 83.3% 1 3.95s 287 8,312
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 79.09s 4,273 33,078
Grok 4.20 4.3 1.1 66.7% 1 24.33s 250 12,804
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 4.7 1.6 66.7% 1 75.34s 775 12,485
Grok 4.20 10.0 10.0 100.0% 0 17.40s 232 9,556
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 7.3 5.9 83.3% 1 59.33s 235 19,493
Grok 4.20 10.0 10.0 100.0% 0 4.17s 180 5,333
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 4.1 4.4 44.5% 2 88.34s 41 46,368
Grok 4.20 5.3 10.0 33.3% 0 27.03s 375 49,339
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 2.8 1.6 33.3% 1 30.30s 20 3,753
Grok 4.20 3.9 2.6 33.3% 1 24.48s 65 6,440
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 24.45s 97 17,361
Grok 4.20 7.3 6.0 83.3% 1 4.42s 40 5,474
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 6.4 4.4 77.8% 2 31.58s 3,589 32,206
Grok 4.20 7.7 10.0 66.7% 0 6.20s 149 7,913
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 4.65s 309 1,365
Grok 4.20 3.0 10.0 0.0% 0 13.68s 197 6,620
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 177.35s 10,919 72,053
Grok 4.20 3.0 10.0 0.0% 0 63.48s 9 16,442

Quick Compare

Switch Comparison Pair

DeepSeek V4 ProhighvsGrok 4.20mediumGemma 4 31BnoneFree AvailablevsGrok 4.20mediumClaude Sonnet 4.6nonevsQwen3.5-35B-A3BmediumRing 2.6 1tnoneFree AvailablevsQwen3.5-35B-A3BmediumGemini 3.1 Flash LiteminimalvsGrok 4.20mediumGPT-5.5nonevsGrok 4.20mediumGemini 3.1 Flash LitenonevsGrok 4.20mediumQwen3.5 Plus 2026-02-15nonevsGrok 4.20mediumClaude Sonnet 4.6nonevsGrok 4.20mediumGemma 4 31BnoneFree AvailablevsQwen3.5-35B-A3BmediumDeepSeek V4 FlashhighvsQwen3.5-35B-A3BmediumDeepSeek V4 ProhighvsQwen3.5-35B-A3Bmedium