Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.5-35B-A3B vs xAI: Grok Build 0.1

Last updated at: 2026-05-22

Metric Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24 Grok Build 0.1 Grok Build 0.1 none Release: 2026-05-21
Score 7.0 6.6
Rank #70 #82
Reliability 6.7 10.0
Consistency 7.1 8.0
Tests Correct
Attempt pass rate 71.7% 60.4%
Flaky tests 7 4
Total Runs 60 57
Cost per result 5.463 7.805
Total Cost $0.547 $0.547
Input Price $0.139 / 1M $1.000 / 1M
Output Price $1.000 / 1M $2.000 / 1M
Output Tokens 31,239 267,275
Reasoning Tokens 336,167 0
Response Time (avg) 69.43s 28.69s
Response Time (max) 409.98s 138.35s
Response Time (total) 1388.55s 459.00s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 21.13s 798 42,652
Grok Build 0.1 8.7 7.9 91.7% 1 6.30s 11,162 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 6.5 10.0 50.0% 0 244.54s 14,456 88,431
Grok Build 0.1 10.0 10.0 100.0% 0 21.41s 16,568 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 4.7 1.6 66.7% 1 75.34s 775 12,485
Grok Build 0.1 0.0 0.0 0.0% 0 0ms 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 7.3 5.9 83.3% 1 59.33s 235 19,493
Grok Build 0.1 4.7 1.6 66.7% 1 9.33s 6,359 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 4.1 4.4 44.5% 2 88.34s 41 46,368
Grok Build 0.1 3.6 7.2 22.2% 1 103.71s 179,469 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 2.8 1.6 33.3% 1 30.30s 20 3,753
Grok Build 0.1 4.3 10.0 0.0% 0 12.47s 6,647 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 24.45s 97 17,361
Grok Build 0.1 9.8 10.0 100.0% 0 7.36s 8,970 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 6.4 4.4 77.8% 2 31.58s 3,589 32,206
Grok Build 0.1 6.4 7.7 55.6% 1 9.55s 14,982 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 4.65s 309 1,365
Grok Build 0.1 0.0 0.0 0.0% 0 0ms 0 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 177.35s 10,919 72,053
Grok Build 0.1 3.0 10.0 0.0% 0 36.09s 23,118 0

Quick Compare

Switch Comparison Pair

Claude Sonnet 4.6nonevsQwen3.5-35B-A3BmediumQwen3.6 27BmediumvsGrok Build 0.1noneDeepSeek V4 ProhighvsGrok Build 0.1noneKimi K2.5mediumvsGrok Build 0.1noneGemini 3.1 Flash LiteminimalvsGrok Build 0.1noneRing-2.6-1TnonevsQwen3.5-35B-A3BmediumGPT-5 MinimediumvsGrok Build 0.1noneGemma 4 31BnoneFree AvailablevsQwen3.5-35B-A3BmediumGrok Build 0.1nonevsMiMo-V2-OmnimediumGemini 3.1 Flash LiteminimalvsQwen3.5-35B-A3BmediumMercury 2mediumvsGrok Build 0.1noneDeepSeek V3.2mediumvsGrok Build 0.1none