Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.6 Plus vs xAI: Grok 4.3

Last updated at: 2026-05-10

Metric Qwen3.6 Plus Qwen3.6 Plus medium Release: 2026-04-20 Grok 4.3 Grok 4.3 medium Release: 2026-05-01
Score 7.9 8.0
Rank #28 #24
Reliability 10.0 10.0
Consistency 9.6 8.7
Tests Correct
Attempt pass rate 70.2% 77.2%
Flaky tests 1 3
Total Runs 57 57
Cost per result 0.118 4.229
Total Cost $0.016 $0.550
Input Price $0.325 / 1M $1.250 / 1M
Output Price $1.950 / 1M $2.500 / 1M
Output Tokens 1,784 1,237
Reasoning Tokens 91,543 200,033
Response Time (avg) 17.06s 48.41s
Response Time (max) 47.51s 216.69s
Response Time (total) 307.07s 919.73s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 Plus 10.0 10.0 100.0% 0 9.90s 207 7,557
Grok 4.3 10.0 10.0 100.0% 0 8.83s 88 8,207
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 Plus 3.0 10.0 0.0% 0 0ms 0 0
Grok 4.3 10.0 10.0 100.0% 0 45.72s 284 9,659
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 Plus 10.0 10.0 100.0% 0 34.95s 452 13,073
Grok 4.3 10.0 10.0 100.0% 0 63.99s 234 15,301
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 Plus 10.0 10.0 100.0% 0 14.95s 270 10,706
Grok 4.3 10.0 10.0 100.0% 0 18.97s 180 9,546
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 Plus 2.9 7.2 11.1% 1 29.59s 56 33,464
Grok 4.3 5.3 7.2 44.4% 1 181.74s 14 111,300
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 Plus 5.1 10.0 0.0% 0 27.05s 111 5,232
Grok 4.3 5.4 2.5 66.7% 1 24.70s 70 5,020
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 Plus 10.0 10.0 100.0% 0 7.54s 102 5,552
Grok 4.3 9.8 10.0 100.0% 0 18.58s 57 8,713
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 Plus 10.0 10.0 100.0% 0 6.11s 298 6,868
Grok 4.3 5.9 7.2 55.6% 1 22.53s 128 14,686
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 Plus 10.0 10.0 100.0% 0 5.87s 267 1,330
Grok 4.3 10.0 10.0 100.0% 0 17.66s 168 4,615
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 Plus 3.0 10.0 0.0% 0 47.51s 21 7,761
Grok 4.3 3.0 10.0 0.0% 0 44.47s 14 12,986

Quick Compare

Switch Comparison Pair