Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Cobuddy vs xAI: Grok 4.20

Last updated at: 2026-05-10

Metric Cobuddy Cobuddy medium Release: 2026-05-06 Free Available Grok 4.20 Grok 4.20 none Release: 2026-03-31
Score 5.8 5.4
Rank #97 #115
Reliability 9.9 N/A
Consistency 6.9 9.5
Tests Correct
Attempt pass rate 54.4% 35.2%
Flaky tests 7 1
Total Runs 57 54
Cost per result 0.000 1.574
Total Cost $0.000 $0.095
Input Price $0.000 / 1M $1.250 / 1M
Output Price $0.000 / 1M $2.500 / 1M
Output Tokens 1,648 1,967
Reasoning Tokens 96,062 0
Response Time (avg) 36.50s 1.11s
Response Time (max) 309.02s 6.04s
Response Time (total) 693.45s 20.02s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 8.7 7.9 91.7% 1 10.00s 98 4,666
Grok 4.20 4.8 10.0 25.0% 0 501ms 267 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 4.3 1.1 66.7% 1 53.59s 343 9,678
Grok 4.20 3.4 9.3 0.0% 0 1.22s 312 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 3.0 10.0 0.0% 0 47.38s 465 7,265
Grok 4.20 3.0 10.0 0.0% 0 6.04s 282 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 6.3 5.8 66.7% 1 17.36s 275 5,591
Grok 4.20 10.0 10.0 100.0% 0 522ms 207 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 2.9 4.4 22.2% 2 128.15s 10 49,454
Grok 4.20 3.0 10.0 0.0% 0 687ms 325 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 4.2 9.9 0.0% 0 23.23s 76 3,782
Grok 4.20 4.8 10.0 0.0% 0 659ms 83 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 9.8 10.0 100.0% 0 11.60s 64 2,842
Grok 4.20 6.3 10.0 50.0% 0 455ms 60 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 3.5 4.4 33.3% 2 12.91s 175 5,627
Grok 4.20 5.3 7.2 44.4% 1 487ms 242 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 10.0 10.0 100.0% 0 11.19s 133 294
Grok 4.20 10.0 10.0 100.0% 0 4.63s 189 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 3.0 10.0 0.0% 0 36.98s 9 6,863
Grok 4.20 - - - - - - - -

Quick Compare

Switch Comparison Pair

CobuddymediumFree AvailablevsQwen3.6 27BnoneCobuddymediumFree AvailablevsOwl AlphanoneCobuddymediumFree AvailablevsQwen3.5-27BnoneCobuddymediumFree AvailablevsMiMo-V2-PrononeCobuddymediumFree AvailablevsGLM 4.7 FlashnoneElephant AlphamediumvsGrok 4.20noneCobuddymediumFree AvailablevsQwen3.5-35B-A3BnoneCobuddymediumFree AvailablevsGPT-5.4noneCobuddymediumFree AvailablevsQwen3.5 Plus 2026-04-20noneCobuddymediumFree AvailablevsKimi K2.6noneMistral Small 4mediumvsGrok 4.20noneCobuddymediumFree AvailablevsGLM 5.1none