Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Cobuddy vs xAI: Grok 4.20

Summary

Cobuddy vs Grok 4.20 benchmark comparison: Cobuddy leads on average score with 4.9 vs 4.4. Cobuddy has the lower benchmark cost at $0.000 vs $0.057. Grok 4.20 is faster at 1.11s vs 39.90s, with pass rates of 47.6% vs 28.6%.

Recommended model: Cobuddy - It has the strongest score in this comparison (4.9) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-07-02

Metric Cobuddy Cobuddy medium Release: 2026-05-06 Grok 4.20 Grok 4.20 none Release: 2026-03-31
Score 4.9 4.4
Rank #145 #160
Reliability 10.0 N/A
Consistency 7.5 8.5
Tests Correct
Attempt pass rate 47.6% 28.6%
Flaky tests 6 0
Total Runs 63 54
Cost per result 0.000 1.570
Total Cost $0.000 $0.057
Input Price $0.000 / 1M $1.250 / 1M
Output Price $0.000 / 1M $2.500 / 1M
Total Input Tokens 37,449 41,313
Output Tokens 1,677 1,923
Reasoning Tokens 116,703 0
Response Time (avg) 39.90s 1.11s
Response Time (max) 309.02s 6.04s
Response Time (total) 797.98s 19.96s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#145 Cobuddy

medium
No endpoints found for baidu/cobuddy:free.
Cost
$0.000
Time
0.1s
Tokens
0 tok

#160 xAI: Grok 4.20

none
Cost
$0.004
Time
6.5s
Tokens
1,367 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Cobuddy 8.7 7.9 91.7% 1 10.00s 453 98 4,666
Grok 4.20 4.8 10.0 25.0% 0 501ms 1,986 267 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Cobuddy 3.7 6.7 22.2% 1 79.17s 4,726 358 30,138
Grok 4.20 1.1 3.1 0.0% 0 1.22s 1,074 312 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Cobuddy 3.0 10.0 0.0% 0 47.38s 18,324 465 7,265
Grok 4.20 3.0 10.0 0.0% 0 6.04s 17,673 282 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Cobuddy 6.3 5.8 66.7% 1 17.36s 8,181 275 5,591
Grok 4.20 10.0 10.0 100.0% 0 522ms 7,749 207 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Cobuddy 2.9 4.4 22.2% 2 128.15s 540 10 49,454
Grok 4.20 3.0 10.0 0.0% 0 687ms 1,746 325 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Cobuddy 4.2 9.9 0.0% 0 23.23s 498 76 3,782
Grok 4.20 4.8 10.0 0.0% 0 659ms 819 83 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Cobuddy 9.8 10.0 100.0% 0 11.60s 508 64 2,842
Grok 4.20 6.3 10.0 50.0% 0 445ms 1,350 60 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Cobuddy 3.6 7.2 22.2% 1 12.83s 561 189 5,808
Grok 4.20 5.3 10.0 33.3% 0 473ms 1,671 198 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Cobuddy 10.0 10.0 100.0% 0 11.19s 3,505 133 294
Grok 4.20 10.0 10.0 100.0% 0 4.63s 7,245 189 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Cobuddy 3.0 10.0 0.0% 0 36.98s 153 9 6,863
Grok 4.20 0.0 0.0 0.0% 0 0ms 0 0 0

Quick Compare

Switch Comparison Pair

CobuddymediumvsGPT-4o-mininoneCobuddymediumvsGLM 4.7 FlashnoneCobuddymediumvsNemotron 3 SupernoneFree AvailableCobuddymediumvsLing-2.6-flashnoneGrok 4.20nonevsGLM 4.7 FlashmediumTrinity Large PreviewnonevsCobuddymediumCobuddymediumvsRing-2.6-1TnoneCobuddymediumvsGPT-5.4 NanononeCobuddymediumvsQwen3.5-9BnoneCobuddymediumvsMiMo-V2.5noneCobuddymediumvsNorth Mini CodenoneFree AvailableCobuddymediumvsQwen3 Coder Nextnone