Navigate
Advertise here

Cobuddy (medium) vs Grok 4.20

Cobuddy (medium) leads on average score with 4.7 vs 4.1. Cobuddy (medium) has the lower benchmark cost at $0.000 vs $0.057. Grok 4.20 is faster at 1.11s vs 39.90s, with pass rates of 45.5% vs 27.3%.

Last updated at: 2026-09-18

Compared models

Rank
#297
Total Output Tokens
118,380
Response Time (avg)
39.90s
Total Cost
$0.000
Rank
#310
Total Output Tokens
1,923
Response Time (avg)
1.11s
Total Cost
$0.057
Recommended model Cobuddy (medium)

It has the strongest score in this comparison (4.7) and the best overall balance of cost and response time across all 2 models.

Detailed comparison

Metric Cobuddy Cobuddy medium Release: 2026-05-06 Grok 4.20 Grok 4.20 none Release: 2026-03-31
Score 4.7 4.1
Rank #297 #310
Reliability 10.0 N/A
Consistency 7.2 8.1
Attempts 63/66 54/66
Tests Correct
Attempt pass rate 45.5% 27.3%
Flaky tests 6 0
Total Runs 63 54
Cost per result 0.000 1.570
Total Cost $0.000 $0.057
Input Price $0.000 / 1M $1.250 / 1M
Output Price $0.000 / 1M $2.500 / 1M
Total Input Tokens 37,449 41,313
Output Tokens 1,677 1,923
Reasoning Tokens 116,703 0
Response Time (avg) 39.90s 1.11s
Response Time (max) 309.02s 6.04s
Response Time (total) 797.98s 19.96s
Parameters ~21B total (~3B active) ~1T total (~100B active)
Availability Closed Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#297 Cobuddy

medium
No endpoints found for baidu/cobuddy:free.
Cost
$0.000
Time
0.1s
Tokens
0 tok

#310 xAI: Grok 4.20

none
Cost
$0.004
Time
6.5s
Tokens
1,367 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Cobuddy 3.7 6.7 22.2% 1 79.17s 4,726 358 30,138
Grok 4.20 1.1 3.1 0.0% 0 1.22s 1,074 312 0

Quick Compare

Switch Comparison Pair