Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Cobuddy vs OpenAI: GPT-5.4

Last updated at: 2026-05-06

Metric Cobuddy Cobuddy medium Release: 2026-05-06 Free Available GPT-5.4 GPT-5.4 none Release: 2026-03-05
Score 6.0 5.9
Rank #90 #92
Reliability 9.9 N/A
Consistency 6.7 9.1
Tests Correct
Attempt pass rate 57.4% 42.6%
Flaky tests 7 2
Total Runs 54 54
Cost per result 0.000 1.477
Total Cost $0.000 $0.104
Input Price $0.000 / 1M $2.500 / 1M
Output Price $0.000 / 1M $15.000 / 1M
Output Tokens 1,639 2,317
Reasoning Tokens 89,199 0
Response Time (avg) 36.47s 1.51s
Response Time (max) 309.02s 2.95s
Response Time (total) 656.47s 27.21s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 8.7 7.9 91.7% 1 10.00s 98 4,666
GPT-5.4 3.2 8.0 8.3% 1 1.21s 406 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 4.3 1.1 66.7% 1 53.59s 343 9,678
GPT-5.4 10.0 10.0 100.0% 0 2.95s 480 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 3.0 10.0 0.0% 0 47.38s 465 7,265
GPT-5.4 3.0 10.0 0.0% 0 2.89s 291 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 6.3 5.8 66.7% 1 17.36s 275 5,591
GPT-5.4 10.0 10.0 100.0% 0 1.04s 222 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 2.9 4.4 22.2% 2 128.15s 10 49,454
GPT-5.4 5.3 7.2 44.4% 1 1.07s 50 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 4.2 9.9 0.0% 0 23.23s 76 3,782
GPT-5.4 4.4 9.9 0.0% 0 1.78s 184 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 9.8 10.0 100.0% 0 11.60s 64 2,842
GPT-5.4 6.5 10.0 50.0% 0 1.07s 81 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 3.5 4.4 33.3% 2 12.91s 175 5,627
GPT-5.4 5.6 9.8 33.3% 0 1.52s 357 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 10.0 10.0 100.0% 0 11.19s 133 294
GPT-5.4 10.0 10.0 100.0% 0 2.75s 246 0

Quick Compare

Switch Comparison Pair

CobuddymediumFree AvailablevsOwl AlphanoneCobuddymediumFree AvailablevsMiMo-V2-PrononeCobuddymediumFree AvailablevsGLM 4.7 FlashnoneCobuddymediumFree AvailablevsQwen3.5-27BnoneCobuddymediumFree AvailablevsQwen3.6 27BnoneCobuddymediumFree AvailablevsQwen3.5-35B-A3BnoneCobuddymediumFree AvailablevsKimi K2.6noneCobuddymediumFree AvailablevsGLM 5.1noneCobuddymediumFree AvailablevsQwen3.5 Plus 2026-04-20noneCobuddymediumFree AvailablevsDeepSeek V3.2noneCobuddymediumFree AvailablevsMiMo-V2.5-PrononeCobuddymediumFree AvailablevsQwen3.6 Flashnone