Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.4 vs Elephant

Last updated at: 2026-04-14

Metric GPT-5.4 GPT-5.4 none Release: 2026-03-05 Elephant Elephant medium Release: 2026-04-14
Score 5.9 5.2
Rank #63 #77
Consistency 9.1 9.6
Tests Correct
Attempt pass rate 42.6% 29.6%
Flaky tests 2 1
Total Runs 54 54
Cost per result 1.477 0.000
Total Cost $0.104 $0.000
Input Price $2.500 / 1M $0.000 / 1M
Output Price $15.000 / 1M $0.000 / 1M
Output Tokens 2,317 2,596
Reasoning Tokens 0 0
Response Time (avg) 1.51s 1.27s
Response Time (max) 2.95s 3.70s
Response Time (total) 27.21s 22.82s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 3.2 8.0 8.3% 1 1.21s 406 0
Elephant 6.6 10.0 50.0% 0 1.19s 815 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 2.95s 480 0
Elephant 5.1 3.3 33.3% 1 1.30s 365 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 3.0 10.0 0.0% 0 2.89s 291 0
Elephant 3.0 10.0 0.0% 0 3.70s 562 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 1.04s 222 0
Elephant 6.5 10.0 50.0% 0 979ms 246 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 5.3 7.2 44.4% 1 1.07s 50 0
Elephant 3.0 10.0 0.0% 0 925ms 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 4.4 9.9 0.0% 0 1.78s 184 0
Elephant 4.3 10.0 0.0% 0 920ms 105 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 6.5 10.0 50.0% 0 1.07s 81 0
Elephant 9.8 10.0 100.0% 0 987ms 82 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 5.6 9.8 33.3% 0 1.52s 357 0
Elephant 3.7 10.0 0.0% 0 867ms 166 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 2.75s 246 0
Elephant 3.0 10.0 0.0% 0 2.83s 231 0

Quick Compare

Switch Comparison Pair

ElephantmediumvsGrok 4.20noneMistral Small 4nonevsElephantmediumgpt-oss-120bnoneFree AvailablevsElephantmediumTrinity Large PreviewnoneFree AvailablevsElephantmediumGPT-5.4 MininonevsElephantmediumElephantmediumvsQwen3 Coder NextnoneNemotron 3 SupernoneFree AvailablevsElephantmediumMiniMax M2.5mediumFree AvailablevsGPT-5.4noneMistral Small 4mediumvsGPT-5.4noneElephantmediumvsGLM 5 TurbononeKimi K2.5nonevsElephantmediumElephantmediumvsGLM 5.1none