Advertise here
#477

HeyGen Decision

Heygen Release: 2026-11-16 Tested on: 2026-11-16 06:14 heygen/heygen-decision-1::none
-OtherClosed

Summary

HeyGen Decision scores 3.2 on AI BENCHY and ranks #477. It has 10.0 reliability, a 26.1% pass rate, $0.029 total cost, and 1.12s average response time.

What makes HeyGen Decision unique: It stands out most in Coding, where it ranks #1, while Instructions following is its weakest area at #8.

Model facts

Researched on 2026-11-16

Parameters
-
Architecture
Other
Availability
Closed
License
-

HeyGen names no backbone or size, so no size estimate is assigned. API-only decision model: answers named yes/no, choice and score questions over text and images with probabilities, without free-form text. Billed on input tokens only. HeyGen endpoint policy publishes training=false and retains prompts. Fallback date records this onboarding request date.

Score

3.2

Consistency

5.2

Total Output Tokens

0

Total Input Tokens

202,431

Input Price

$0.140 / 1M

Output Price

$0.000 / 1M

Cache Read Price

N/A

Cache Write Price

N/A

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Tests Correct

Wrong Tests: 6

Attempt pass rate: 26.1%

Benchmark coverage: 36/69 attempts. Choices supplied by adapters. Supports 12/23 tests. Other tests are unsupported, not failed. Score uses the full suite.

Flaky tests

0

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

1.12s

Response Time (max): 2.28s

Response Time (total): 13.40s

Charts

Choose the first model, then click a second model to open a side-by-side page.

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Category Breakdown

Category Score Consistency Tests Correct
Agentic 0.0 0.0
Anti-AI Tricks 4.0 7.5
Coding 5.1 6.7
Combined 0.0 0.0
Data parsing and extraction 10.0 10.0
Domain specific 5.3 10.0
General Intelligence 0.0 0.0
Instructions following 1.5 5.0
Puzzle Solving 3.3 3.3
Tool Calling 0.0 0.0
Trivia 0.0 0.0

Compared models