Navigate
Advertise here

ERNIE-Light-DT-1.0 (high) vs Inkling 2 Mini (local Q4) (minimal)

The average score is effectively tied at 8.6 vs 8.7. Inkling 2 Mini (local Q4) (minimal) has the lower benchmark cost at ~$0.206 vs $1.027. ERNIE-Light-DT-1.0 (high) is faster at 25.66s vs 108.28s, with pass rates of 75.4% vs 73.9%.

Last updated at: 2026-11-22

Compared models

Rank
#113
Total Output Tokens
194,474
Response Time (avg)
25.66s
Total Cost
$1.027
Rank
#108
Total Output Tokens
219,084
Response Time (avg)
108.28s
Total Cost
~$0.206
Recommended model Inkling 2 Mini (local Q4) (minimal)

It has the best score here (8.7), while costing about 5.0x less than ERNIE-Light-DT-1.0 (high).

Detailed comparison

Metric ERNIE-Light-DT-1.0 ERNIE-Light-DT-1.0 high Release: 2026-11-12 Inkling 2 Mini (local Q4) Inkling 2 Mini (local Q4) minimal Release: 2026-11-20
Score 8.6 8.7
Rank #113 #108
Reliability 9.3 9.8
Consistency 9.3 10.0
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 75.4% 73.9%
Flaky tests 2 0
Total Runs 69 69
Cost per result 6.418 ~1.207
Total Cost $1.027 ~$0.206
Input Price $1.130 / 1M N/A
Output Price $3.941 / 1M N/A
Cache Read Price $0.113 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 230,563 309,808
Output Tokens 6,576 1,579
Reasoning Tokens 187,898 217,505
Response Time (avg) 25.66s 108.28s
Response Time (max) 200.80s 1322.88s
Response Time (total) 590.18s 2490.37s
Parameters ~320B total (~18B active) 26.4B total (3.4B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#113 ERNIE-Light-DT-1.0

high
Cost
$0.067
Time
129.8s
Tokens
16,960 tok

#108 Thinking Machines: Inkling 2 Mini (local Q4)

minimal
Cost
~$0.002
Time
67.8s
Tokens
2,348 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
ERNIE-Light-DT-1.0 10.0 10.0 100.0% 0 14.96s 7,317 419 16,035
Inkling 2 Mini (local Q4) 10.0 10.0 100.0% 0 225.36s 8,814 512 47,862

Switch Comparison Pair

Qwen4 MaxlowvsInkling 2 Mini (local Q4)minimalClaude Fable 5.2highvsInkling 2 Mini (local Q4)minimalGPT-6 SollowvsInkling 2 Mini (local Q4)minimalERNIE-Light-DT-1.0highvsMuse EmbermaxERNIE-Light-DT-1.0highvsMuse EmberlowERNIE-Light-DT-1.0highvsDeepSeek V4.1 FlashmaxSeed 2.1 TurbomediumvsInkling 2 Mini (local Q4)minimalInkling 2 Mini (local Q4)minimalvsMiMo-V2.6-PromediumQwen3.8 27BhighFree AvailablevsInkling 2 Mini (local Q4)minimalMuse EmberlowvsInkling 2 Mini (local Q4)minimalMuse EmbermaxvsInkling 2 Mini (local Q4)minimalGPT-5.2mediumvsInkling 2 Mini (local Q4)minimal