Navigate
Advertise here

ERNIE-Light-DT-1.0 vs Gemma 4 31B

Gemma 4 31B leads on average score with 5.7 vs 5.6. Gemma 4 31B has the lower benchmark cost at $0.031 vs $0.524. Gemma 4 31B is faster at 7.28s vs 24.16s, with pass rates of 36.2% vs 42.0%.

Last updated at: 2026-11-13

Compared models

Rank
#357
Total Output Tokens
76,149
Response Time (avg)
24.16s
Total Cost
$0.524
Rank
#352
Total Output Tokens
15,499
Response Time (avg)
7.28s
Total Cost
$0.031
Recommended model Gemma 4 31B

It has the best score here (5.7), while costing about 16.9x less than ERNIE-Light-DT-1.0.

Detailed comparison

Metric ERNIE-Light-DT-1.0 ERNIE-Light-DT-1.0 none Release: 2026-11-12 Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 Free Available
Score 5.6 5.7
Rank #357 #352
Reliability 9.2 10.0
Consistency 9.7 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 36.2% 42.0%
Flaky tests 1 1
Total Runs 69 69
Cost per result 6.545 0.520
Total Cost $0.524 $0.031
Input Price $1.130 / 1M $0.090 / 1M
Output Price $3.941 / 1M $0.340 / 1M
Cache Read Price $0.113 / 1M $0.050 / 1M
Cache Write Price N/A N/A
Total Input Tokens 197,790 270,970
Output Tokens 76,149 15,499
Reasoning Tokens 0 0
Response Time (avg) 24.16s 7.28s
Response Time (max) 449.96s 44.73s
Response Time (total) 555.78s 152.84s
Parameters ~320B total (~18B active) 30.7B
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#357 ERNIE-Light-DT-1.0

none
Cost
$0.009
Time
14.9s
Tokens
2,144 tok

#352 Gemma 4 31B

none
Cost
$0.001
Time
12.8s
Tokens
795 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
ERNIE-Light-DT-1.0 4.3 7.4 11.1% 1 151.72s 6,005 68,639 0
Gemma 4 31B 5.5 10.0 33.3% 0 11.19s 8,381 735 0

Switch Comparison Pair