Navigate
Advertise here

Dots 3 Note Preview (medium) vs Gemma 4 31B

The average score is effectively tied at 5.7 vs 5.7. Dots 3 Note Preview (medium) has the lower benchmark cost at $0.000 vs $0.031. Gemma 4 31B is faster at 7.28s vs 70.32s, with pass rates of 58.0% vs 42.0%.

Last updated at: 2026-11-13

Compared models

Rank
#351
Total Output Tokens
661,931
Response Time (avg)
70.32s
Total Cost
$0.000
Rank
#352
Total Output Tokens
15,499
Response Time (avg)
7.28s
Total Cost
$0.031
Recommended model Gemma 4 31B

It has the best score here (5.7), while responding about 9.7x faster than Dots 3 Note Preview (medium).

Detailed comparison

Metric Dots 3 Note Preview Dots 3 Note Preview medium Release: 2026-08-14 Free Available Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 Free Available
Score 5.7 5.7
Rank #351 #352
Reliability 10.0 10.0
Consistency 6.9 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 58.0% 42.0%
Flaky tests 9 1
Total Runs 69 69
Cost per result 0.000 0.520
Total Cost $0.000 $0.031
Input Price $0.000 / 1M $0.090 / 1M
Output Price $0.000 / 1M $0.340 / 1M
Cache Read Price N/A $0.050 / 1M
Cache Write Price N/A N/A
Total Input Tokens 208,598 270,970
Output Tokens 120,583 15,499
Reasoning Tokens 590,044 0
Response Time (avg) 70.32s 7.28s
Response Time (max) 459.19s 44.73s
Response Time (total) 1617.43s 152.84s
Parameters 280B total (16B active) 30.7B
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#351 Dots 3 Note Preview

medium
Cost
$0.000
Time
585.4s
Tokens
12,198 tok

#352 Gemma 4 31B

none
Cost
$0.001
Time
12.8s
Tokens
795 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Dots 3 Note Preview 4.2 5.1 33.3% 2 309.15s 7,368 29,392 373,137
Gemma 4 31B 5.5 10.0 33.3% 0 11.19s 8,381 735 0

Switch Comparison Pair