Navigate
Advertise here

Gemma 4 31B (medium) vs GPT-5.6 Luna (low)

The average score is effectively tied at 6.9 vs 6.9. GPT-5.6 Luna (low) has the lower benchmark cost at $0.049 vs $0.144. GPT-5.6 Luna (low) is faster at 6.96s vs 78.76s, with pass rates of 66.7% vs 56.5%.

Last updated at: 2026-10-07

Compared models

Rank
#175
Total Output Tokens
277,315
Response Time (avg)
78.76s
Total Cost
$0.144
Rank
#176
Total Output Tokens
28,001
Response Time (avg)
6.96s
Total Cost
$0.049
Recommended model GPT-5.6 Luna (low)

It has the best score here (6.9), while costing about 2.9x less than Gemma 4 31B (medium).

Detailed comparison

Metric Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available GPT-5.6 Luna GPT-5.6 Luna low Release: 2026-07-09
Score 6.9 6.9
Rank #175 #176
Reliability 10.0 10.0
Consistency 8.7 8.3
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 66.7% 56.5%
Flaky tests 3 5
Total Runs 69 69
Cost per result 1.195 2.428
Total Cost $0.144 $0.049
Input Price $0.090 / 1M $0.200 / 1M
Output Price $0.340 / 1M $1.200 / 1M
Cache Read Price $0.050 / 1M $0.020 / 1M
Cache Write Price N/A $0.250 / 1M
Total Input Tokens 251,164 202,680
Output Tokens 36,112 9,230
Reasoning Tokens 241,203 18,771
Response Time (avg) 78.76s 6.96s
Response Time (max) 437.40s 45.74s
Response Time (total) 1653.96s 160.19s
Parameters 30.7B ~400B total (~17B active)
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#175 Gemma 4 31B

medium
Cost
$0.002
Time
45.7s
Tokens
2,696 tok

#176 GPT-5.6 Luna

low
Cost
$0.011
Time
10.2s
Tokens
1,897 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 4.3 5.8 22.2% 1 219.76s 5,568 11,098 33,212
GPT-5.6 Luna 5.5 10.0 33.3% 0 4.61s 7,302 557 3,535

Quick Compare

Switch Comparison Pair

Claude Opus 4.8nonevsGPT-5.6 LunalowClaude Sonnet 5.5lowvsGemma 4 31BmediumFree AvailableClaude Opus 4.8nonevsGemma 4 31BmediumFree AvailableEmber-1highvsGemma 4 31BmediumFree AvailableEmber-1highvsGPT-5.6 LunalowGemini 3.1 Flash LitemediumvsGPT-5.6 LunalowKimi K2.6mediumvsGPT-5.6 LunalowGPT-5.6 LunalowvsQwen3.5-FlashmediumMercury 2.5 PreviewmediumvsGPT-5.6 LunalowGemma 4 31BmediumFree AvailablevsInklinglowFree AvailableGemma 4 31BmediumFree AvailablevsGPT-6 SolnoneGemma 4 31BmediumFree AvailablevsMuse Glimmer 30Blow