Navigate
AI BENCHY
Advertise here

Gemini 3.1 Flash Lite Preview (medium) vs GPT-5.6 Luna (medium)

The average score is effectively tied at 7.4 vs 7.4. GPT-5.6 Luna (medium) has the lower benchmark cost at $0.072 vs $0.117. Gemini 3.1 Flash Lite Preview (medium) is faster at 4.59s vs 7.43s, with pass rates of 63.6% vs 62.1%.

Last updated at: 2026-08-20

Rank
#90
Total Output Tokens
57,778
Response Time (avg)
4.59s
Total Cost
$0.117
Rank
#93
Total Output Tokens
44,525
Response Time (avg)
7.43s
Total Cost
$0.072
Recommended model GPT-5.6 Luna (medium)

It has the best score here (7.4), while costing about 1.6x less than Gemini 3.1 Flash Lite Preview (medium).

Detailed comparison

Metric Gemini 3.1 Flash Lite Preview Gemini 3.1 Flash Lite Preview medium Release: 2026-03-03 GPT-5.6 Luna GPT-5.6 Luna medium Release: 2026-07-09
Score 7.4 7.4
Rank #90 #93
Reliability 10.0 10.0
Consistency 9.9 9.2
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 63.6% 62.1%
Flaky tests 0 2
Total Runs 66 66
Cost per result 0.829 2.601
Total Cost $0.117 $0.072
Input Price $0.250 / 1M $0.200 / 1M
Output Price $1.500 / 1M $1.200 / 1M
Total Input Tokens 117,493 89,685
Output Tokens 10,589 5,701
Reasoning Tokens 47,189 38,824
Response Time (avg) 4.59s 7.43s
Response Time (max) 18.34s 29.85s
Response Time (total) 101.04s 163.54s
Parameters ~150B total (~10B active) ~400B total (~17B active)
Availability Closed Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#90 Gemini 3.1 Flash Lite Preview

medium
Cost
$0.003
Time
5.2s
Tokens
1,944 tok

#93 GPT-5.6 Luna

medium
Cost
$0.014
Time
14.6s
Tokens
2,362 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 5.5 10.0 33.3% 0 4.09s 8,126 461 8,597
GPT-5.6 Luna 5.4 7.2 44.4% 1 10.38s 7,302 564 9,928

Quick Compare

Switch Comparison Pair

Gemini 3.1 Flash Lite PreviewmediumvsQwen3.7 MaxnoneGPT-5.6 LunamediumvsQwen3.7 MaxnoneGemini 3.1 Flash Lite PreviewmediumvsGPT 5.3 ChatnoneGPT-5.6 LunamediumvsQwen3.8 2.4T A95BhighGemini 3.1 Flash Lite PreviewmediumvsGPT-5.6 TerralowGemini 3.1 Flash Lite PreviewmediumvsQwen3.8 2.4T A95BhighGPT-5.6 LunamediumvsGrok 4.6lowGemini 3 Flash PreviewlowvsGPT-5.6 LunamediumGemini 3.1 Flash Lite PreviewmediumvsGrok 4.6lowClaude Sonnet 4.6nonevsGPT-5.6 LunamediumGPT-5.6 LunamediumvsGLM 5.3highKAT-Coder-Pro V2.5lowvsGPT-5.6 Lunamedium