Navigate
AI BENCHY
Advertise here

Gemini 3.1 Flash Lite Preview (medium) vs GPT-5.4 Mini (medium)

The average score is effectively tied at 7.4 vs 7.5. Gemini 3.1 Flash Lite Preview (medium) has the lower benchmark cost at $0.117 vs $0.786. Gemini 3.1 Flash Lite Preview (medium) is faster at 4.59s vs 26.72s, with pass rates of 63.6% vs 68.2%.

Last updated at: 2026-08-29

Rank
#91
Total Output Tokens
57,778
Response Time (avg)
4.59s
Total Cost
$0.117
Rank
#89
Total Output Tokens
158,344
Response Time (avg)
26.72s
Total Cost
$0.786
Recommended model Gemini 3.1 Flash Lite Preview (medium)

It has the best score here (7.4), while costing about 6.8x less than GPT-5.4 Mini (medium).

Detailed comparison

Metric Gemini 3.1 Flash Lite Preview Gemini 3.1 Flash Lite Preview medium Release: 2026-03-03 GPT-5.4 Mini GPT-5.4 Mini medium Release: 2026-03-17
Score 7.4 7.5
Rank #91 #89
Reliability 10.0 10.0
Consistency 9.9 8.1
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 63.6% 68.2%
Flaky tests 0 5
Total Runs 66 66
Cost per result 0.829 6.546
Total Cost $0.117 $0.786
Input Price $0.250 / 1M $0.750 / 1M
Output Price $1.500 / 1M $4.500 / 1M
Total Input Tokens 117,493 97,164
Output Tokens 10,589 6,211
Reasoning Tokens 47,189 152,133
Response Time (avg) 4.59s 26.72s
Response Time (max) 18.34s 138.75s
Response Time (total) 101.04s 587.90s
Parameters ~150B total (~10B active) ~400B total (~17B active)
Availability Closed Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#91 Gemini 3.1 Flash Lite Preview

medium
Cost
$0.003
Time
5.2s
Tokens
1,944 tok

#89 GPT-5.4 Mini

medium
Cost
$0.056
Time
95.5s
Tokens
12,464 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 5.5 10.0 33.3% 0 4.09s 8,126 461 8,597
GPT-5.4 Mini 8.4 7.4 88.9% 1 57.87s 7,305 467 40,902

Quick Compare

Switch Comparison Pair

Gemini 3.1 Flash Lite PreviewmediumvsQwen3.7 MaxnoneGPT-5.4 MinimediumvsQwen3.7 MaxnoneGemini 3.1 Flash Lite PreviewmediumvsGPT 5.3 ChatnoneGemini 3.1 Flash Lite PreviewmediumvsGPT-5.6 TerralowGemini 3.1 Flash Lite PreviewmediumvsQwen3.8 2.4T A95BhighGPT-5.4 MinimediumvsQwen3.8 2.4T A95BhighGemini 3.1 Flash Lite PreviewmediumvsGrok 4.6lowGPT-5.4 MinimediumvsGrok 4.6lowGemini 3 Flash PreviewlowvsGPT-5.4 MinimediumClaude Opus 5nonevsGPT-5.4 MinimediumGPT-5.4 MinimediumvsSolar Pro 4xhighClaude Sonnet 4.6nonevsGemini 3.1 Flash Lite Previewmedium