Navigate
AI BENCHY
Advertise here

Gemini 3.1 Flash Lite Preview (medium) vs Step 3.7 Flash (low)

Gemini 3.1 Flash Lite Preview (medium) leads on average score with 7.4 vs 7.1. Gemini 3.1 Flash Lite Preview (medium) has the lower benchmark cost at $0.117 vs $0.390. Gemini 3.1 Flash Lite Preview (medium) is faster at 4.59s vs 17.87s, with pass rates of 63.6% vs 63.6%.

Last updated at: 2026-08-15

Rank
#90
Total Output Tokens
57,778
Response Time (avg)
4.59s
Total Cost
$0.117
Rank
#112
Total Output Tokens
320,393
Response Time (avg)
17.87s
Total Cost
$0.390
Recommended model Gemini 3.1 Flash Lite Preview (medium)

It has the best score here (7.4), while costing about 3.4x less than Step 3.7 Flash (low).

Detailed comparison

Metric Gemini 3.1 Flash Lite Preview Gemini 3.1 Flash Lite Preview medium Release: 2026-03-03 Step 3.7 Flash Step 3.7 Flash low Release: 2026-05-29
Score 7.4 7.1
Rank #90 #112
Reliability 10.0 10.0
Consistency 9.9 8.1
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 63.6% 63.6%
Flaky tests 0 5
Total Runs 66 66
Cost per result 0.829 3.539
Total Cost $0.117 $0.390
Input Price $0.250 / 1M $0.200 / 1M
Output Price $1.500 / 1M $1.150 / 1M
Total Input Tokens 117,493 103,842
Output Tokens 10,589 320,393
Reasoning Tokens 47,189 0
Response Time (avg) 4.59s 17.87s
Response Time (max) 18.34s 124.75s
Response Time (total) 101.04s 393.04s
Parameters ~150B total (~10B active) 198B total (11B active)
Availability Closed Open source

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#90 Gemini 3.1 Flash Lite Preview

medium
Cost
$0.003
Time
5.2s
Tokens
1,944 tok

#112 Step 3.7 Flash

low
Invalid SVG
Cost
$0.004
Time
25.3s
Tokens
3,072 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 5.5 10.0 33.3% 0 4.09s 8,126 461 8,597
Step 3.7 Flash 8.2 7.2 88.9% 1 9.46s 7,437 18,685 0

Quick Compare

Switch Comparison Pair

Gemini 3.1 Flash Lite PreviewmediumvsQwen3.7 MaxnoneQwen3.5-122B-A10BmediumvsStep 3.7 FlashlowStep 3.7 FlashlowvsSolar Pro 4highGemini 3.1 Flash Lite PreviewmediumvsGPT 5.3 ChatnoneMuse Glimmer 30BmediumvsStep 3.7 FlashlowGemini 3.1 Flash Lite PreviewmediumvsGPT-5.6 TerralowGemini 3.1 Flash Lite PreviewmediumvsQwen3.8 2.4T A95BhighQwen3.5 Plus 2026-04-20mediumvsStep 3.7 FlashlowGemini 3.1 Flash Lite PreviewmediumvsGrok 4.6lowMuse Glimmer 30BhighvsStep 3.7 FlashlowStep 3.7 FlashlowvsGrok 4.3mediumGPT-5.6 SolnonevsStep 3.7 Flashlow