Navigate
AI BENCHY
Advertise here

Gemini 3.1 Flash Lite Preview (medium) vs Qwen3.5 Plus 2026-02-15 (medium)

The average score is effectively tied at 7.4 vs 7.5. Gemini 3.1 Flash Lite Preview (medium) has the lower benchmark cost at $0.117 vs $0.459. Gemini 3.1 Flash Lite Preview (medium) is faster at 4.59s vs 91.76s, with pass rates of 63.6% vs 72.7%.

Last updated at: 2026-08-15

Rank
#90
Total Output Tokens
57,778
Response Time (avg)
4.59s
Total Cost
$0.117
Rank
#86
Total Output Tokens
274,709
Response Time (avg)
91.76s
Total Cost
$0.459
Recommended model Gemini 3.1 Flash Lite Preview (medium)

It has the best score here (7.4), while costing about 3.9x less than Qwen3.5 Plus 2026-02-15 (medium).

Detailed comparison

Metric Gemini 3.1 Flash Lite Preview Gemini 3.1 Flash Lite Preview medium Release: 2026-03-03 Qwen3.5 Plus 2026-02-15 Qwen3.5 Plus 2026-02-15 medium Release: 2026-02-15
Score 7.4 7.5
Rank #90 #86
Reliability 10.0 10.0
Consistency 9.9 8.1
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 63.6% 72.7%
Flaky tests 0 5
Total Runs 66 66
Cost per result 0.829 3.483
Total Cost $0.117 $0.459
Input Price $0.250 / 1M $0.260 / 1M
Output Price $1.500 / 1M $1.560 / 1M
Total Input Tokens 117,493 113,569
Output Tokens 10,589 9,823
Reasoning Tokens 47,189 264,886
Response Time (avg) 4.59s 91.76s
Response Time (max) 18.34s 304.85s
Response Time (total) 101.04s 1376.42s
Parameters ~150B total (~10B active) ~397B total (~17B active)
Availability Closed Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#90 Gemini 3.1 Flash Lite Preview

medium
Cost
$0.003
Time
5.2s
Tokens
1,944 tok

#86 Qwen3.5 Plus 2026-02-15

medium
Cost
$0.011
Time
125.5s
Tokens
7,040 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 5.5 10.0 33.3% 0 4.09s 8,126 461 8,597
Qwen3.5 Plus 2026-02-15 6.6 7.1 44.4% 1 180.70s 6,950 420 80,595

Quick Compare

Switch Comparison Pair

GPT 5.3 ChatnonevsQwen3.5 Plus 2026-02-15mediumGemini 3.1 Flash Lite PreviewmediumvsQwen3.7 MaxnoneGPT-5.6 TerralowvsQwen3.5 Plus 2026-02-15mediumGemini 3.1 Flash Lite PreviewmediumvsGPT 5.3 ChatnoneGemini 3.1 Flash Lite PreviewmediumvsGPT-5.6 TerralowGemini 3.1 Flash Lite PreviewmediumvsQwen3.8 2.4T A95BhighClaude Opus 5nonevsQwen3.5 Plus 2026-02-15mediumGemini 3.1 Flash Lite PreviewmediumvsGrok 4.6lowQwen3.5 Plus 2026-02-15mediumvsSolar Pro 4xhighGPT-5.6 LunahighvsQwen3.5 Plus 2026-02-15mediumClaude Sonnet 4.6nonevsGemini 3.1 Flash Lite PreviewmediumClaude Opus 5nonevsGemini 3.1 Flash Lite Previewmedium