- Rank
- #81
- Total Output Tokens
- 24,866
- Response Time (avg)
- 7.65s
- Total Cost
- $1.550
Claude Opus 5 vs Gemini 3.1 Flash Lite Preview (medium)
Claude Opus 5 leads on average score with 7.5 vs 7.4. Gemini 3.1 Flash Lite Preview (medium) has the lower benchmark cost at $0.117 vs $1.550. Gemini 3.1 Flash Lite Preview (medium) is faster at 4.59s vs 7.65s, with pass rates of 57.6% vs 63.6%.
- Rank
- #90
- Total Output Tokens
- 57,778
- Response Time (avg)
- 4.59s
- Total Cost
- $0.117
Recommended model
Gemini 3.1 Flash Lite Preview (medium)
Its score stays close to the best score here (7.4 vs 7.5), while costing about 13.4x less than Claude Opus 5.
Detailed comparison
| Metric | Claude Opus 5 Claude Opus 5 none | Gemini 3.1 Flash Lite Preview Gemini 3.1 Flash Lite Preview medium |
|---|---|---|
| Score | 7.5 | 7.4 |
| Rank | #81 | #90 |
| Reliability | 10.0 | 10.0 |
| Consistency | 9.6 | 9.9 |
| Attempts | 66/66 | 66/66 |
| Tests Correct | ||
| Attempt pass rate | 57.6% | 63.6% |
| Flaky tests | 1 | 0 |
| Total Runs | 66 | 66 |
| Cost per result | 12.912 | 0.829 |
| Total Cost | $1.550 | $0.117 |
| Input Price | $5.000 / 1M | $0.250 / 1M |
| Output Price | $25.000 / 1M | $1.500 / 1M |
| Total Input Tokens | 185,547 | 117,493 |
| Output Tokens | 24,866 | 10,589 |
| Reasoning Tokens | 0 | 47,189 |
| Response Time (avg) | 7.65s | 4.59s |
| Response Time (max) | 47.72s | 18.34s |
| Response Time (total) | 168.35s | 101.04s |
| Parameters | ~5T total (~500B active) | ~150B total (~10B active) |
| Availability | Closed | Closed |
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#81 Claude Opus 5
none- Cost
- $0.271
- Time
- 149.3s
- Tokens
- 10,962 tok
#90 Gemini 3.1 Flash Lite Preview
medium- Cost
- $0.003
- Time
- 5.2s
- Tokens
- 1,944 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 5.5 | 8.3 | 41.7% | 1 | 4.33s | 834 | 1,398 | 0 | |
| Gemini 3.1 Flash Lite Preview | 9.1 | 10.0 | 75.0% | 0 | 2.33s | 512 | 570 | 4,305 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 5.9 | 9.7 | 33.3% | 0 | 5.54s | 10,590 | 2,886 | 0 | |
| Gemini 3.1 Flash Lite Preview | 5.5 | 10.0 | 33.3% | 0 | 4.09s | 8,126 | 461 | 8,597 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 8.3 | 10.0 | 50.0% | 0 | 30.54s | 148,140 | 13,011 | 0 | |
| Gemini 3.1 Flash Lite Preview | 7.2 | 9.1 | 50.0% | 0 | 16.63s | 93,097 | 8,706 | 16,997 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 10.0 | 10.0 | 100.0% | 0 | 3.88s | 10,503 | 309 | 0 | |
| Gemini 3.1 Flash Lite Preview | 10.0 | 10.0 | 100.0% | 0 | 2.29s | 7,362 | 279 | 2,952 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 5.3 | 10.0 | 33.3% | 0 | 11.10s | 972 | 5,440 | 0 | |
| Gemini 3.1 Flash Lite Preview | 5.3 | 10.0 | 33.3% | 0 | 4.09s | 652 | 18 | 6,120 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 10.0 | 10.0 | 100.0% | 0 | 3.70s | 708 | 316 | 0 | |
| Gemini 3.1 Flash Lite Preview | 10.0 | 10.0 | 100.0% | 0 | 3.16s | 488 | 96 | 1,488 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 10.0 | 10.0 | 100.0% | 0 | 2.81s | 909 | 99 | 0 | |
| Gemini 3.1 Flash Lite Preview | 10.0 | 10.0 | 100.0% | 0 | 1.91s | 621 | 72 | 2,121 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 7.7 | 10.0 | 66.7% | 0 | 3.66s | 894 | 874 | 0 | |
| Gemini 3.1 Flash Lite Preview | 7.7 | 10.0 | 66.7% | 0 | 5.30s | 566 | 141 | 1,896 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 10.0 | 10.0 | 100.0% | 0 | 7.89s | 11,739 | 355 | 0 | |
| Gemini 3.1 Flash Lite Preview | 10.0 | 10.0 | 100.0% | 0 | 3.80s | 5,909 | 234 | 912 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 3.0 | 10.0 | 0.0% | 0 | 4.08s | 258 | 178 | 0 | |
| Gemini 3.1 Flash Lite Preview | 3.0 | 10.0 | 0.0% | 0 | 2.68s | 160 | 12 | 1,801 |
Quick Compare
Switch Comparison Pair
Gemini 3.1 Flash Lite PreviewmediumvsQwen3.7 MaxnoneClaude Opus 5nonevsNemotron 3 UltramediumFree AvailableClaude Opus 5nonevsSolar Pro 4xhighClaude Opus 5nonevsGPT-5.6 LunahighClaude Opus 5nonevsGPT-5.4 NanomediumGemini 3.1 Flash Lite PreviewmediumvsGPT 5.3 ChatnoneGemini 3.1 Flash Lite PreviewmediumvsGPT-5.6 TerralowGemini 3.1 Flash Lite PreviewmediumvsQwen3.8 2.4T A95BhighClaude Opus 5nonevsGPT-5.6 TerralowClaude Opus 5nonevsMiniMax M3mediumClaude Opus 5nonevsQwen3.5 Plus 2026-02-15mediumGemini 3.1 Flash Lite PreviewmediumvsGrok 4.6low