- Rank
- #71
- Total Output Tokens
- 102,691
- Response Time (avg)
- 22.71s
- Total Cost
- $1.585
Gemini 3.1 Pro Preview (medium) vs Kimi K3 (max)
Gemini 3.1 Pro Preview (medium) leads on average score with 8.4 vs 8.3. Gemini 3.1 Pro Preview (medium) has the lower benchmark cost at $1.585 vs $4.013. Gemini 3.1 Pro Preview (medium) is faster at 22.71s vs 139.41s, with pass rates of 89.9% vs 78.3%.
Compared models
- Rank
- #78
- Total Output Tokens
- 233,327
- Response Time (avg)
- 139.41s
- Total Cost
- $4.013
Recommended model
Gemini 3.1 Pro Preview (medium)
It has the best score here (8.4), while costing about 2.5x less than Kimi K3 (max).
Detailed comparison
| Metric | Gemini 3.1 Pro Preview Gemini 3.1 Pro Preview medium | Kimi K3 Kimi K3 max |
|---|---|---|
| Score | 8.4 | 8.3 |
| Rank | #71 | #78 |
| Reliability | 9.8 | 9.3 |
| Consistency | 9.6 | 9.3 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 89.9% | 78.3% |
| Flaky tests | 1 | 2 |
| Total Runs | 69 | 69 |
| Cost per result | 7.924 | 23.601 |
| Total Cost | $1.585 | $4.013 |
| Input Price | $2.000 / 1M | $3.000 / 1M |
| Output Price | $12.000 / 1M | $15.000 / 1M |
| Total Input Tokens | 176,208 | 170,700 |
| Output Tokens | 6,093 | 7,719 |
| Reasoning Tokens | 96,598 | 225,608 |
| Response Time (avg) | 22.71s | 139.41s |
| Response Time (max) | 88.68s | 766.58s |
| Response Time (total) | 386.11s | 2788.26s |
| Parameters | ~1.2T total (~20B active) | 2.8T total (104B active) |
| Availability | Closed | Weights available |
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#71 Gemini 3.1 Pro Preview
medium- Cost
- $0.115
- Time
- 87.2s
- Tokens
- 9,629 tok
#78 MoonshotAI: Kimi K3
max- Cost
- $0.281
- Time
- 506.9s
- Tokens
- 18,863 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Pro Preview | 4.7 | 1.6 | 66.7% | 1 | 56.17s | 83,912 | 861 | 4,592 | |
| Kimi K3 | 10.0 | 10.0 | 100.0% | 0 | 74.24s | 135,740 | 4,832 | 4,367 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Pro Preview | 10.0 | 10.0 | 100.0% | 0 | 7.90s | 498 | 112 | 3,218 | |
| Kimi K3 | 10.0 | 10.0 | 100.0% | 0 | 10.24s | 1,638 | 496 | 2,629 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Pro Preview | 7.9 | 9.9 | 66.7% | 0 | 40.17s | 8,124 | 435 | 41,247 | |
| Kimi K3 | 10.0 | 10.0 | 100.0% | 0 | 325.79s | 8,061 | 460 | 84,012 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Pro Preview | 9.8 | 10.0 | 100.0% | 0 | 40.39s | 67,910 | 3,687 | 23,111 | |
| Kimi K3 | 6.5 | 10.0 | 50.0% | 0 | 223.03s | 12,792 | 399 | 20,460 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Pro Preview | 10.0 | 10.0 | 100.0% | 0 | 7.72s | 7,265 | 279 | 3,904 | |
| Kimi K3 | 7.3 | 5.8 | 83.3% | 1 | 16.72s | 7,839 | 354 | 2,606 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Pro Preview | 7.7 | 10.0 | 66.7% | 0 | 20.29s | 644 | 18 | 11,704 | |
| Kimi K3 | 5.3 | 7.2 | 44.4% | 1 | 683.62s | 838 | 57 | 106,892 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Pro Preview | 10.0 | 10.0 | 100.0% | 0 | 11.77s | 490 | 108 | 1,179 | |
| Kimi K3 | 10.0 | 10.0 | 100.0% | 0 | 14.91s | 732 | 191 | 871 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Pro Preview | 10.0 | 10.0 | 100.0% | 0 | 9.56s | 621 | 72 | 2,236 | |
| Kimi K3 | 10.0 | 10.0 | 100.0% | 0 | 7.66s | 1,179 | 147 | 1,119 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Pro Preview | 10.0 | 10.0 | 100.0% | 0 | 6.90s | 570 | 235 | 3,128 | |
| Kimi K3 | 10.0 | 10.0 | 100.0% | 0 | 7.36s | 1,416 | 495 | 1,368 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Pro Preview | 10.0 | 10.0 | 100.0% | 0 | 23.15s | 6,018 | 274 | 982 | |
| Kimi K3 | 3.0 | 10.0 | 0.0% | 0 | 0ms | 0 | 0 | 0 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Pro Preview | 10.0 | 10.0 | 100.0% | 0 | 6.27s | 156 | 12 | 1,297 | |
| Kimi K3 | 3.0 | 10.0 | 0.0% | 0 | 19.67s | 465 | 288 | 1,284 |
Quick Compare
Switch Comparison Pair
Gemini 3.5 FlashhighvsKimi K3maxGemini 3.1 Pro PreviewmediumvsInklinghighFree AvailableGemini 3.1 Pro PreviewmediumvsMuse Glimmer 30BxhighGemini 3.1 Pro PreviewmediumvsMuse Spark 1.1highGemini 3.1 Pro PreviewmediumvsQwen3.8 2.4T A95BlowKimi K3maxvsGPT-5.6 TerrahighKimi K3maxvsGPT-6 LunamediumClaude Opus 4.8mediumvsKimi K3maxDeepSeek V4 Flash 0731highvsGemini 3.1 Pro PreviewmediumKimi K3maxvsQwen3.7 PlusmediumKimi K3maxvsGLM 5.2highKimi K3maxvsGrok 4.5high