#21 MoonshotAI: Kimi K3
max- Cost
- $0.281
- Time
- 506.9s
- Tokens
- 18,863 tok
AI BENCHY Compare
MoonshotAI: Kimi K3 vs xAI: Grok 4.5
Summary
Kimi K3 (max) leads on average score with 8.5 vs 8.3. Grok 4.5 (medium) has the lower benchmark cost at $1.696 vs $3.112. Grok 4.5 (medium) is faster at 62.63s vs 122.48s, with pass rates of 82.5% vs 77.8%.
Recommended modelGrok 4.5 (medium)Its score stays close to the best score here (8.3 vs 8.5), while costing about 1.8x less than Kimi K3 (max).
Last updated at: 2026-07-16
| Metric | Kimi K3 Kimi K3 max | Grok 4.5 Grok 4.5 medium |
|---|---|---|
| Score | 8.5 | 8.3 |
| Rank | #21 | #29 |
| Reliability | 9.4 | 9.9 |
| Consistency | 9.2 | 8.9 |
| Tests Correct | ||
| Attempt pass rate | 82.5% | 77.8% |
| Flaky tests | 2 | 3 |
| Total Runs | 63 | 63 |
| Cost per result | 19.446 | 11.304 |
| Total Cost | $3.112 | $1.696 |
| Input Price | $3.000 / 1M | $2.000 / 1M |
| Output Price | $15.000 / 1M | $6.000 / 1M |
| Total Input Tokens | 34,916 | 53,500 |
| Output Tokens | 2,910 | 1,621 |
| Reasoning Tokens | 197,529 | 263,127 |
| Response Time (avg) | 122.48s | 62.63s |
| Response Time (max) | 766.58s | 436.38s |
| Response Time (total) | 2327.06s | 1315.20s |
Generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#29 xAI: Grok 4.5
medium- Cost
- $0.044
- Time
- 59.4s
- Tokens
- 7,512 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
Quick Compare
Switch Comparison Pair
Kimi K3maxvsGPT-5 MinimediumKimi K3maxvsGLM 5mediumKimi K3maxvsGPT-5.4mediumSeed-2.0-LitemediumvsKimi K3maxKimi K3maxvsGPT-5.2 ChatnoneKimi K3maxvsStep 3.7 FlashmediumDeepSeek V4 FlashhighvsGrok 4.5mediumKimi K3maxvsGLM 5.2mediumGPT-5.6 TerrahighvsGrok 4.5mediumKimi K3maxvsGPT-5.2mediumGPT-5.2 ChatnonevsGrok 4.5mediumClaude Opus 4.7mediumvsKimi K3max