#274 MoonshotAI: Kimi K3.1 Pro
high- Cost
- $0.074
- Time
- 141.9s
- Tokens
- 7,498 tok
Summary
Kimi K3.1 Pro scores 6.2 on AI BENCHY and ranks #274. It has 8.5 reliability, a 60.9% pass rate, $1.255 total cost, and 39.12s average response time.
What makes Kimi K3.1 Pro unique: It stands out most in General Intelligence, where it ranks #1, while Domain specific is its weakest area at #15.
Researched on 2026-10-24
Best estimate from public evidence; the vendor did not disclose every value. API-only exact checkpoint on the research date. Moonshot says the full weights will be released by November 4; do not classify promised weights as available. Total and active parameter values are estimates inherited from the Kimi K3 backbone because the official Pro blog describes a post-trained K3 without restating exact counts. Native K3.1 Pro documentation requires thinking with low/high/max, which are the benchmarked modes. On the research date, the standard endpoint is $2/$10 per million; the same model has a faster $4/$20 endpoint. These benchmarks use standard speed.
6.2
Consistency
5.3
8.5
$1.255
Total Output Tokens
92,327
Total Input Tokens
165,632
Input Price
$2.000 / 1M
Output Price
$10.000 / 1M
Cache Read Price
$0.200 / 1M
Cache Write Price
N/A
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Flaky tests
13
Flaky tests had mixed outcomes across runs (at least one pass and one fail).
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
Run history
| Tested on | Score | Reliability | Tests Correct | Total Cost | Compare |
|---|---|---|---|---|---|
| 2026-10-24 20:16 Re-test | 8.2 | 8.5 | $1.646 | Compare | |
| 2026-10-24 15:44 Initial run | 6.2 | 8.5 | $1.255 | Current run |
Choose the first model, then click a second model to open a side-by-side page.
| Category | Score | Consistency | Tests Correct |
|---|---|---|---|
| Agentic | 6.1 | 3.1 | |
| Anti-AI Tricks | 7.3 | 5.8 | |
| Coding | 8.2 | 7.2 | |
| Combined | 3.3 | 1.7 | |
| Data parsing and extraction | 7.3 | 5.9 | |
| Domain specific | 2.9 | 4.4 | |
| General Intelligence | 10.0 | 10.0 | |
| Instructions following | 6.5 | 10.0 | |
| Puzzle Solving | 4.0 | 1.6 | |
| Tool Calling | 4.7 | 1.6 | |
| Trivia | 3.0 | 10.0 |