Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

MoonshotAI: Kimi K2.6 vs StepFun: Step 3.7 Flash

Summary

Kimi K2.6 (medium) leads on average score with 7.8 vs 7.7. Step 3.7 Flash (low) has the lower benchmark cost at $0.341 vs $0.888. Step 3.7 Flash (low) is faster at 15.74s vs 71.67s, with pass rates of 65.1% vs 68.3%.

Recommended modelStep 3.7 Flash (low)Its score stays close to the best score here (7.7 vs 7.8), while costing about 2.6x less than Kimi K2.6 (medium).

Last updated at: 2026-07-14

Metric Kimi K2.6 Kimi K2.6 medium Release: 2026-04-20 Free Available Step 3.7 Flash Step 3.7 Flash low Release: 2026-05-29
Score 7.8 7.7
Rank #45 #51
Reliability 10.0 10.0
Consistency 8.6 8.4
Tests Correct
Attempt pass rate 65.1% 68.3%
Flaky tests 3 4
Total Runs 63 63
Cost per result 8.358 2.840
Total Cost $0.888 $0.341
Input Price $0.660 / 1M $0.200 / 1M
Output Price $3.410 / 1M $1.150 / 1M
Total Input Tokens 29,450 40,101
Output Tokens 102,923 289,325
Reasoning Tokens 254,094 0
Response Time (avg) 71.67s 15.74s
Response Time (max) 406.78s 124.75s
Response Time (total) 1433.36s 330.63s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#45 MoonshotAI: Kimi K2.6

medium
Cost
$0.013
Time
103.4s
Tokens
3,620 tok

#51 Step 3.7 Flash

low
Invalid SVG
Cost
$0.004
Time
25.3s
Tokens
3,072 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Kimi K2.6 5.7 8.6 33.3% 0 214.42s 2,925 9,970 77,189
Step 3.7 Flash 8.2 7.2 88.9% 1 9.46s 7,437 18,685 0

Quick Compare

Switch Comparison Pair