Navigate
Advertise here

Qwen3.5-9B vs Inkling Small

The average score is effectively tied at 4.9 vs 4.9. Qwen3.5-9B has the lower benchmark cost at $0.041 vs $0.054. Inkling Small is faster at 1.45s vs 37.19s, with pass rates of 18.8% vs 23.2%.

Last updated at: 2026-10-19

Compared models

Rank
#362
Total Output Tokens
70,427
Response Time (avg)
37.19s
Total Cost
$0.041
Rank
#356
Total Output Tokens
8,770
Response Time (avg)
1.45s
Total Cost
$0.054
Recommended model Inkling Small

It has the best score here (4.9), while responding about 25.7x faster than Qwen3.5-9B.

Detailed comparison

Metric Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02 Inkling Small Inkling Small none Release: 2026-08-01 Free Available
Score 4.9 4.9
Rank #362 #356
Reliability 9.8 10.0
Consistency 9.7 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 18.8% 23.2%
Flaky tests 1 1
Total Runs 69 69
Cost per result 1.022 1.158
Total Cost $0.041 $0.054
Input Price $0.100 / 1M $0.450 / 1M
Output Price $0.150 / 1M $1.200 / 1M
Cache Read Price N/A $0.100 / 1M
Cache Write Price N/A N/A
Total Input Tokens 307,670 94,733
Output Tokens 70,427 7,087
Reasoning Tokens 0 1,683
Response Time (avg) 37.19s 1.45s
Response Time (max) 433.02s 12.35s
Response Time (total) 855.27s 33.24s
Parameters 9B 276B total (12B active)
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#362 Qwen3.5-9B

none
Reached the allocated time limit (300 seconds) without receiving showcase output.
Cost
$0.000
Time
300.0s
Tokens
0 tok

#356 Thinking Machines: Inkling Small

none
Cost
$0.008
Time
42.1s
Tokens
6,319 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-9B 3.9 7.8 11.1% 1 5.60s 7,913 1,042 0
Inkling Small 3.6 10.0 0.0% 0 759ms 7,356 454 0

Switch Comparison Pair