Navigate
Advertise here

Qwen3.8 27B vs Inkling Small (low)

Qwen3.8 27B leads on average score with 5.4 vs 5.2. Qwen3.8 27B has the lower benchmark cost at ~$0.010 vs $0.055. Inkling Small (low) is faster at 1.99s vs 5.05s, with pass rates of 39.1% vs 47.8%.

Last updated at: 2026-10-03

Compared models

Rank
#279
Total Output Tokens
13,791
Response Time (avg)
5.05s
Total Cost
~$0.010
Rank
#292
Total Output Tokens
14,686
Response Time (avg)
1.99s
Total Cost
$0.055
Recommended model Qwen3.8 27B

It has the best score here (5.4), while costing about 5.7x less than Inkling Small (low).

Detailed comparison

Metric Qwen3.8 27B Qwen3.8 27B none Release: 2026-08-14 Free Available Inkling Small Inkling Small low Release: 2026-08-01 Free Available
Score 5.4 5.2
Rank #279 #292
Reliability 10.0 10.0
Consistency 10.0 8.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 39.1% 47.8%
Flaky tests 0 4
Total Runs 69 69
Cost per result ~0.107 0.649
Total Cost ~$0.010 $0.055
Input Price N/A $0.450 / 1M
Output Price N/A $1.200 / 1M
Cache Read Price N/A $0.100 / 1M
Cache Write Price N/A N/A
Total Input Tokens 281,460 81,447
Output Tokens 13,791 2,715
Reasoning Tokens 0 11,971
Response Time (avg) 5.05s 1.99s
Response Time (max) 47.42s 5.82s
Response Time (total) 116.11s 45.67s
Parameters 27.3B 276B total (12B active)
Availability Weights available Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#279 Qwen3.8 27B

none
Cost
~$0.001
Time
23.9s
Tokens
1,922 tok

#292 Thinking Machines: Inkling Small

low
Cost
$0.001
Time
5.9s
Tokens
759 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.8 27B 5.5 10.0 33.3% 0 1.19s 7,911 408 0
Inkling Small 4.6 5.0 33.3% 2 3.70s 7,374 375 4,332

Quick Compare

Switch Comparison Pair