Navigate
Advertise here

Qwen4 Max (low) vs Inkling 2 Mini (local Q4) (minimal)

The average score is effectively tied at 8.7 vs 8.7. Inkling 2 Mini (local Q4) (minimal) has the lower benchmark cost at ~$0.206 vs $1.064. Qwen4 Max (low) is faster at 56.68s vs 108.28s, with pass rates of 87.0% vs 73.9%.

Last updated at: 2026-11-22

Compared models

Rank
#109
Total Output Tokens
144,069
Response Time (avg)
56.68s
Total Cost
$1.064
Rank
#108
Total Output Tokens
219,084
Response Time (avg)
108.28s
Total Cost
~$0.206
Recommended model Inkling 2 Mini (local Q4) (minimal)

It has the best score here (8.7), while costing about 5.2x less than Qwen4 Max (low).

Detailed comparison

Metric Qwen4 Max Qwen4 Max low Release: 2026-11-16 Inkling 2 Mini (local Q4) Inkling 2 Mini (local Q4) minimal Release: 2026-11-20
Score 8.7 8.7
Rank #109 #108
Reliability 9.9 9.8
Consistency 10.0 10.0
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 87.0% 73.9%
Flaky tests 0 0
Total Runs 69 69
Cost per result 5.318 ~1.207
Total Cost $1.064 ~$0.206
Input Price $1.500 / 1M N/A
Output Price $4.500 / 1M N/A
Cache Read Price $0.075 / 1M N/A
Cache Write Price $1.875 / 1M N/A
Total Input Tokens 276,790 309,808
Output Tokens 8,266 1,579
Reasoning Tokens 135,803 217,505
Response Time (avg) 56.68s 108.28s
Response Time (max) 564.77s 1322.88s
Response Time (total) 1303.63s 2490.37s
Parameters ~2.4T total (~95B active) 26.4B total (3.4B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#109 Qwen4 Max

low
Cost
$0.064
Time
239.1s
Tokens
14,300 tok

#108 Thinking Machines: Inkling 2 Mini (local Q4)

minimal
Cost
~$0.002
Time
67.8s
Tokens
2,348 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen4 Max 10.0 10.0 100.0% 0 15.29s 8,001 427 8,546
Inkling 2 Mini (local Q4) 10.0 10.0 100.0% 0 225.36s 8,814 512 47,862

Switch Comparison Pair

Claude Fable 5.2highvsQwen4 MaxlowClaude Fable 5.2highvsInkling 2 Mini (local Q4)minimalGPT-6 SollowvsInkling 2 Mini (local Q4)minimalSeed 2.1 TurbomediumvsInkling 2 Mini (local Q4)minimalSeed 2.1 TurbomediumvsQwen4 MaxlowInkling 2 Mini (local Q4)minimalvsMiMo-V2.6-PromediumQwen4 MaxlowvsMiMo-V2.6-PromediumMuse EmbermaxvsQwen4 MaxlowQwen3.8 27BhighFree AvailablevsInkling 2 Mini (local Q4)minimalMuse EmberlowvsInkling 2 Mini (local Q4)minimalMuse EmbermaxvsInkling 2 Mini (local Q4)minimalGPT-5.2mediumvsInkling 2 Mini (local Q4)minimal