Navigate
Advertise here

Qwen3.5-27B vs Hy4 flash (medium)

The average score is effectively tied at 7.2 vs 7.3. Hy4 flash (medium) has the lower benchmark cost at $0.098 vs $0.116. Qwen3.5-27B is faster at 9.98s vs 49.04s, with pass rates of 47.8% vs 72.5%.

Last updated at: 2026-11-17

Compared models

Rank
#220
Total Output Tokens
36,422
Response Time (avg)
9.98s
Total Cost
$0.116
Rank
#218
Total Output Tokens
617,409
Response Time (avg)
49.04s
Total Cost
$0.098
Recommended model Qwen3.5-27B

It has the best score here (7.2), while responding about 4.9x faster than Hy4 flash (medium).

Detailed comparison

Metric Qwen3.5-27B Qwen3.5-27B none Release: 2026-02-24 Hy4 flash Hy4 flash medium Release: 2026-11-17
Score 7.2 7.3
Rank #220 #218
Reliability 10.0 10.0
Consistency 9.4 8.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 47.8% 72.5%
Flaky tests 2 4
Total Runs 69 69
Cost per result 1.153 0.654
Total Cost $0.116 $0.098
Input Price $0.195 / 1M $0.035 / 1M
Output Price $1.560 / 1M $0.141 / 1M
Cache Read Price N/A $0.002 / 1M
Cache Write Price N/A N/A
Total Input Tokens 283,977 321,297
Output Tokens 36,422 7,872
Reasoning Tokens 0 609,537
Response Time (avg) 9.98s 49.04s
Response Time (max) 124.53s 265.97s
Response Time (total) 229.52s 1127.83s
Parameters 27B ~190B total (~12B active)
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#220 Qwen3.5-27B

none
Cost
$0.007
Time
42.9s
Tokens
4,273 tok

#218 Hy4 flash

medium
Cost
$0.002
Time
53.7s
Tokens
13,619 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 5.8 10.0 33.3% 0 1.80s 7,913 415 0
Hy4 flash 7.4 7.0 77.8% 1 74.25s 7,527 129 167,056

Switch Comparison Pair