AI BENCHY
Advertise here
#48

Qwen3.7 Flash

Qwen Release: 2026-07-28 Tested on: 2026-07-28 09:10 qwen/qwen3.7-flash::high
(high) (medium) (low) (none)

Summary

Qwen3.7 Flash scores 7.8 on AI BENCHY and ranks #48. It has 10.0 reliability, a 72.7% pass rate, $0.051 total cost, and 39.77s average response time.

What makes Qwen3.7 Flash unique: It stands out most in Coding, where it ranks #3, while Instructions following is its weakest area at #16. Its total benchmark cost is unusually low for its score range. It uses unusually many reasoning tokens, which can help explain its slower or more expensive runs.

Score

7.8

Consistency

7.8

Reliability

10.0

Total Cost (Current Price)

$0.051

Total Output Tokens

359,703

Total Input Tokens

116,322

Input Price

$0.030 / 1M

Output Price

$0.130 / 1M

Tests Correct

Wrong Tests: 9

Attempt pass rate: 72.7%

Flaky tests

6

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

39.77s

Response Time (max): 431.47s

Response Time (total): 875.01s

Wrong answer: 7 Did not follow instructions: 1 Invalid tool call: 1

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#48 Qwen3.7 Flash

high
Invalid SVG
Cost
$0.000
Time
600.0s
Tokens
0 tok

Price History

Historical pricing data for this model from OpenRouter.

Date Input Price Output Price
2026-07-28 09:19 $0.030 / 1M $0.130 / 1M

Charts

Choose the first model, then click a second model to open a side-by-side page.

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Qwen3.7 FlashhighvsClaude Sonnet 4.6mediumQwen3.7 FlashhighvsClaude Opus 4.8lowQwen3.7 FlashhighvsGPT-5.6 TerramediumQwen3.7 FlashhighvsGLM 5mediumQwen3.7 FlashhighvsGLM 5.2mediumQwen3.7 FlashhighvsClaude Opus 4.6mediumQwen3.7 FlashhighvsQwen3.6 PlusmediumQwen3.7 FlashhighvsGPT-5.6 LunahighQwen3.7 FlashhighvsQwen3.7 PlusmediumQwen3.7 FlashhighvsDeepSeek V4 Flashhigh

Category Breakdown

Category Score Consistency Tests Correct
Anti-AI Tricks 10.0 10.0
Coding 8.2 9.7
Combined 6.9 5.9
Data parsing and extraction 10.0 10.0
Domain specific 3.5 4.4
General Intelligence 5.1 3.4
Instructions following 9.8 10.0
Puzzle Solving 7.1 5.1
Tool Calling 10.0 10.0
Trivia 3.0 10.0

Compared models