Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

OpenAI: GPT-5 Nano vs Qwen: Qwen3.7 Plus

Last updated at: 2026-06-04

Metric GPT-5 Nano GPT-5 Nano medium Release: 2025-08-07 Qwen3.7 Plus Qwen3.7 Plus none Release: 2026-06-03
Score 6.3 6.4
Rank #94 #88
Reliability 10.0 10.0
Consistency 7.3 10.0
Tests Correct
Attempt pass rate 57.1% 47.6%
Flaky tests 7 0
Total Runs 63 63
Cost per result 0.897 0.276
Total Cost $0.081 $0.028
Input Price $0.050 / 1M $0.400 / 1M
Output Price $0.400 / 1M $1.600 / 1M
Total Input Tokens 34,108 42,510
Output Tokens 5,464 6,578
Reasoning Tokens 192,064 0
Response Time (avg) 42.51s 2.85s
Response Time (max) 204.02s 29.38s
Response Time (total) 595.09s 59.86s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5 Nano 6.5 7.9 58.3% 1 25.50s 606 1,221 21,184
Qwen3.7 Plus 6.5 10.0 50.0% 0 1.38s 696 349 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5 Nano 7.0 7.7 55.6% 1 41.62s 7,305 740 41,152
Qwen3.7 Plus 5.5 10.0 33.3% 0 2.15s 7,911 639 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5 Nano 10.0 10.0 100.0% 0 65.96s 11,019 578 17,984
Qwen3.7 Plus 10.0 10.0 100.0% 0 29.38s 14,952 4,505 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5 Nano 3.7 1.7 50.0% 2 21.42s 7,140 453 10,560
Qwen3.7 Plus 10.0 10.0 100.0% 0 1.43s 7,794 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5 Nano 5.2 4.4 55.6% 2 204.02s 619 237 64,448
Qwen3.7 Plus 3.0 10.0 0.0% 0 868ms 789 18 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5 Nano 4.1 10.0 0.0% 0 17.51s 477 202 4,608
Qwen3.7 Plus 5.3 10.0 0.0% 0 1.33s 522 78 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5 Nano 9.8 10.0 100.0% 0 15.64s 660 312 4,736
Qwen3.7 Plus 6.3 10.0 50.0% 0 929ms 711 72 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5 Nano 5.3 7.2 44.4% 1 20.63s 642 929 14,272
Qwen3.7 Plus 7.7 10.0 66.7% 0 1.71s 714 443 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5 Nano 10.0 10.0 100.0% 0 33.30s 5,445 558 6,976
Qwen3.7 Plus 10.0 10.0 100.0% 0 3.54s 8,211 222 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5 Nano 3.0 10.0 0.0% 0 20.13s 195 234 6,144
Qwen3.7 Plus 3.0 10.0 0.0% 0 1.21s 210 9 0

Quick Compare

Switch Comparison Pair

Gemini 3.1 Flash LiteminimalvsQwen3.7 PlusnoneGPT-5 NanomediumvsQwen3.5 Plus 2026-02-15noneRing-2.6-1TnonevsGPT-5 NanomediumGemini 2.5 FlashnonevsGPT-5 NanomediumGemini 3.1 Flash LitenonevsGPT-5 NanomediumGemini 3.1 Flash LiteminimalvsGPT-5 NanomediumGPT-5 NanomediumvsGLM 5noneMercury 2mediumvsQwen3.7 PlusnoneGemma 4 31BnoneFree AvailablevsGPT-5 NanomediumQwen3.7 PlusnonevsMimo V2 OmnimediumGPT-5 NanomediumvsMimo V2 OmninoneGemma 4 26B A4BnoneFree AvailablevsGPT-5 Nanomedium