Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5 Nano vs Qwen: Qwen3.5-122B-A10B

Last updated at: 2026-06-01

Metric GPT-5 Nano GPT-5 Nano medium Release: 2025-08-07 Qwen3.5-122B-A10B Qwen3.5-122B-A10B none Release: 2026-02-24
Score 6.1 5.4
Rank #100 #131
Reliability 10.0 10.0
Consistency 7.1 9.5
Tests Correct
Attempt pass rate 55.0% 33.3%
Flaky tests 7 1
Total Runs 60 60
Cost per result 0.952 0.380
Total Cost $0.077 $0.019
Input Price $0.050 / 1M $0.260 / 1M
Output Price $0.400 / 1M $2.080 / 1M
Output Tokens 5,328 3,374
Reasoning Tokens 181,056 0
Response Time (avg) 43.52s 3.38s
Response Time (max) 204.02s 46.00s
Response Time (total) 565.82s 67.55s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 6.5 7.9 58.3% 1 25.50s 1,221 21,184
Qwen3.5-122B-A10B 4.8 10.0 25.0% 0 1.59s 312 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 5.4 6.6 33.3% 1 47.80s 604 30,144
Qwen3.5-122B-A10B 4.0 5.5 33.3% 1 2.14s 684 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 10.0 10.0 100.0% 0 65.96s 578 17,984
Qwen3.5-122B-A10B 3.0 10.0 0.0% 0 46.00s 1,137 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 3.7 1.7 50.0% 2 21.42s 453 10,560
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 1.01s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 5.2 4.4 55.6% 2 204.02s 237 64,448
Qwen3.5-122B-A10B 5.3 10.0 33.3% 0 465ms 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 4.1 10.0 0.0% 0 17.51s 202 4,608
Qwen3.5-122B-A10B 5.0 10.0 0.0% 0 1.12s 66 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 9.8 10.0 100.0% 0 15.64s 312 4,736
Qwen3.5-122B-A10B 6.3 10.0 50.0% 0 513ms 69 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 5.3 7.2 44.4% 1 20.63s 929 14,272
Qwen3.5-122B-A10B 3.8 10.0 0.0% 0 1.00s 575 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 10.0 10.0 100.0% 0 33.30s 558 6,976
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 2.04s 264 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 3.0 10.0 0.0% 0 20.13s 234 6,144
Qwen3.5-122B-A10B 3.0 10.0 0.0% 0 295ms 9 0

Quick Compare

Switch Comparison Pair