Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.6 Luna vs Qwen: Qwen3.5-35B-A3B

Summary

GPT-5.6 Luna vs Qwen3.5-35B-A3B benchmark comparison: Qwen3.5-35B-A3B leads on average score with 5.9 vs 5.3. Qwen3.5-35B-A3B has the lower benchmark cost at $0.012 vs $0.047. GPT-5.6 Luna is faster at 1.06s vs 3.37s, with pass rates of 36.5% vs 42.9%.

Recommended model: Qwen3.5-35B-A3B - It has the best score here (5.9), while costing about 4.1x less than GPT-5.6 Luna.

Last updated at: 2026-07-09

Metric GPT-5.6 Luna GPT-5.6 Luna none Release: 2026-07-09 Qwen3.5-35B-A3B Qwen3.5-35B-A3B none Release: 2026-02-24
Score 5.3 5.9
Rank #142 #119
Reliability 10.0 10.0
Consistency 8.8 8.9
Tests Correct
Attempt pass rate 36.5% 42.9%
Flaky tests 3 3
Total Runs 63 63
Cost per result 0.767 0.230
Total Cost $0.047 $0.012
Input Price $1.000 / 1M $0.140 / 1M
Output Price $6.000 / 1M $1.000 / 1M
Total Input Tokens 34,218 48,194
Output Tokens 1,967 4,343
Reasoning Tokens 0 0
Response Time (avg) 1.06s 3.37s
Response Time (max) 2.80s 47.43s
Response Time (total) 22.34s 70.75s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#142 GPT-5.6 Luna

none
Cost
$0.016
Time
15.8s
Tokens
2,685 tok

#119 Qwen3.5-35B-A3B

none
Cost
$0.005
Time
28.4s
Tokens
4,518 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Luna 4.8 10.0 25.0% 0 901ms 606 266 0
Qwen3.5-35B-A3B 3.4 7.9 16.7% 1 1.43s 696 574 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Luna 3.8 7.2 22.2% 1 980ms 7,302 459 0
Qwen3.5-35B-A3B 5.5 10.0 33.3% 0 1.39s 7,808 571 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Luna 3.0 10.0 0.0% 0 2.78s 11,019 280 0
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 47.43s 20,739 1,833 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Luna 10.0 10.0 100.0% 0 758ms 7,140 222 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 1.16s 7,794 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Luna 2.9 7.2 11.1% 1 737ms 723 54 0
Qwen3.5-35B-A3B 7.7 10.0 66.7% 0 485ms 789 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Luna 5.0 10.0 0.0% 0 1.00s 477 150 0
Qwen3.5-35B-A3B 6.5 3.4 66.7% 1 1.19s 522 114 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Luna 7.1 5.8 83.3% 1 1.23s 660 86 0
Qwen3.5-35B-A3B 6.3 10.0 50.0% 0 809ms 711 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Luna 5.3 10.0 33.3% 0 790ms 642 202 0
Qwen3.5-35B-A3B 3.7 7.4 22.2% 1 1.35s 714 655 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Luna 10.0 10.0 100.0% 0 2.80s 5,454 222 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.30s 8,211 264 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Luna 3.0 10.0 0.0% 0 651ms 195 26 0
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 493ms 210 11 0

Quick Compare

Switch Comparison Pair

North Mini CodemediumFree AvailablevsQwen3.5-35B-A3BnoneMiniMax M2.7mediumvsGPT-5.6 LunanoneGemini 3.1 Flash LiteminimalvsQwen3.5-35B-A3BnoneMistral Small 4mediumvsGPT-5.6 LunanoneGPT-5.6 LunalowvsQwen3.5-35B-A3BnoneGemma 4 31BmediumFree AvailablevsQwen3.5-35B-A3BnoneCobuddymediumvsGPT-5.6 LunanoneNemotron 3 SupermediumFree AvailablevsQwen3.5-35B-A3BnoneGemini 3.1 Flash LitelowvsQwen3.5-35B-A3BnoneNorth Mini CodemediumFree AvailablevsGPT-5.6 LunanoneGemini 3.1 Flash Lite PreviewlowvsQwen3.5-35B-A3BnoneMiniMax M2.5mediumvsGPT-5.6 Lunanone