Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.2 Chat vs Qwen: Qwen3.5-27B

Last updated at: 2026-04-16

Metric GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11 Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24
Score 7.9 8.4
Rank #28 #10
Consistency 8.7 8.8
Tests Correct
Attempt pass rate 75.9% 81.5%
Flaky tests 3 3
Total Runs 54 54
Cost per result 2.424 3.822
Total Cost $0.291 $0.497
Input Price $1.750 / 1M $0.195 / 1M
Output Price $14.000 / 1M $1.560 / 1M
Output Tokens 17,346 2,500
Reasoning Tokens 0 242,500
Response Time (avg) 6.84s 53.03s
Response Time (max) 38.52s 163.96s
Response Time (total) 123.17s 954.46s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 8.7 7.9 91.7% 1 3.40s 1,807 0
Qwen3.5-27B 8.7 7.9 91.7% 1 19.75s 569 31,505
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 8.97s 1,345 0
Qwen3.5-27B 10.0 10.0 100.0% 0 70.35s 375 19,165
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 9.12s 1,243 0
Qwen3.5-27B 10.0 10.0 100.0% 0 163.96s 483 9,991
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 3.05s 980 0
Qwen3.5-27B 10.0 10.0 100.0% 0 30.26s 270 16,150
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 5.3 10.0 33.3% 0 17.78s 7,810 0
Qwen3.5-27B 5.3 10.0 33.3% 0 79.53s 43 52,368
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 4.4 3.0 33.3% 1 3.20s 335 0
Qwen3.5-27B 6.1 3.1 66.7% 1 101.41s 70 23,147
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 7.5 6.1 83.3% 1 5.46s 1,528 0
Qwen3.5-27B 10.0 10.0 100.0% 0 19.66s 97 11,638
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 7.7 10.0 66.7% 0 4.42s 1,743 0
Qwen3.5-27B 8.2 7.7 77.8% 1 64.61s 245 77,213
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 4.68s 555 0
Qwen3.5-27B 10.0 10.0 100.0% 0 7.45s 348 1,323

Quick Compare

Switch Comparison Pair

GPT-5.2 ChatnonevsStep 3.5 FlashmediumDeepSeek V3.2mediumvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsGLM 5V TurbomediumClaude Sonnet 4.6mediumvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsQwen3.5-FlashmediumGemma 4 26B A4BmediumFree AvailablevsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsGLM 5.1mediumGPT-5.2 ChatnonevsMiMo-V2-PromediumGemini 3.1 Flash Lite PreviewlowvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsQwen3.6 PlusmediumGPT-5.2 ChatnonevsQwen3.5-122B-A10BmediumGPT-5.2 ChatnonevsMiMo-V2-Omnimedium