#27
Claude Opus 5
high
Anthropic
2
0.9
$4.524 19/23 25.3s
Total Tests 23
Wrong Tests 4
Total Cost $4.524
Response Time (avg) 25.3s
#61
Qwen3.8 MAX
low
Qwen
5
0.9
$1.089 17/23 25.1s
Total Tests 23
Wrong Tests 6
Total Cost $1.089
Response Time (avg) 25.1s
#284
KAT-Coder-Pro V2.5
default
Kwaipilot
10
0.6
$0.742 11/23 25.0s
Total Tests 23
Wrong Tests 12
Total Cost $0.742
Response Time (avg) 25.0s
#62
GPT-5.4
medium
OpenAI
5
0.9
$2.213 16/23 24.8s
Total Tests 23
Wrong Tests 7
Total Cost $2.213
Response Time (avg) 24.8s
#146
Qwen3.8 Flash Next
medium
Qwen
6
0.8
~$0.047 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4752 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.046984. 15/23 24.8s
Total Tests 23
Wrong Tests 8
Total Cost ~$0.047 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4752 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.046984.
Response Time (avg) 24.8s
#386
Hy3 preview
low
Tencent
4
0.5
$0.042 10/21 24.6s
Total Tests 21
Wrong Tests 11
Total Cost $0.042
Response Time (avg) 24.6s
#271
KAT-Coder-Pro V2.5
medium
Kwaipilot
9
0.6
$0.669 11/23 23.9s
Total Tests 23
Wrong Tests 12
Total Cost $0.669
Response Time (avg) 23.9s
#405
Grok 4.1 Fast
medium
X AI
4
0.4
$0.069 9/19 23.8s
Total Tests 19
Wrong Tests 10
Total Cost $0.069
Response Time (avg) 23.8s
#117
Qwen3.8 Flash Next
low
Qwen
6
0.8
~$0.045 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4535 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.044834. 15/23 23.7s
Total Tests 23
Wrong Tests 8
Total Cost ~$0.045 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4535 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.044834.
Response Time (avg) 23.7s
#3
GPT-6 Sol
high
OpenAI
1
1.0
$0.921 22/23 23.6s
Total Tests 23
Wrong Tests 1
Total Cost $0.921
Response Time (avg) 23.6s
#147
GPT-6 Luna
low
OpenAI
7
0.8
$0.033 12/23 23.2s
Total Tests 23
Wrong Tests 11
Total Cost $0.033
Response Time (avg) 23.2s
#324
GLM 5V Turbo
medium
Z.ai
7
0.5
$0.457 11/21 23.1s
Total Tests 21
Wrong Tests 10
Total Cost $0.457
Response Time (avg) 23.1s
#272
GLM 5 Turbo
medium
Z.ai
4
0.6
$0.323 14/21 23.0s
Total Tests 21
Wrong Tests 7
Total Cost $0.323
Response Time (avg) 23.0s
#137
Muse Wonder
high
Meta
2
0.8
$3.426 15/23 23.0s
Total Tests 23
Wrong Tests 8
Total Cost $3.426
Response Time (avg) 23.0s
#88
Gemini 3.1 Pro Preview
medium
Google
2
0.8
$1.585 20/23 22.7s
Total Tests 23
Wrong Tests 3
Total Cost $1.585
Response Time (avg) 22.7s