#128
GLM 5.3
high
Z.ai
1
0.8
$0.495 14/23 28.4s
Total Tests 23
Wrong Tests 9
Total Cost $0.495
Response Time (avg) 28.4s
#59
Pareto 26.9
default
Unbiased
1
0.9
$1.864 15/23 28.3s
Total Tests 23
Wrong Tests 8
Total Cost $1.864
Response Time (avg) 28.3s
#55
Muse Spark 1.2
high
Meta
3
0.9
$2.018 15/23 28.1s
Total Tests 23
Wrong Tests 8
Total Cost $2.018
Response Time (avg) 28.1s
#25
Claude Opus 5.5
high
Anthropic
1
0.9
$2.133 19/23 27.6s
Total Tests 23
Wrong Tests 4
Total Cost $2.133
Response Time (avg) 27.6s
#270
DeepSeek V4 Flash 0731
none
DeepSeek
2
0.6
$0.053 5/23 27.4s
Total Tests 23
Wrong Tests 18
Total Cost $0.053
Response Time (avg) 27.4s
#57
Muse Spark 1.1
medium
Meta
2
0.9
$1.665 16/23 27.0s
Total Tests 23
Wrong Tests 7
Total Cost $1.665
Response Time (avg) 27.0s
#129
Step 3.7 Flash
medium
Stepfun
2
0.8
$0.571 13/23 26.6s
Total Tests 23
Wrong Tests 10
Total Cost $0.571
Response Time (avg) 26.6s
#316
Kimi K2.6
none
Moonshot AI
3
0.5
$0.486 6/23 26.3s
Total Tests 23
Wrong Tests 17
Total Cost $0.486
Response Time (avg) 26.3s
#24
Claude Opus 5.5
low
Anthropic
1
0.9
$1.733 19/23 25.7s
Total Tests 23
Wrong Tests 4
Total Cost $1.733
Response Time (avg) 25.7s
#60
Qwen3.8 MAX
low
Qwen
1
0.9
$1.089 17/23 25.1s
Total Tests 23
Wrong Tests 6
Total Cost $1.089
Response Time (avg) 25.1s
#61
GPT-5.4
medium
OpenAI
2
0.9
$2.213 16/23 24.8s
Total Tests 23
Wrong Tests 7
Total Cost $2.213
Response Time (avg) 24.8s
#143
Qwen3.8 Flash Next
medium
Qwen
1
0.8
~$0.047 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4752 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.046984. 15/23 24.8s
Total Tests 23
Wrong Tests 8
Total Cost ~$0.047 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4752 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.046984.
Response Time (avg) 24.8s
#268
KAT-Coder-Pro V2.5
medium
Kwaipilot
1
0.6
$0.669 11/23 23.9s
Total Tests 23
Wrong Tests 12
Total Cost $0.669
Response Time (avg) 23.9s
#402
Grok 4.1 Fast
medium
X AI
4
0.4
$0.069 9/19 23.8s
Total Tests 19
Wrong Tests 10
Total Cost $0.069
Response Time (avg) 23.8s
#114
Qwen3.8 Flash Next
low
Qwen
1
0.8
~$0.045 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4535 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.044834. 15/23 23.7s
Total Tests 23
Wrong Tests 8
Total Cost ~$0.045 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4535 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.044834.
Response Time (avg) 23.7s