#67
DeepSeek V4 Flash 0731
high
DeepSeek
1
8.0
$0.084 14/22 114.9s
Total Tests 22
Wrong Tests 8
Total Cost $0.084
Response Time (avg) 114.9s
#68
GLM 5.2
high
Z.ai
2
8.0
$1.188 14/22 69.9s
Total Tests 22
Wrong Tests 8
Total Cost $1.188
Response Time (avg) 69.9s
#81
Qwen3.8 27B
medium
Qwen
1
7.8
~$0.058 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.5784 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.057183. 14/22 33.0s
Total Tests 22
Wrong Tests 8
Total Cost ~$0.058 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.5784 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.057183.
Response Time (avg) 33.0s
#110
Qwen3.8 2.4T A95B
high
Qwen
2
7.4
$2.357 14/22 120.6s
Total Tests 22
Wrong Tests 8
Total Cost $2.357
Response Time (avg) 120.6s
#90
GLM 5 Turbo
medium
Z.ai
1
7.6
$0.323 14/21 23.0s
Total Tests 21
Wrong Tests 7
Total Cost $0.323
Response Time (avg) 23.0s
#54
Seed 2.1 Turbo
medium
Bytedance Seed
1
8.4
$1.951 15/22 193.6s
Total Tests 22
Wrong Tests 7
Total Cost $1.951
Response Time (avg) 193.6s
#57
Claude Fable 5.1
medium
Anthropic
2
8.3
$2.909 15/22 11.7s
Total Tests 22
Wrong Tests 7
Total Cost $2.909
Response Time (avg) 11.7s
#61
Qwen3.8 2.4T A95B
low
Qwen
2
8.1
$2.672 15/22 119.0s
Total Tests 22
Wrong Tests 7
Total Cost $2.672
Response Time (avg) 119.0s
#69
Inkling
medium
Thinkingmachines
1
8.0
$0.383 15/22 15.7s
Total Tests 22
Wrong Tests 7
Total Cost $0.383
Response Time (avg) 15.7s
#74
Qwen3.8 27B
low
Qwen
2
7.9
~$0.071 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7171 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.070898. 15/22 39.1s
Total Tests 22
Wrong Tests 7
Total Cost ~$0.071 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7171 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.070898.
Response Time (avg) 39.1s
#101
Mercury 2.5 Preview
medium
Inception
1
7.5
$0.024 15/22 3.58s
Total Tests 22
Wrong Tests 7
Total Cost $0.024
Response Time (avg) 3.58s
#154
Gemma 4 26B A4B
medium
Google
2
6.8
$0.092 15/22 104.9s
Total Tests 22
Wrong Tests 7
Total Cost $0.092
Response Time (avg) 104.9s
#78
GLM 5.2
medium
Z.ai
2
7.8
$0.224 15/21 23.3s
Total Tests 21
Wrong Tests 6
Total Cost $0.224
Response Time (avg) 23.3s
#85
GLM 5
medium
Z.ai
1
7.7
$0.228 15/21 33.5s
Total Tests 21
Wrong Tests 6
Total Cost $0.228
Response Time (avg) 33.5s
#31
Muse Spark 1.3
high
Meta
1
8.9
$1.653 16/22 52.5s
Total Tests 22
Wrong Tests 6
Total Cost $1.653
Response Time (avg) 52.5s