#273
Hy4 preview
none
Tencent
2
4.8
$0.041 3/22 39.2s
Total Tests 22
Wrong Tests 19
Total Cost $0.041
Response Time (avg) 39.2s
#74
Qwen3.8 27B
low
Qwen
1
7.9
~$0.071 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7171 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.070898. 15/22 39.1s
Total Tests 22
Wrong Tests 7
Total Cost ~$0.071 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7171 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.070898.
Response Time (avg) 39.1s
#315
Step 3.5 Flash
none
Stepfun
1
2.3
$0.020 6/12 39.0s
Total Tests 12
Wrong Tests 6
Total Cost $0.020
Response Time (avg) 39.0s
#125
Qwen3.7 Flash
low
Qwen
3
7.2
$0.043 11/22 38.0s
Total Tests 22
Wrong Tests 11
Total Cost $0.043
Response Time (avg) 38.0s
#65
Muse Spark 1.1
high
Meta
2
8.0
$2.253 12/22 36.9s
Total Tests 22
Wrong Tests 10
Total Cost $2.253
Response Time (avg) 36.9s
#238
DeepSeek V4 Flash 0423
none
DeepSeek
1
5.4
$0.039 4/22 36.2s
Total Tests 22
Wrong Tests 18
Total Cost $0.039
Response Time (avg) 36.2s
#85
GLM 5
medium
Z.ai
1
7.7
$0.228 15/21 33.5s
Total Tests 21
Wrong Tests 6
Total Cost $0.228
Response Time (avg) 33.5s
#81
Qwen3.8 27B
medium
Qwen
2
7.8
~$0.058 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.5784 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.057183. 14/22 33.0s
Total Tests 22
Wrong Tests 8
Total Cost ~$0.058 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.5784 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.057183.
Response Time (avg) 33.0s
#137
Grok 4.20
medium
X AI
2
7.0
$0.805 11/22 32.6s
Total Tests 22
Wrong Tests 11
Total Cost $0.805
Response Time (avg) 32.6s
#87
Claude Opus 4.6
medium
Anthropic
1
7.7
$2.961 13/22 32.2s
Total Tests 22
Wrong Tests 9
Total Cost $2.961
Response Time (avg) 32.2s
#126
Muse Glimmer 30B
medium
Meta
1
7.2
$0.211 11/22 30.6s
Total Tests 22
Wrong Tests 11
Total Cost $0.211
Response Time (avg) 30.6s
#55
Inkling Small
high
Thinkingmachines
2
8.4
$0.398 14/22 30.4s
Total Tests 22
Wrong Tests 8
Total Cost $0.398
Response Time (avg) 30.4s
#263
North Mini Code
none
Cohere
2
5.1
$0.000 4/22 29.9s
Total Tests 22
Wrong Tests 18
Total Cost $0.000
Response Time (avg) 29.9s
#305
Grok Build 0.1
none
X AI
2
4.0
$0.547 7/19 28.7s
Total Tests 19
Wrong Tests 12
Total Cost $0.547
Response Time (avg) 28.7s
#52
GPT-5.2
medium
OpenAI
3
8.4
$1.182 14/22 28.5s
Total Tests 22
Wrong Tests 8
Total Cost $1.182
Response Time (avg) 28.5s