#149
Mistral Large 4
high
Mistral
2
0.8
$1.391 12/23 263.7s
Total Tests 23
Wrong Tests 11
Total Cost $1.391
Response Time (avg) 263.7s
#157
Inkling Small
high
Thinkingmachines
2
0.7
$0.398 14/23 29.1s
Total Tests 23
Wrong Tests 9
Total Cost $0.398
Response Time (avg) 29.1s
#158
DeepSeek V4 Pro 0423
none
DeepSeek
2
0.7
$0.083 10/23 14.1s
Total Tests 23
Wrong Tests 13
Total Cost $0.083
Response Time (avg) 14.1s
#161
GLM 5.3 Flash
high
Z.ai
2
0.7
$0.056 13/23 29.1s
Total Tests 23
Wrong Tests 10
Total Cost $0.056
Response Time (avg) 29.1s
#164
Gemini 2.5 Flash
medium
Google
2
0.7
$0.680 15/23 20.5s
Total Tests 23
Wrong Tests 8
Total Cost $0.680
Response Time (avg) 20.5s
#165
LongCat 2.0
high
Meituan
2
0.7
$0.778 10/23 151.7s
Total Tests 23
Wrong Tests 13
Total Cost $0.778
Response Time (avg) 151.7s
#168
Qwen3.5-27B
none
Qwen
2
0.7
$0.116 10/23 9.98s
Total Tests 23
Wrong Tests 13
Total Cost $0.116
Response Time (avg) 9.98s
#170
Qwen3.8 27B
medium
Qwen
2
0.7
~$0.073 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7349 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.072660. 14/23 40.1s
Total Tests 23
Wrong Tests 9
Total Cost ~$0.073 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7349 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.072660.
Response Time (avg) 40.1s
#179
Qwen3.8 Flash Next
xhigh
Qwen
2
0.7
~$0.195 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 1.9676 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.194534. 14/23 102.7s
Total Tests 23
Wrong Tests 9
Total Cost ~$0.195 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 1.9676 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.194534.
Response Time (avg) 102.7s
#182
MiMo-V2.6-Flash
low
Xiaomi
2
0.7
$0.200 12/23 54.6s
Total Tests 23
Wrong Tests 11
Total Cost $0.200
Response Time (avg) 54.6s
#201
Kimi K2.6
medium
Moonshot AI
2
0.7
$1.594 12/23 121.3s
Total Tests 23
Wrong Tests 11
Total Cost $1.594
Response Time (avg) 121.3s
#203
Inkling
low
Thinkingmachines
2
0.7
$0.293 11/23 6.81s
Total Tests 23
Wrong Tests 12
Total Cost $0.293
Response Time (avg) 6.81s
#206
Space Bunny Alpha
max
Stealth
2
0.7
$0.000 11/23 36.2s
Total Tests 23
Wrong Tests 12
Total Cost $0.000
Response Time (avg) 36.2s
#211
Solar Pro 4
low
Upstage
2
0.7
$0.101 11/23 145.2s
Total Tests 23
Wrong Tests 12
Total Cost $0.101
Response Time (avg) 145.2s
#212
Grok 4.7
high
X AI
2
0.7
$3.037 13/23 122.2s
Total Tests 23
Wrong Tests 10
Total Cost $3.037
Response Time (avg) 122.2s