#163
Grok 4.7
medium
X AI
2
0.7
$2.938 15/23 117.7s
Total Tests 23
Wrong Tests 8
Total Cost $2.938
Response Time (avg) 117.7s
#162
Claude Fable 5.1
medium
Anthropic
2
0.7
$3.197 15/23 11.9s
Total Tests 23
Wrong Tests 8
Total Cost $3.197
Response Time (avg) 11.9s
#161
GLM 5.3 Flash
high
Z.ai
1
0.7
$0.056 13/23 29.1s
Total Tests 23
Wrong Tests 10
Total Cost $0.056
Response Time (avg) 29.1s
#160
Gemma 4 26B A4B
medium
Google
2
0.7
$0.101 16/23 105.0s
Total Tests 23
Wrong Tests 7
Total Cost $0.101
Response Time (avg) 105.0s
#159
Inkling
medium
Thinkingmachines
1
0.7
$0.527 15/23 17.0s
Total Tests 23
Wrong Tests 8
Total Cost $0.527
Response Time (avg) 17.0s
#156
Grok 4.7
low
X AI
2
0.7
$1.933 14/23 63.2s
Total Tests 23
Wrong Tests 9
Total Cost $1.933
Response Time (avg) 63.2s
#153
DeepSeek V4 Flash 0731
low
DeepSeek
1
0.7
$0.306 13/23 88.1s
Total Tests 23
Wrong Tests 10
Total Cost $0.306
Response Time (avg) 88.1s
#150
Seed-2.0-Code
high
Bytedance Seed
1
0.7
$1.448 12/23 124.9s
Total Tests 23
Wrong Tests 11
Total Cost $1.448
Response Time (avg) 124.9s
#149
Mistral Large 4
high
Mistral
2
0.8
$1.391 12/23 263.7s
Total Tests 23
Wrong Tests 11
Total Cost $1.391
Response Time (avg) 263.7s
#148
Seed-2.0-Mini
medium
Bytedance Seed
1
0.8
$0.140 12/23 91.7s
Total Tests 23
Wrong Tests 11
Total Cost $0.140
Response Time (avg) 91.7s
#147
GLM 5.1
medium
Z.ai
1
0.8
$1.546 13/23 66.4s
Total Tests 23
Wrong Tests 10
Total Cost $1.546
Response Time (avg) 66.4s
#144
GPT-6 Luna
low
OpenAI
1
0.8
$0.033 12/23 23.2s
Total Tests 23
Wrong Tests 11
Total Cost $0.033
Response Time (avg) 23.2s
#145
Qwen3.8 27B
low
Qwen
2
0.8
~$0.089 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.8932 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.088310. 15/23 46.6s
Total Tests 23
Wrong Tests 8
Total Cost ~$0.089 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.8932 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.088310.
Response Time (avg) 46.6s
#143
Qwen3.8 Flash Next
medium
Qwen
1
0.8
~$0.047 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4752 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.046984. 15/23 24.8s
Total Tests 23
Wrong Tests 8
Total Cost ~$0.047 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4752 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.046984.
Response Time (avg) 24.8s
#141
Muse Glimmer 30B
medium
Meta
1
0.8
$0.288 12/23 34.0s
Total Tests 23
Wrong Tests 11
Total Cost $0.288
Response Time (avg) 34.0s