#130
Grok 4.6
medium
X AI
1
0.8
$2.270 16/23 74.8s
Total Tests 23
Wrong Tests 7
Total Cost $2.270
Response Time (avg) 74.8s
#131
Qwen3.7 Plus
none
Qwen
1
0.8
$0.178 13/23 17.8s
Total Tests 23
Wrong Tests 10
Total Cost $0.178
Response Time (avg) 17.8s
#135
GPT-6 Luna
high
OpenAI
1
0.8
$0.074 15/23 20.4s
Total Tests 23
Wrong Tests 8
Total Cost $0.074
Response Time (avg) 20.4s
#136
Muse Glimmer 30B
high
Meta
3
0.8
$0.506 11/23 69.9s
Total Tests 23
Wrong Tests 12
Total Cost $0.506
Response Time (avg) 69.9s
#137
Nemotron 3.5 Super VL
medium
NVIDIA
1
0.8
$0.437 14/23 84.9s
Total Tests 23
Wrong Tests 9
Total Cost $0.437
Response Time (avg) 84.9s
#138
Claude Haiku 5.5
medium
Anthropic
2
0.8
$0.063 13/23 7.71s
Total Tests 23
Wrong Tests 10
Total Cost $0.063
Response Time (avg) 7.71s
#140
Qwen3.7 Flash
low
Qwen
3
0.8
$0.071 12/23 41.0s
Total Tests 23
Wrong Tests 11
Total Cost $0.071
Response Time (avg) 41.0s
#141
Muse Glimmer 30B
medium
Meta
1
0.8
$0.288 12/23 34.0s
Total Tests 23
Wrong Tests 11
Total Cost $0.288
Response Time (avg) 34.0s
#450
Nimble v3 9B
default
Bespoke Labs
1
0.8
~$0.001 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.0021 h × 0.377 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.000263. 1/7 363ms
Total Tests 7
Wrong Tests 6
Total Cost ~$0.001 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.0021 h × 0.377 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.000263.
Response Time (avg) 363ms
#143
Qwen3.8 Flash Next
medium
Qwen
1
0.8
~$0.047 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4752 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.046984. 15/23 24.8s
Total Tests 23
Wrong Tests 8
Total Cost ~$0.047 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4752 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.046984.
Response Time (avg) 24.8s
#144
GPT-6 Luna
low
OpenAI
1
0.8
$0.033 12/23 23.2s
Total Tests 23
Wrong Tests 11
Total Cost $0.033
Response Time (avg) 23.2s
#145
Qwen3.8 27B
low
Qwen
1
0.8
~$0.089 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.8932 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.088310. 15/23 46.6s
Total Tests 23
Wrong Tests 8
Total Cost ~$0.089 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.8932 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.088310.
Response Time (avg) 46.6s
#148
Seed-2.0-Mini
medium
Bytedance Seed
1
0.8
$0.140 12/23 91.7s
Total Tests 23
Wrong Tests 11
Total Cost $0.140
Response Time (avg) 91.7s
#149
Mistral Large 4
high
Mistral
2
0.8
$1.391 12/23 263.7s
Total Tests 23
Wrong Tests 11
Total Cost $1.391
Response Time (avg) 263.7s
#150
Seed-2.0-Code
high
Bytedance Seed
1
0.7
$1.448 12/23 124.9s
Total Tests 23
Wrong Tests 11
Total Cost $1.448
Response Time (avg) 124.9s