#452
Solar Decide
default
Upstage
5
0.1
$0.009 2/7 6.01s
Total Tests 7
Wrong Tests 5
Total Cost $0.009
Response Time (avg) 6.01s
#454
Nimble v3 9B
default
Bespoke Labs
5
0.8
~$0.001 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.0021 h × 0.377 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.000263. 1/7 363ms
Total Tests 7
Wrong Tests 6
Total Cost ~$0.001 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.0021 h × 0.377 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.000263.
Response Time (avg) 363ms
#59
Pareto 26.9
default
Unbiased
6
0.9
$1.864 15/23 28.3s
Total Tests 23
Wrong Tests 8
Total Cost $1.864
Response Time (avg) 28.3s
#73
DeepSeek V4.1 Flash
max
DeepSeek
6
0.9
$1.204 15/23 61.6s
Total Tests 23
Wrong Tests 8
Total Cost $1.204
Response Time (avg) 61.6s
#100
Qwen3.7 Plus
medium
Qwen
6
0.8
$0.415 16/23 59.7s
Total Tests 23
Wrong Tests 7
Total Cost $0.415
Response Time (avg) 59.7s
#106
Seed-2.0-Lite
medium
Bytedance Seed
6
0.8
$0.271 14/23 48.9s
Total Tests 23
Wrong Tests 9
Total Cost $0.271
Response Time (avg) 48.9s
#111
DeepSeek V4 Flash 0423
high
DeepSeek
6
0.8
$0.261 14/23 56.0s
Total Tests 23
Wrong Tests 9
Total Cost $0.261
Response Time (avg) 56.0s
#117
Qwen3.8 Flash Next
low
Qwen
6
0.8
~$0.045 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4535 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.044834. 15/23 23.7s
Total Tests 23
Wrong Tests 8
Total Cost ~$0.045 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4535 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.044834.
Response Time (avg) 23.7s
#122
GPT-5.4 Mini
medium
OpenAI
6
0.8
$1.102 13/23 29.9s
Total Tests 23
Wrong Tests 10
Total Cost $1.102
Response Time (avg) 29.9s
#126
MiMo-V2.6-Flash
medium
Xiaomi
6
0.8
$0.218 12/23 61.9s
Total Tests 23
Wrong Tests 11
Total Cost $0.218
Response Time (avg) 61.9s
#130
Grok 4.5
medium
X AI
6
0.8
$2.996 17/23 68.4s
Total Tests 23
Wrong Tests 6
Total Cost $2.996
Response Time (avg) 68.4s
#131
GLM 5.3
high
Z.ai
6
0.8
$0.495 14/23 28.4s
Total Tests 23
Wrong Tests 9
Total Cost $0.495
Response Time (avg) 28.4s
#132
Step 3.7 Flash
medium
Stepfun
6
0.8
$0.571 13/23 26.6s
Total Tests 23
Wrong Tests 10
Total Cost $0.571
Response Time (avg) 26.6s
#133
Grok 4.6
medium
X AI
6
0.8
$2.270 16/23 74.8s
Total Tests 23
Wrong Tests 7
Total Cost $2.270
Response Time (avg) 74.8s
#138
GPT-6 Luna
high
OpenAI
6
0.8
$0.074 15/23 20.4s
Total Tests 23
Wrong Tests 8
Total Cost $0.074
Response Time (avg) 20.4s