#85
Muse Glimmer 30B
xhigh
Meta
1
0.8
$0.585 14/23 97.7s
Total Tests 23
Wrong Tests 9
Total Cost $0.585
Response Time (avg) 97.7s
#104
Seed-2.0-Lite
medium
Bytedance Seed
2
0.8
$0.271 14/23 48.9s
Total Tests 23
Wrong Tests 9
Total Cost $0.271
Response Time (avg) 48.9s
#105
Seed-2.0-Code
low
Bytedance Seed
1
0.8
$0.881 14/23 73.0s
Total Tests 23
Wrong Tests 9
Total Cost $0.881
Response Time (avg) 73.0s
#108
DeepSeek V4 Flash 0423
high
DeepSeek
2
0.8
$0.261 14/23 56.0s
Total Tests 23
Wrong Tests 9
Total Cost $0.261
Response Time (avg) 56.0s
#116
Qwen3.5-27B
medium
Qwen
2
0.8
$1.135 14/23 114.7s
Total Tests 23
Wrong Tests 9
Total Cost $1.135
Response Time (avg) 114.7s
#128
GLM 5.3
high
Z.ai
1
0.8
$0.495 14/23 28.4s
Total Tests 23
Wrong Tests 9
Total Cost $0.495
Response Time (avg) 28.4s
#137
Nemotron 3.5 Super VL
medium
NVIDIA
1
0.8
$0.437 14/23 84.9s
Total Tests 23
Wrong Tests 9
Total Cost $0.437
Response Time (avg) 84.9s
#156
Grok 4.7
low
X AI
1
0.7
$1.933 14/23 63.2s
Total Tests 23
Wrong Tests 9
Total Cost $1.933
Response Time (avg) 63.2s
#157
Inkling Small
high
Thinkingmachines
2
0.7
$0.398 14/23 29.1s
Total Tests 23
Wrong Tests 9
Total Cost $0.398
Response Time (avg) 29.1s
#167
Gemini 3.5 Flash Lite
medium
Google
1
0.7
$0.440 14/23 8.68s
Total Tests 23
Wrong Tests 9
Total Cost $0.440
Response Time (avg) 8.68s
#170
Qwen3.8 27B
medium
Qwen
2
0.7
~$0.073 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7349 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.072660. 14/23 40.1s
Total Tests 23
Wrong Tests 9
Total Cost ~$0.073 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7349 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.072660.
Response Time (avg) 40.1s
#179
Qwen3.8 Flash Next
xhigh
Qwen
2
0.7
~$0.195 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 1.9676 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.194534. 14/23 102.7s
Total Tests 23
Wrong Tests 9
Total Cost ~$0.195 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 1.9676 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.194534.
Response Time (avg) 102.7s
#186
Gemini 3.1 Flash Lite Preview
medium
Google
1
0.7
$0.158 14/23 6.78s
Total Tests 23
Wrong Tests 9
Total Cost $0.158
Response Time (avg) 6.78s
#255
Gemini 3.1 Flash Lite Preview
low
Google
1
0.6
$0.736 14/23 19.0s
Total Tests 23
Wrong Tests 9
Total Cost $0.736
Response Time (avg) 19.0s
#261
Claude Opus 4.6
medium
Anthropic
1
0.6
$2.961 13/22 32.2s
Total Tests 22
Wrong Tests 9
Total Cost $2.961
Response Time (avg) 32.2s