#116
Qwen3.5-27B
medium
Qwen
2
0.8
$1.135 14/23 114.7s
Total Tests 23
Wrong Tests 9
Total Cost $1.135
Response Time (avg) 114.7s
#128
GLM 5.3
high
Z.ai
1
0.8
$0.495 14/23 28.4s
Total Tests 23
Wrong Tests 9
Total Cost $0.495
Response Time (avg) 28.4s
#137
Nemotron 3.5 Super VL
medium
NVIDIA
1
0.8
$0.437 14/23 84.9s
Total Tests 23
Wrong Tests 9
Total Cost $0.437
Response Time (avg) 84.9s
#156
Grok 4.7
low
X AI
1
0.7
$1.933 14/23 63.2s
Total Tests 23
Wrong Tests 9
Total Cost $1.933
Response Time (avg) 63.2s
#157
Inkling Small
high
Thinkingmachines
2
0.7
$0.398 14/23 29.1s
Total Tests 23
Wrong Tests 9
Total Cost $0.398
Response Time (avg) 29.1s
#167
Gemini 3.5 Flash Lite
medium
Google
1
0.7
$0.440 14/23 8.68s
Total Tests 23
Wrong Tests 9
Total Cost $0.440
Response Time (avg) 8.68s
#170
Qwen3.8 27B
medium
Qwen
2
0.7
~$0.073 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7349 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.072660. 14/23 40.1s
Total Tests 23
Wrong Tests 9
Total Cost ~$0.073 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7349 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.072660.
Response Time (avg) 40.1s
#179
Qwen3.8 Flash Next
xhigh
Qwen
2
0.7
~$0.195 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 1.9676 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.194534. 14/23 102.7s
Total Tests 23
Wrong Tests 9
Total Cost ~$0.195 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 1.9676 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.194534.
Response Time (avg) 102.7s
#186
Gemini 3.1 Flash Lite Preview
medium
Google
1
0.7
$0.158 14/23 6.78s
Total Tests 23
Wrong Tests 9
Total Cost $0.158
Response Time (avg) 6.78s
#255
Gemini 3.1 Flash Lite Preview
low
Google
1
0.6
$0.736 14/23 19.0s
Total Tests 23
Wrong Tests 9
Total Cost $0.736
Response Time (avg) 19.0s
#55
Muse Spark 1.2
high
Meta
3
0.9
$2.018 15/23 28.1s
Total Tests 23
Wrong Tests 8
Total Cost $2.018
Response Time (avg) 28.1s
#56
Muse Spark 1.2
medium
Meta
3
0.9
$1.590 15/23 21.3s
Total Tests 23
Wrong Tests 8
Total Cost $1.590
Response Time (avg) 21.3s
#59
Pareto 26.9
default
Unbiased
1
0.9
$1.864 15/23 28.3s
Total Tests 23
Wrong Tests 8
Total Cost $1.864
Response Time (avg) 28.3s
#62
Muse Spark Open
medium
Meta
2
0.9
$1.260 15/23 77.4s
Total Tests 23
Wrong Tests 8
Total Cost $1.260
Response Time (avg) 77.4s
#66
GPT-5.2
medium
OpenAI
3
0.9
$1.558 15/23 31.3s
Total Tests 23
Wrong Tests 8
Total Cost $1.558
Response Time (avg) 31.3s