#271
Gemini 3.1 Flash Lite Preview
none
Google
1
0.6
$0.090 12/23 3.60s
Total Tests 23
Wrong Tests 11
Total Cost $0.090
Response Time (avg) 3.60s
#145
Qwen3.8 27B
low
Qwen
2
0.8
~$0.089 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.8932 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.088310. 15/23 46.6s
Total Tests 23
Wrong Tests 8
Total Cost ~$0.089 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.8932 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.088310.
Response Time (avg) 46.6s
#53
GLM 5.3 Flash
max
Z.ai
1
0.9
$0.089 17/23 54.0s
Total Tests 23
Wrong Tests 6
Total Cost $0.089
Response Time (avg) 54.0s
#92
Claude Haiku 5.5
high
Anthropic
1
0.8
$0.088 15/23 10.4s
Total Tests 23
Wrong Tests 8
Total Cost $0.088
Response Time (avg) 10.4s
#237
Laguna XS 2.1
medium
Poolside
2
0.6
$0.083 9/23 49.0s
Total Tests 23
Wrong Tests 14
Total Cost $0.083
Response Time (avg) 49.0s
#315
Nemotron 3 Super
medium
NVIDIA
1
0.6
$0.081 8/23 56.4s
Total Tests 23
Wrong Tests 15
Total Cost $0.081
Response Time (avg) 56.4s
#288
Gemini 3.1 Flash Lite
minimal
Google
1
0.6
$0.080 10/23 3.95s
Total Tests 23
Wrong Tests 13
Total Cost $0.080
Response Time (avg) 3.95s
#258
Solar Pro 4
high
Upstage
1
0.6
$0.077 11/23 128.9s
Total Tests 23
Wrong Tests 12
Total Cost $0.077
Response Time (avg) 128.9s
#170
Qwen3.8 27B
medium
Qwen
1
0.7
~$0.073 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7349 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.072660. 14/23 40.1s
Total Tests 23
Wrong Tests 9
Total Cost ~$0.073 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7349 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.072660.
Response Time (avg) 40.1s
#372
Qwen3 Coder Next
medium
Qwen
1
0.5
$0.071 3/23 17.0s
Total Tests 23
Wrong Tests 20
Total Cost $0.071
Response Time (avg) 17.0s
#290
Gemini 3.1 Flash Lite
none
Google
1
0.6
$0.069 9/23 3.58s
Total Tests 23
Wrong Tests 14
Total Cost $0.069
Response Time (avg) 3.58s
#402
Grok 4.1 Fast
medium
X AI
1
0.4
$0.069 9/19 23.8s
Total Tests 19
Wrong Tests 10
Total Cost $0.069
Response Time (avg) 23.8s
#374
GPT-5.4 Nano
none
OpenAI
1
0.5
$0.068 4/23 4.42s
Total Tests 23
Wrong Tests 19
Total Cost $0.068
Response Time (avg) 4.42s
#207
Solar Pro 4
xhigh
Upstage
2
0.7
$0.067 12/23 142.8s
Total Tests 23
Wrong Tests 11
Total Cost $0.067
Response Time (avg) 142.8s
#357
Qwen3 Coder Next
default
Qwen
1
0.5
$0.067 5/23 19.7s
Total Tests 23
Wrong Tests 18
Total Cost $0.067
Response Time (avg) 19.7s