#173
Gemini 3.1 Flash Lite Preview
none
Google
1
6.4
$0.052 12/22 1.56s
Total Tests 22
Wrong Tests 10
Total Cost $0.052
Response Time (avg) 1.56s
#239
Laguna S 2.1
medium
Poolside
2
5.4
$0.053 4/22 58.4s
Total Tests 22
Wrong Tests 18
Total Cost $0.053
Response Time (avg) 58.4s
#81
Qwen3.8 27B
medium
Qwen
1
7.8
~$0.058 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.5784 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.057183. 14/22 33.0s
Total Tests 22
Wrong Tests 8
Total Cost ~$0.058 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.5784 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.057183.
Response Time (avg) 33.0s
#39
GLM 5.3 Flash
max
Z.ai
1
8.7
$0.059 16/22 52.1s
Total Tests 22
Wrong Tests 6
Total Cost $0.059
Response Time (avg) 52.1s
#309
Qwen3.5-9B
medium
Qwen
3
3.8
$0.062 3/22 107.5s
Total Tests 22
Wrong Tests 19
Total Cost $0.062
Response Time (avg) 107.5s
#183
Seed-2.0-Lite
none
Bytedance Seed
1
6.2
$0.066 8/22 4.37s
Total Tests 22
Wrong Tests 14
Total Cost $0.066
Response Time (avg) 4.37s
#119
DeepSeek V4 Flash 0731
medium
DeepSeek
3
7.3
$0.066 11/22 84.7s
Total Tests 22
Wrong Tests 11
Total Cost $0.066
Response Time (avg) 84.7s
#171
Laguna XS 2.1
medium
Poolside
2
6.5
$0.068 9/22 48.2s
Total Tests 22
Wrong Tests 13
Total Cost $0.068
Response Time (avg) 48.2s
#242
MiMo-V2.5-Pro
none
Xiaomi
1
5.4
$0.068 5/22 4.24s
Total Tests 22
Wrong Tests 17
Total Cost $0.068
Response Time (avg) 4.24s
#283
Grok 4.1 Fast
medium
X AI
1
4.7
$0.069 9/19 23.8s
Total Tests 19
Wrong Tests 10
Total Cost $0.069
Response Time (avg) 23.8s
#74
Qwen3.8 27B
low
Qwen
2
7.9
~$0.071 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7171 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.070898. 15/22 39.1s
Total Tests 22
Wrong Tests 7
Total Cost ~$0.071 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7171 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.070898.
Response Time (avg) 39.1s
#287
Granite 4.2 8B
high
IBM Granite
1
4.6
$0.084 4/22 235.9s
Total Tests 22
Wrong Tests 18
Total Cost $0.084
Response Time (avg) 235.9s
#67
DeepSeek V4 Flash 0731
high
DeepSeek
1
8.0
$0.084 14/22 114.9s
Total Tests 22
Wrong Tests 8
Total Cost $0.084
Response Time (avg) 114.9s
#153
Gemini 3 Flash Preview
none
Google
1
6.8
$0.085 13/22 2.82s
Total Tests 22
Wrong Tests 9
Total Cost $0.085
Response Time (avg) 2.82s
#213
Seed 2.1 Turbo
none
Bytedance Seed
1
5.9
$0.092 10/22 6.84s
Total Tests 22
Wrong Tests 12
Total Cost $0.092
Response Time (avg) 6.84s