#178
MiMo-V2.5
medium
Xiaomi
2
6.4
$0.104 11/22 46.3s
Total Tests 22
Wrong Tests 11
Total Cost $0.104
Response Time (avg) 46.3s
#254
Granite 4.2 8B
medium
IBM Granite
1
5.2
$0.009 7/22 46.0s
Total Tests 22
Wrong Tests 15
Total Cost $0.009
Response Time (avg) 46.0s
#131
Grok 4.3
medium
X AI
1
7.0
$0.741 12/22 44.2s
Total Tests 22
Wrong Tests 10
Total Cost $0.741
Response Time (avg) 44.2s
#264
MiniMax M2.7
medium
Minimax
2
5.0
$0.208 5/22 43.2s
Total Tests 22
Wrong Tests 17
Total Cost $0.208
Response Time (avg) 43.2s
#209
Mimo V2 Omni
medium
Xiaomi
2
5.9
$0.683 10/21 41.2s
Total Tests 21
Wrong Tests 11
Total Cost $0.683
Response Time (avg) 41.2s
#74
Qwen3.8 27B
low
Qwen
2
7.9
~$0.071 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7171 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.070898. 15/22 39.1s
Total Tests 22
Wrong Tests 7
Total Cost ~$0.071 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.7171 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.070898.
Response Time (avg) 39.1s
#2
Gemini 3.8 Flash
high
Google
1
9.9
$1.595 21/22 37.2s
Total Tests 22
Wrong Tests 1
Total Cost $1.595
Response Time (avg) 37.2s
#65
Muse Spark 1.1
high
Meta
1
8.0
$2.253 12/22 36.9s
Total Tests 22
Wrong Tests 10
Total Cost $2.253
Response Time (avg) 36.9s
#85
GLM 5
medium
Z.ai
1
7.7
$0.228 15/21 33.5s
Total Tests 21
Wrong Tests 6
Total Cost $0.228
Response Time (avg) 33.5s
#81
Qwen3.8 27B
medium
Qwen
1
7.8
~$0.058 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.5784 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.057183. 14/22 33.0s
Total Tests 22
Wrong Tests 8
Total Cost ~$0.058 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.5784 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.057183.
Response Time (avg) 33.0s
#126
Muse Glimmer 30B
medium
Meta
1
7.2
$0.211 11/22 30.6s
Total Tests 22
Wrong Tests 11
Total Cost $0.211
Response Time (avg) 30.6s
#52
GPT-5.2
medium
OpenAI
1
8.4
$1.182 14/22 28.5s
Total Tests 22
Wrong Tests 8
Total Cost $1.182
Response Time (avg) 28.5s
#62
GPT-5 Mini
medium
OpenAI
1
8.1
$0.241 12/22 27.6s
Total Tests 22
Wrong Tests 10
Total Cost $0.241
Response Time (avg) 27.6s
#116
GLM 5.3 Flash
high
Z.ai
1
7.3
$0.029 13/22 25.4s
Total Tests 22
Wrong Tests 9
Total Cost $0.029
Response Time (avg) 25.4s
#283
Grok 4.1 Fast
medium
X AI
1
4.7
$0.069 9/19 23.8s
Total Tests 19
Wrong Tests 10
Total Cost $0.069
Response Time (avg) 23.8s