#43
Muse Spark 1.1
medium
Meta
2
8.6
$1.420 15/22 26.2s
Total Tests 22
Wrong Tests 7
Total Cost $1.420
Response Time (avg) 26.2s
#47
GPT-5.4
medium
OpenAI
2
8.5
$1.560 15/22 22.9s
Total Tests 22
Wrong Tests 7
Total Cost $1.560
Response Time (avg) 22.9s
#53
Qwen3.8 27B
high
Qwen
2
8.4
~$0.287 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 2.8999 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.286715. 16/22 167.9s
Total Tests 22
Wrong Tests 6
Total Cost ~$0.287 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 2.8999 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.286715.
Response Time (avg) 167.9s
#55
Inkling Small
high
Thinkingmachines
2
8.4
$0.398 14/22 30.4s
Total Tests 22
Wrong Tests 8
Total Cost $0.398
Response Time (avg) 30.4s
#65
Muse Spark 1.1
high
Meta
2
8.0
$2.253 12/22 36.9s
Total Tests 22
Wrong Tests 10
Total Cost $2.253
Response Time (avg) 36.9s
#67
DeepSeek V4 Flash 0731
high
DeepSeek
2
8.0
$0.084 14/22 114.9s
Total Tests 22
Wrong Tests 8
Total Cost $0.084
Response Time (avg) 114.9s
#81
Qwen3.8 27B
medium
Qwen
2
7.8
~$0.058 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.5784 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.057183. 14/22 33.0s
Total Tests 22
Wrong Tests 8
Total Cost ~$0.058 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.5784 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.057183.
Response Time (avg) 33.0s
#82
Seed-2.0-Lite
medium
Bytedance Seed
2
7.8
$0.236 13/22 47.9s
Total Tests 22
Wrong Tests 9
Total Cost $0.236
Response Time (avg) 47.9s
#88
DeepSeek V4 Pro
high
DeepSeek
2
7.7
$0.476 10/22 92.5s
Total Tests 22
Wrong Tests 12
Total Cost $0.476
Response Time (avg) 92.5s
#89
DeepSeek V4 Flash 0423
high
DeepSeek
2
7.6
$0.042 13/22 51.8s
Total Tests 22
Wrong Tests 9
Total Cost $0.042
Response Time (avg) 51.8s
#95
GPT-5.4 Nano
medium
OpenAI
2
7.5
$0.142 12/22 13.3s
Total Tests 22
Wrong Tests 10
Total Cost $0.142
Response Time (avg) 13.3s
#97
MiniMax M3
medium
Minimax
2
7.5
$0.300 11/22 75.2s
Total Tests 22
Wrong Tests 11
Total Cost $0.300
Response Time (avg) 75.2s
#98
GPT 5.3 Chat
none
OpenAI
2
7.5
$0.533 13/22 6.56s
Total Tests 22
Wrong Tests 9
Total Cost $0.533
Response Time (avg) 6.56s
#100
Qwen3.5-27B
medium
Qwen
2
7.5
$0.982 13/22 113.3s
Total Tests 22
Wrong Tests 9
Total Cost $0.982
Response Time (avg) 113.3s
#110
Qwen3.8 2.4T A95B
high
Qwen
2
7.4
$2.357 14/22 120.6s
Total Tests 22
Wrong Tests 8
Total Cost $2.357
Response Time (avg) 120.6s