#440
Clef Omni
default
Cloudflare
1
0.2
$0.011 2/12 880ms
Total Tests 12
Wrong Tests 10
Total Cost $0.011
Response Time (avg) 880ms
#442
Step 3.5 Flash
none
Stepfun
1
0.2
$0.020 6/12 39.0s
Total Tests 12
Wrong Tests 6
Total Cost $0.020
Response Time (avg) 39.0s
#445
LFM2-24B-A2B
default
Liquid
1
0.2
$0.001 2/16 782ms
Total Tests 16
Wrong Tests 14
Total Cost $0.001
Response Time (avg) 782ms
#450
Nimble v3 9B
default
Bespoke Labs
1
0.8
~$0.001 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.0021 h × 0.377 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.000263. 1/7 363ms
Total Tests 7
Wrong Tests 6
Total Cost ~$0.001 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.0021 h × 0.377 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.000263.
Response Time (avg) 363ms
#34
Claude Sonnet 5.5
max
Anthropic
2
0.9
$8.557 18/23 84.3s
Total Tests 23
Wrong Tests 5
Total Cost $8.557
Response Time (avg) 84.3s
#38
GPT-5.3-Codex
medium
OpenAI
2
0.9
$1.318 17/23 18.9s
Total Tests 23
Wrong Tests 6
Total Cost $1.318
Response Time (avg) 18.9s
#40
Muse Spark 1.3
high
Meta
2
0.9
$1.891 17/23 52.9s
Total Tests 23
Wrong Tests 6
Total Cost $1.891
Response Time (avg) 52.9s
#54
Muse Spark Open
low
Meta
2
0.9
$0.600 16/23 21.6s
Total Tests 23
Wrong Tests 7
Total Cost $0.600
Response Time (avg) 21.6s
#57
Muse Spark 1.1
medium
Meta
2
0.9
$1.665 16/23 27.0s
Total Tests 23
Wrong Tests 7
Total Cost $1.665
Response Time (avg) 27.0s
#61
GPT-5.4
medium
OpenAI
2
0.9
$2.213 16/23 24.8s
Total Tests 23
Wrong Tests 7
Total Cost $2.213
Response Time (avg) 24.8s
#62
Muse Spark Open
medium
Meta
2
0.9
$1.260 15/23 77.4s
Total Tests 23
Wrong Tests 8
Total Cost $1.260
Response Time (avg) 77.4s
#67
Qwen3.8 27B
high
Qwen
2
0.9
~$0.298 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 3.0102 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.297613. 17/23 166.3s
Total Tests 23
Wrong Tests 6
Total Cost ~$0.298 Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 3.0102 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.297613.
Response Time (avg) 166.3s
#75
Claude Haiku 5.5
low
Anthropic
2
0.9
$0.061 16/23 7.51s
Total Tests 23
Wrong Tests 7
Total Cost $0.061
Response Time (avg) 7.51s
#82
Nemotron 3.5 Super VL
high
NVIDIA
2
0.8
$0.349 15/23 49.9s
Total Tests 23
Wrong Tests 8
Total Cost $0.349
Response Time (avg) 49.9s
#88
Muse Spark 1.1
high
Meta
2
0.8
$2.570 13/23 37.4s
Total Tests 23
Wrong Tests 10
Total Cost $2.570
Response Time (avg) 37.4s