#39
LiquidAI: LFM2-24B-A2B
Liquid · liquid/lfm-2-24b-a2b::none
Avg Score
2.43
Cost per result
0.045
Consistency
8.91
Total Cost
$0.001
Tests Correct
1/14
A test is fully passed only if every run passed for that test.
Wrong Tests
13
Attempt pass rate: 16.7%
Flaky tests
2
Response time: avg 851ms · total 11.07s · max 2.88s
Wrong answer: 8
API error: 3
Did not follow instructions: 2
Top Models by Score
Choose the first model, then click a second model to open a side-by-side page.
Category Breakdown
| Category | Avg Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 1.00 | 9.82 | 0/3 |
| Data parsing and extraction | 1.00 | 10.00 | 0/2 |
| Domain specific | 4.00 | 7.21 | 1/3 |
| Instructions following | 3.00 | 10.00 | 0/2 |
| Puzzle Solving | 3.34 | 7.89 | 0/3 |
| Tool Calling | 1.00 | 10.00 | 0/1 |