Data parsing and extraction: Wrong answer
Data parsing and extraction
Wrong answer
See which AI models are most likely to hit Wrong answer on Data parsing and extraction, so you can spot weak points faster. Sort by: Response Time (avg) ↑.
Failure Reasons
80/80
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #434 | Decider V1.1 27B default | Perplexity | 1 | 0.6 | $0.002 | 1/2 | 286ms |
| #438 | Jev 1.14 default | Typesafe | 1 | 0.7 | $0.003 | 1/2 | 335ms |
| #443 | D1 default | Liquid | 1 | 0.6 | $0.003 | 1/2 | 418ms |
| #441 | Decider Flash V1.2 default | Perplexity | 1 | 0.7 | $0.001 | 1/2 | 422ms |
| #433 | Decider V1.2 default | Perplexity | 1 | 0.6 | $0.001 | 1/2 | 482ms |
| #449 | Tev1 4B Experimental default | Togethercomputer | 2 | 0.3 | $0.002 | 0/2 | 509ms |
| #405 | Granite 4.1 8b default | IBM Granite | 2 | 0.3 | $0.007 | 0/2 | 575ms |
| #430 | d1-ultra default | Liquid | 1 | 0.7 | $0.003 | 1/2 | 587ms |
| #391 | Mercury 2 none | Inception | 1 | 0.7 | $0.033 | 1/2 | 667ms |
| #428 | Span-02 default | Respan | 1 | 0.7 | $0.001 | 1/2 | 710ms |
| #445 | LFM2-24B-A2B default | Liquid | 2 | 0.3 | $0.001 | 0/2 | 714ms |
| #450 | Nimble v3 9B default | Bespoke Labs | 2 | 0.3 | ~$0.001 | 0/2 | 880ms |
| #414 | Elephant Alpha medium | Openrouter | 1 | 0.6 | $0.000 | 1/2 | 979ms |
| #367 | Mercury 2.5 Preview default | Inception | 1 | 0.6 | $0.023 | 1/2 | 1.04s |
| #413 | Elephant Alpha default | Openrouter | 1 | 0.6 | $0.000 | 1/2 | 1.04s |