Decision model ranking
Last updated at: 2026-10-07
Models Evaluated: 7
5 tests. 60 decisions. Three repeats per model.
How decision models work (English) →
7/7
Filter models
No models match the current search and filters.
| Rank | Model | Score Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. | Company | Total Cost | Response Time (avg) Response Time (avg) | Correct decisions Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. |
|---|---|---|---|---|---|---|
| #1🥇 #1 | Solar Decidedefault15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. | 9.1… | Upstage | $0.008 … | 12.02s… | Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. Wrong answer: 17 Response Time (avg)12.02s Response Time (max)- Response Time (total)180.34s … |
Wrong answer: 17
|
||||||
| #2🥈 #2 | Jev 1.13default15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. | 9.0… | Typesafe | $0.002 … | 482ms… | Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. Wrong answer: 18 Response Time (avg)482ms Response Time (max)- Response Time (total)7.23s … |
Wrong answer: 18
|
||||||
| #3🥉 #3 | Decider V1.1 27Bdefault15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. | 8.8… | Perplexity | $0.003 … | 345ms… | Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. Wrong answer: 21 Response Time (avg)345ms Response Time (max)- Response Time (total)5.17s … |
Wrong answer: 21
|
||||||
| #4#4 | D1default15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. | 8.7… | Liquid | $0.005 … | 886ms… | Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. Wrong answer: 24 Response Time (avg)886ms Response Time (max)- Response Time (total)13.29s … |
Wrong answer: 24
|
||||||
| #5#5 | GPT-6 Luna Decisionsdefault15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. | 8.5… | OpenAI | $0.004 … | 665ms… | Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. Wrong answer: 27 Response Time (avg)665ms Response Time (max)- Response Time (total)9.97s … |
Wrong answer: 27
|
||||||
| #6#6 | Kev 4Bdefault15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. | 7.8… | Jaredpalmer | $0.001 … | 998ms… | Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. Wrong answer: 39 Response Time (avg)998ms Response Time (max)- Response Time (total)14.96s … |
Wrong answer: 39
|
||||||
| #7#7 | Tev1 4B Experimentaldefault15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. | 7.0… | Togethercomputer | $0.006 … | 885ms… | Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%. Wrong answer: 54 Response Time (avg)885ms Response Time (max)- Response Time (total)13.27s … |
Wrong answer: 54
|
||||||
Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%.
Cost covers all 15 requests. Time measures a whole request, including all its questions. Providers can process these questions differently. These results are separate from the general leaderboard.
Quick Compare
Solar Decidedefault15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%.vsJev 1.13default15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%.Jev 1.13default15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%.vsDecider V1.1 27Bdefault15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%.Decider V1.1 27Bdefault15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%.vsD1default15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%.D1default15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%.vsGPT-6 Luna Decisionsdefault15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%.GPT-6 Luna Decisionsdefault15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%.vsKev 4Bdefault15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%.Kev 4Bdefault15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%.vsTev1 4B Experimentaldefault15/15 attempts. Ranked by correct decisions; cost breaks ties. A perfect attempt needs all 12 answers correct. Missing coverage receives no rank. Partial credit applies: 3 of 12 correct answers gives 25%.