A test is fully passed only if every run passed for that test.No answer: 3Invalid tool call: 1Wrong answer: 1Response Time (avg)15.01sResponse Time (max)80.80sResponse Time (total)330.15s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.20sResponse Time (max)6.57sResponse Time (total)24.81s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.59sResponse Time (max)22.20sResponse Time (total)46.76s
Combined
: 6.5 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)27.47sResponse Time (max)33.70sResponse Time (total)54.94s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.18sResponse Time (max)7.44sResponse Time (total)14.35s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)37.32sResponse Time (max)80.80sResponse Time (total)111.95s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.42sResponse Time (max)7.42sResponse Time (total)7.42s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.90sResponse Time (max)5.96sResponse Time (total)11.79s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)5.18sResponse Time (max)5.58sResponse Time (total)15.53s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)16.96sResponse Time (max)16.96sResponse Time (total)16.96s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)25.64sResponse Time (max)25.64sResponse Time (total)25.64s
A test is fully passed only if every run passed for that test.Wrong answer: 2Extra formatting: 1No answer: 1Response Time (avg)22.51sResponse Time (max)159.01sResponse Time (total)495.12s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.91sResponse Time (max)10.95sResponse Time (total)23.66s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.73sResponse Time (max)15.75sResponse Time (total)38.19s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)31.11sResponse Time (max)42.48sResponse Time (total)62.21s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.22sResponse Time (max)4.27sResponse Time (total)8.43s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Extra formatting: 1Response Time (avg)104.24sResponse Time (max)159.01sResponse Time (total)312.73s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.79sResponse Time (max)3.79sResponse Time (total)3.79s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.78sResponse Time (max)4.91sResponse Time (total)9.56s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.66sResponse Time (max)5.51sResponse Time (total)13.97s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.44sResponse Time (max)8.44sResponse Time (total)8.44s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)14.14sResponse Time (max)14.14sResponse Time (total)14.14s
A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)13.59sResponse Time (max)40.17sResponse Time (total)298.90s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.90sResponse Time (max)6.70sResponse Time (total)23.59s
Coding
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)13.91sResponse Time (max)19.46sResponse Time (total)41.74s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)34.59sResponse Time (max)40.17sResponse Time (total)69.18s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.30sResponse Time (max)7.96sResponse Time (total)12.59s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)24.34sResponse Time (max)29.92sResponse Time (total)73.01s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.40sResponse Time (max)5.40sResponse Time (total)5.40s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.60sResponse Time (max)5.76sResponse Time (total)11.20s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.11sResponse Time (max)6.93sResponse Time (total)18.32s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.30sResponse Time (max)13.30sResponse Time (total)13.30s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)30.58sResponse Time (max)30.58sResponse Time (total)30.58s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.24sResponse Time (max)15.21sResponse Time (total)40.97s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)325.79sResponse Time (max)589.43sResponse Time (total)977.36s
Combined
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)223.03sResponse Time (max)223.03sResponse Time (total)223.03s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)16.72sResponse Time (max)18.73sResponse Time (total)33.44s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.No answer: 1Timed out: 1Response Time (avg)683.62sResponse Time (max)766.58sResponse Time (total)1367.25s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.91sResponse Time (max)14.91sResponse Time (total)14.91s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.66sResponse Time (max)7.99sResponse Time (total)15.33s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.36sResponse Time (max)12.30sResponse Time (total)22.07s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)19.67sResponse Time (max)19.67sResponse Time (total)19.67s
A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)18.65sResponse Time (max)254.93sResponse Time (total)410.28s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.25sResponse Time (max)4.01sResponse Time (total)13.02s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.86sResponse Time (max)6.97sResponse Time (total)17.59s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.38sResponse Time (max)35.76sResponse Time (total)48.76s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.32sResponse Time (max)2.45sResponse Time (total)4.64s
Domain specific
: 7.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)95.10sResponse Time (max)254.93sResponse Time (total)285.30s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.28sResponse Time (max)8.28sResponse Time (total)8.28s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.58sResponse Time (max)3.77sResponse Time (total)7.15s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.60sResponse Time (max)4.52sResponse Time (total)10.79s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.92sResponse Time (max)8.92sResponse Time (total)8.92s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.83sResponse Time (max)5.83sResponse Time (total)5.83s
A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)61.27sResponse Time (max)960.01sResponse Time (total)1347.96s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.87sResponse Time (max)8.14sResponse Time (total)19.46s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.64sResponse Time (max)23.54sResponse Time (total)43.92s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)64.02sResponse Time (max)96.57sResponse Time (total)128.04s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.78sResponse Time (max)4.82sResponse Time (total)9.56s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)356.37sResponse Time (max)960.01sResponse Time (total)1069.12s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.69sResponse Time (max)13.69sResponse Time (total)13.69s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.34sResponse Time (max)8.87sResponse Time (total)12.67s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.32sResponse Time (max)10.41sResponse Time (total)21.95s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.65sResponse Time (max)20.65sResponse Time (total)20.65s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.91sResponse Time (max)8.91sResponse Time (total)8.91s
A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)38.97sResponse Time (max)332.10sResponse Time (total)857.43s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.66sResponse Time (max)6.74sResponse Time (total)18.65s
Coding
: 8.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)59.77sResponse Time (max)130.26sResponse Time (total)179.30s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)33.52sResponse Time (max)47.74sResponse Time (total)67.03s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.18sResponse Time (max)4.35sResponse Time (total)8.36s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)168.16sResponse Time (max)332.10sResponse Time (total)504.49s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.16sResponse Time (max)4.16sResponse Time (total)4.16s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.36sResponse Time (max)3.46sResponse Time (total)6.73s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.76sResponse Time (max)10.54sResponse Time (total)20.28s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.57sResponse Time (max)10.57sResponse Time (total)10.57s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)37.86sResponse Time (max)37.86sResponse Time (total)37.86s
A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)28.44sResponse Time (max)381.11sResponse Time (total)625.68s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.71sResponse Time (max)5.18sResponse Time (total)14.85s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.27sResponse Time (max)11.08sResponse Time (total)24.81s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)41.20sResponse Time (max)63.24sResponse Time (total)82.41s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.34sResponse Time (max)3.64sResponse Time (total)6.69s
Domain specific
: 7.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)146.97sResponse Time (max)381.11sResponse Time (total)440.90s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.68sResponse Time (max)7.68sResponse Time (total)7.68s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.91sResponse Time (max)5.08sResponse Time (total)9.82s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.48sResponse Time (max)5.60sResponse Time (total)13.44s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.04sResponse Time (max)11.04sResponse Time (total)11.04s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.06sResponse Time (max)14.06sResponse Time (total)14.06s
Anti-AI Tricks
: 6.9 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)3.46sResponse Time (max)4.38sResponse Time (total)13.86s
Coding
: 3.3 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.11sResponse Time (max)27.11sResponse Time (total)27.11s
Combined
: 1.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.54sResponse Time (max)7.51sResponse Time (total)11.08s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.52sResponse Time (max)3.80sResponse Time (total)7.04s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.