A test is fully passed only if every run passed for that test.No answer: 4Wrong answer: 3API error: 1Response Time (avg)115.74sResponse Time (max)775.64sResponse Time (total)2546.31s…
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)35.37sResponse Time (max)83.16sResponse Time (total)141.48s
Coding
: 5.3 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)414.53sResponse Time (max)775.64sResponse Time (total)1243.59s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)170.10sResponse Time (max)307.48sResponse Time (total)340.19s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.50sResponse Time (max)8.31sResponse Time (total)15.00s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.No answer: 2Wrong answer: 1Response Time (avg)190.55sResponse Time (max)240.86sResponse Time (total)571.65s
General Intelligence
: 4.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)26.32sResponse Time (max)26.32sResponse Time (total)26.32s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.31sResponse Time (max)27.10sResponse Time (total)34.62s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.50sResponse Time (max)30.41sResponse Time (total)61.50s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.36sResponse Time (max)5.36sResponse Time (total)5.36s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)106.61sResponse Time (max)106.61sResponse Time (total)106.61s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)45.78sResponse Time (max)81.20sResponse Time (total)91.57s
Coding
: 6.6 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)180.70sResponse Time (max)266.69sResponse Time (total)542.10s
Combined
: 6.9 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)175.85sResponse Time (max)304.85sResponse Time (total)351.70s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)46.91sResponse Time (max)46.91sResponse Time (total)46.91s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)55.99sResponse Time (max)55.99sResponse Time (total)55.99s
General Intelligence
: 4.7 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)79.86sResponse Time (max)79.86sResponse Time (total)79.86s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)31.93sResponse Time (max)31.93sResponse Time (total)31.93s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)32.50sResponse Time (max)49.12sResponse Time (total)65.01s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.54sResponse Time (max)7.54sResponse Time (total)7.54s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)103.81sResponse Time (max)103.81sResponse Time (total)103.81s
Anti-AI Tricks
: 9.1 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)2.33sResponse Time (max)3.89sResponse Time (total)9.30s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)4.09sResponse Time (max)4.34sResponse Time (total)12.27s
Combined
: 7.2 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)16.63sResponse Time (max)18.34sResponse Time (total)33.26s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.29sResponse Time (max)2.31sResponse Time (total)4.59s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)4.09sResponse Time (max)5.86sResponse Time (total)12.28s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.16sResponse Time (max)3.16sResponse Time (total)3.16s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.91sResponse Time (max)1.93sResponse Time (total)3.82s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)5.30sResponse Time (max)9.55sResponse Time (total)15.89s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.80sResponse Time (max)3.80sResponse Time (total)3.80s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.68sResponse Time (max)2.68sResponse Time (total)2.68s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.22sResponse Time (max)63.59sResponse Time (total)96.87s
Coding
: 5.9 A test is fully passed only if every run passed for that test.Did not follow instructions: 1No answer: 1Response Time (avg)160.52sResponse Time (max)311.89sResponse Time (total)481.57s
Combined
: 6.9 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)266.12sResponse Time (max)328.22sResponse Time (total)532.25s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.67sResponse Time (max)19.13sResponse Time (total)27.34s
Domain specific
: 4.1 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)301.08sResponse Time (max)532.28sResponse Time (total)903.25s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.45sResponse Time (max)15.77sResponse Time (total)22.90s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)65.54sResponse Time (max)156.63sResponse Time (total)196.61s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)32.93sResponse Time (max)32.93sResponse Time (total)32.93s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)347.95sResponse Time (max)347.95sResponse Time (total)347.95s
A test is fully passed only if every run passed for that test.Wrong answer: 5Timed out: 2Invalid tool call: 1Response Time (avg)65.67sResponse Time (max)519.30sResponse Time (total)1444.68s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.75sResponse Time (max)18.03sResponse Time (total)39.01s
Coding
: 6.0 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)114.48sResponse Time (max)168.16sResponse Time (total)343.44s
Combined
: 6.4 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)313.55sResponse Time (max)519.30sResponse Time (total)627.09s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.41sResponse Time (max)29.79sResponse Time (total)46.83s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)74.43sResponse Time (max)119.29sResponse Time (total)223.29s
General Intelligence
: 3.4 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)34.11sResponse Time (max)34.11sResponse Time (total)34.11s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.88sResponse Time (max)15.44sResponse Time (total)19.76s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.89sResponse Time (max)31.99sResponse Time (total)53.68s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.60sResponse Time (max)4.60sResponse Time (total)4.60s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)52.87sResponse Time (max)52.87sResponse Time (total)52.87s
A test is fully passed only if every run passed for that test.API error: 4Wrong answer: 4Response Time (avg)10.18sResponse Time (max)64.36sResponse Time (total)183.29s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.53sResponse Time (max)3.43sResponse Time (total)10.12s
Coding
: 8.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)34.69sResponse Time (max)64.36sResponse Time (total)104.06s
Combined
: 3.0 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)8.10sResponse Time (max)8.10sResponse Time (total)8.10s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)12.18sResponse Time (max)14.00sResponse Time (total)36.54s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.46sResponse Time (max)3.46sResponse Time (total)3.46s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.38sResponse Time (max)3.40sResponse Time (total)6.76s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.13sResponse Time (max)3.33sResponse Time (total)9.39s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.87sResponse Time (max)4.87sResponse Time (total)4.87s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.12sResponse Time (max)3.18sResponse Time (total)8.50s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.39sResponse Time (max)2.20sResponse Time (total)4.16s
Combined
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)160.63sResponse Time (max)309.35sResponse Time (total)321.26s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.00sResponse Time (max)3.74sResponse Time (total)5.99s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.10sResponse Time (max)3.51sResponse Time (total)6.29s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.49sResponse Time (max)1.66sResponse Time (total)2.99s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.69sResponse Time (max)1.89sResponse Time (total)5.08s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.54sResponse Time (max)9.54sResponse Time (total)9.54s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.35sResponse Time (max)1.35sResponse Time (total)1.35s
Anti-AI Tricks
: 7.3 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)2.76sResponse Time (max)4.92sResponse Time (total)11.02s
Coding
: 8.2 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)150.44sResponse Time (max)390.15sResponse Time (total)451.33s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)50.80sResponse Time (max)77.07sResponse Time (total)101.61s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.71sResponse Time (max)3.20sResponse Time (total)5.41s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.70sResponse Time (max)5.70sResponse Time (total)5.70s
Puzzle Solving
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)92.20sResponse Time (max)266.38sResponse Time (total)276.61s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.60sResponse Time (max)3.60sResponse Time (total)3.60s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)527.13sResponse Time (max)527.13sResponse Time (total)527.13s
Anti-AI Tricks
: 7.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)4.36sResponse Time (max)8.92sResponse Time (total)17.45s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.34sResponse Time (max)12.60sResponse Time (total)31.02s
Combined
: 6.6 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)29.45sResponse Time (max)39.63sResponse Time (total)58.89s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.22sResponse Time (max)3.93sResponse Time (total)6.45s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.12sResponse Time (max)4.12sResponse Time (total)4.12s
Puzzle Solving
: 8.3 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)6.60sResponse Time (max)11.77sResponse Time (total)19.81s
Tool Calling
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.98sResponse Time (max)5.98sResponse Time (total)5.98s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)8.17sResponse Time (max)8.17sResponse Time (total)8.17s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.01sResponse Time (max)33.19sResponse Time (total)52.06s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)105.91sResponse Time (max)159.45sResponse Time (total)317.72s
Combined
: 6.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1No answer: 1Response Time (avg)272.74sResponse Time (max)467.25sResponse Time (total)545.49s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)19.84sResponse Time (max)23.87sResponse Time (total)39.68s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)142.55sResponse Time (max)292.27sResponse Time (total)427.66s
General Intelligence
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.41sResponse Time (max)7.41sResponse Time (total)7.41s
Puzzle Solving
: 7.8 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)199.67sResponse Time (max)576.79sResponse Time (total)599.00s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.08sResponse Time (max)8.08sResponse Time (total)8.08s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)87.23sResponse Time (max)87.23sResponse Time (total)87.23s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.08sResponse Time (max)24.45sResponse Time (total)40.32s
Coding
: 7.3 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)163.31sResponse Time (max)438.65sResponse Time (total)489.94s
Combined
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)54.25sResponse Time (max)73.69sResponse Time (total)108.49s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.35sResponse Time (max)5.29sResponse Time (total)8.71s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)255.51sResponse Time (max)411.82sResponse Time (total)766.52s
General Intelligence
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.63sResponse Time (max)7.63sResponse Time (total)7.63s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.01sResponse Time (max)3.92sResponse Time (total)6.03s
Puzzle Solving
: 8.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)9.08sResponse Time (max)12.40sResponse Time (total)27.25s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.44sResponse Time (max)4.44sResponse Time (total)4.44s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)246.86sResponse Time (max)246.86sResponse Time (total)246.86s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.40sResponse Time (max)4.78sResponse Time (total)13.59s
Coding
: 8.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)9.82sResponse Time (max)13.35sResponse Time (total)29.45s
Combined
: 7.3 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)13.91sResponse Time (max)18.70sResponse Time (total)27.82s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.05sResponse Time (max)3.33sResponse Time (total)6.10s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2API error: 1Response Time (avg)23.67sResponse Time (max)38.52sResponse Time (total)47.34s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.51sResponse Time (max)6.55sResponse Time (total)11.02s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.10sResponse Time (max)5.04sResponse Time (total)12.31s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.68sResponse Time (max)4.68sResponse Time (total)4.68s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.89sResponse Time (max)6.89sResponse Time (total)6.89s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)9.65sResponse Time (max)35.08sResponse Time (total)38.62s
Coding
: 8.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)27.42sResponse Time (max)60.98sResponse Time (total)82.26s
Combined
: 7.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)80.94sResponse Time (max)152.83sResponse Time (total)161.89s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.75sResponse Time (max)3.35sResponse Time (total)5.49s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)27.26sResponse Time (max)34.06sResponse Time (total)81.77s
General Intelligence
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.85sResponse Time (max)6.85sResponse Time (total)6.85s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.83sResponse Time (max)2.21sResponse Time (total)3.65s
Puzzle Solving
: 5.7 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)6.19sResponse Time (max)12.51sResponse Time (total)18.56s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.16sResponse Time (max)4.16sResponse Time (total)4.16s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)113.98sResponse Time (max)113.98sResponse Time (total)113.98s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)17.99sResponse Time (max)48.33sResponse Time (total)71.98s
Coding
: 8.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)156.74sResponse Time (max)254.92sResponse Time (total)470.22s
Combined
: 6.4 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)58.52sResponse Time (max)79.36sResponse Time (total)117.04s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.07sResponse Time (max)12.19sResponse Time (total)18.14s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)84.35sResponse Time (max)168.71sResponse Time (total)253.05s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.26sResponse Time (max)9.02sResponse Time (total)14.52s
Puzzle Solving
: 9.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)10.23sResponse Time (max)11.54sResponse Time (total)30.68s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.38sResponse Time (max)12.38sResponse Time (total)12.38s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)48.32sResponse Time (max)48.32sResponse Time (total)48.32s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.21sResponse Time (max)15.82sResponse Time (total)40.82s
Coding
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)58.84sResponse Time (max)69.05sResponse Time (total)176.53s
Combined
: 6.9 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)231.97sResponse Time (max)431.47sResponse Time (total)463.94s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.10sResponse Time (max)26.73sResponse Time (total)40.19s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)34.43sResponse Time (max)56.51sResponse Time (total)103.29s
General Intelligence
: 5.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.73sResponse Time (max)10.73sResponse Time (total)10.73s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.41sResponse Time (max)10.36sResponse Time (total)18.82s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.72sResponse Time (max)5.72sResponse Time (total)5.72s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)17.70sResponse Time (max)17.70sResponse Time (total)17.70s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)39.56sResponse Time (max)120.09sResponse Time (total)158.26s
Coding
: 7.0 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)109.70sResponse Time (max)141.71sResponse Time (total)329.11s
Combined
: 7.3 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)99.12sResponse Time (max)173.03sResponse Time (total)198.23s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.88sResponse Time (max)30.28sResponse Time (total)49.75s
Domain specific
: 4.1 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)238.45sResponse Time (max)485.92sResponse Time (total)715.34s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.20sResponse Time (max)21.22sResponse Time (total)24.41s
Puzzle Solving
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.50sResponse Time (max)20.68sResponse Time (total)37.50s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)55.56sResponse Time (max)55.56sResponse Time (total)55.56s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.02sResponse Time (max)10.02sResponse Time (total)10.02s
Anti-AI Tricks
: 6.4 A test is fully passed only if every run passed for that test.Extra formatting: 2Response Time (avg)7.45sResponse Time (max)11.88sResponse Time (total)14.90s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)114.08sResponse Time (max)151.51sResponse Time (total)228.16s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.37sResponse Time (max)7.37sResponse Time (total)7.37s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.04sResponse Time (max)5.04sResponse Time (total)5.04s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.43sResponse Time (max)2.43sResponse Time (total)2.43s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.71sResponse Time (max)4.75sResponse Time (total)9.41s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.73sResponse Time (max)9.73sResponse Time (total)9.73s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)63.24sResponse Time (max)63.24sResponse Time (total)63.24s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)28.51sResponse Time (max)39.73sResponse Time (total)114.05s
Coding
: 7.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)50.60sResponse Time (max)62.48sResponse Time (total)151.79s
Combined
: 6.4 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)104.10sResponse Time (max)131.63sResponse Time (total)208.20s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)28.03sResponse Time (max)30.49sResponse Time (total)56.07s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)115.42sResponse Time (max)218.13sResponse Time (total)346.26s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.36sResponse Time (max)19.53sResponse Time (total)30.73s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)26.11sResponse Time (max)32.37sResponse Time (total)78.32s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)74.73sResponse Time (max)74.73sResponse Time (total)74.73s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)54.46sResponse Time (max)54.46sResponse Time (total)54.46s
A test is fully passed only if every run passed for that test.Wrong answer: 7API error: 1Invalid tool call: 1Response Time (avg)33.62sResponse Time (max)392.56sResponse Time (total)739.59s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.62sResponse Time (max)16.86sResponse Time (total)34.49s
Coding
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)26.53sResponse Time (max)31.91sResponse Time (total)79.58s
Combined
: 6.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)218.25sResponse Time (max)392.56sResponse Time (total)436.49s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.68sResponse Time (max)7.94sResponse Time (total)11.36s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)35.22sResponse Time (max)49.56sResponse Time (total)105.65s
General Intelligence
: 3.7 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)2.52sResponse Time (max)2.52sResponse Time (total)2.52s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.35sResponse Time (max)9.38sResponse Time (total)12.69s
Puzzle Solving
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.54sResponse Time (max)6.03sResponse Time (total)10.62s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.72sResponse Time (max)7.72sResponse Time (total)7.72s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)38.47sResponse Time (max)38.47sResponse Time (total)38.47s
A test is fully passed only if every run passed for that test.Wrong answer: 8Invalid tool call: 1Response Time (avg)5.45sResponse Time (max)19.85sResponse Time (total)119.83s…
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.36sResponse Time (max)3.09sResponse Time (total)9.46s
Coding
: 6.6 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)9.56sResponse Time (max)19.85sResponse Time (total)28.67s
Combined
: 8.7 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)9.68sResponse Time (max)14.29sResponse Time (total)19.36s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)919msResponse Time (max)931msResponse Time (total)1.84s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)9.34sResponse Time (max)11.03sResponse Time (total)28.02s
General Intelligence
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.52sResponse Time (max)3.52sResponse Time (total)3.52s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.48sResponse Time (max)1.80sResponse Time (total)2.96s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.46sResponse Time (max)8.85sResponse Time (total)13.37s
Tool Calling
: 4.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.69sResponse Time (max)6.69sResponse Time (total)6.69s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)5.95sResponse Time (max)5.95sResponse Time (total)5.95s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)27.98sResponse Time (max)54.59sResponse Time (total)111.90s
Coding
: 6.0 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)335.92sResponse Time (max)573.57sResponse Time (total)1007.77s
Combined
: 8.6 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)129.30sResponse Time (max)218.67sResponse Time (total)258.60s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.65sResponse Time (max)12.04sResponse Time (total)17.30s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)306.71sResponse Time (max)451.62sResponse Time (total)920.12s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)19.88sResponse Time (max)31.30sResponse Time (total)59.65s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.08sResponse Time (max)5.08sResponse Time (total)5.08s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)62.44sResponse Time (max)62.44sResponse Time (total)62.44s
Coding
: 5.6 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)10.52sResponse Time (max)11.72sResponse Time (total)31.55s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.07sResponse Time (max)18.19sResponse Time (total)30.14s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.21sResponse Time (max)2.52sResponse Time (total)4.42s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2API error: 1Response Time (avg)12.75sResponse Time (max)18.33sResponse Time (total)25.50s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.51sResponse Time (max)4.60sResponse Time (total)7.01s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.99sResponse Time (max)3.16sResponse Time (total)8.97s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.36sResponse Time (max)8.36sResponse Time (total)8.36s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.38sResponse Time (max)4.38sResponse Time (total)4.38s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)19.75sResponse Time (max)49.95sResponse Time (total)79.01s
Coding
: 6.2 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)160.69sResponse Time (max)234.36sResponse Time (total)482.07s
Combined
: 7.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)595.19sResponse Time (max)1026.43sResponse Time (total)1190.39s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)30.26sResponse Time (max)32.03sResponse Time (total)60.52s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)89.39sResponse Time (max)95.52sResponse Time (total)268.18s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)19.66sResponse Time (max)32.25sResponse Time (total)39.32s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)59.60sResponse Time (max)123.57sResponse Time (total)178.80s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.45sResponse Time (max)7.45sResponse Time (total)7.45s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)85.11sResponse Time (max)85.11sResponse Time (total)85.11s
A test is fully passed only if every run passed for that test.Wrong answer: 6Extra formatting: 3Response Time (avg)54.50sResponse Time (max)252.69sResponse Time (total)1199.07s…
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)7.43sResponse Time (max)10.89sResponse Time (total)29.72s
Coding
: 5.7 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)108.46sResponse Time (max)200.16sResponse Time (total)325.39s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)65.08sResponse Time (max)97.35sResponse Time (total)130.16s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.72sResponse Time (max)12.13sResponse Time (total)21.44s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Extra formatting: 1Response Time (avg)175.94sResponse Time (max)252.69sResponse Time (total)527.81s
General Intelligence
: 4.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)18.41sResponse Time (max)18.41sResponse Time (total)18.41s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.36sResponse Time (max)20.80sResponse Time (total)24.73s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)18.26sResponse Time (max)44.40sResponse Time (total)54.79s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.12sResponse Time (max)13.12sResponse Time (total)13.12s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)53.51sResponse Time (max)53.51sResponse Time (total)53.51s
A test is fully passed only if every run passed for that test.Wrong answer: 9Response Time (avg)7.43sResponse Time (max)29.85sResponse Time (total)163.54s…
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.52sResponse Time (max)3.90sResponse Time (total)10.08s
Coding
: 5.4 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)10.38sResponse Time (max)17.15sResponse Time (total)31.15s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.59sResponse Time (max)19.65sResponse Time (total)29.17s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.95sResponse Time (max)2.42sResponse Time (total)3.89s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)18.45sResponse Time (max)29.85sResponse Time (total)55.36s
General Intelligence
: 5.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.34sResponse Time (max)4.34sResponse Time (total)4.34s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.38sResponse Time (max)3.43sResponse Time (total)4.77s
Puzzle Solving
: 7.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.04sResponse Time (max)6.14sResponse Time (total)12.12s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.02sResponse Time (max)6.02sResponse Time (total)6.02s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.64sResponse Time (max)6.64sResponse Time (total)6.64s
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.