A test is fully passed only if every run passed for that test.Wrong answer: 4Invalid tool call: 1Response Time (avg)27.34sResponse Time (max)126.60sResponse Time (total)628.75s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)115.27sResponse Time (max)115.27sResponse Time (total)115.27s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.17sResponse Time (max)6.30sResponse Time (total)16.69s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)41.35sResponse Time (max)74.36sResponse Time (total)124.04s
Combined
: 8.7 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)91.25sResponse Time (max)126.60sResponse Time (total)182.50s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.72sResponse Time (max)9.59sResponse Time (total)17.44s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)41.77sResponse Time (max)49.58sResponse Time (total)125.30s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.41sResponse Time (max)6.41sResponse Time (total)6.41s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.49sResponse Time (max)4.45sResponse Time (total)6.98s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.93sResponse Time (max)6.68sResponse Time (total)14.79s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.83sResponse Time (max)7.83sResponse Time (total)7.83s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)11.49sResponse Time (max)11.49sResponse Time (total)11.49s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)46.67sResponse Time (max)46.67sResponse Time (total)46.67s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.02sResponse Time (max)3.82sResponse Time (total)8.08s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.01sResponse Time (max)49.86sResponse Time (total)81.03s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)18.73sResponse Time (max)30.18sResponse Time (total)37.45s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.71sResponse Time (max)1.78sResponse Time (total)3.43s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)174.63sResponse Time (max)443.63sResponse Time (total)523.89s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.25sResponse Time (max)2.25sResponse Time (total)2.25s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.25sResponse Time (max)1.30sResponse Time (total)2.51s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.92sResponse Time (max)1.92sResponse Time (total)1.92s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)33.79sResponse Time (max)33.79sResponse Time (total)33.79s
A test is fully passed only if every run passed for that test.Wrong answer: 4Did not follow instructions: 2Response Time (avg)18.87sResponse Time (max)100.93sResponse Time (total)433.94s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)61.91sResponse Time (max)61.91sResponse Time (total)61.91s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.16sResponse Time (max)6.68sResponse Time (total)16.63s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)19.50sResponse Time (max)27.96sResponse Time (total)58.49s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)26.04sResponse Time (max)32.53sResponse Time (total)52.08s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.07sResponse Time (max)3.59sResponse Time (total)6.15s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)63.93sResponse Time (max)100.93sResponse Time (total)191.78s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.04sResponse Time (max)3.44sResponse Time (total)6.07s
Puzzle Solving
: 9.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)5.05sResponse Time (max)8.73sResponse Time (total)15.15s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.37sResponse Time (max)6.37sResponse Time (total)6.37s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)14.43sResponse Time (max)14.43sResponse Time (total)14.43s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)62.72sResponse Time (max)62.72sResponse Time (total)62.72s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.88sResponse Time (max)3.40sResponse Time (total)11.53s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.13sResponse Time (max)19.82sResponse Time (total)39.38s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)38.95sResponse Time (max)55.34sResponse Time (total)77.89s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.65sResponse Time (max)3.86sResponse Time (total)7.30s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)47.83sResponse Time (max)92.74sResponse Time (total)143.50s
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)9.80sResponse Time (max)9.80sResponse Time (total)9.80s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.34sResponse Time (max)3.64sResponse Time (total)6.68s
Puzzle Solving
: 7.6 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)3.80sResponse Time (max)5.83sResponse Time (total)11.40s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.42sResponse Time (max)6.42sResponse Time (total)6.42s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)4.79sResponse Time (max)4.79sResponse Time (total)4.79s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)61.28sResponse Time (max)61.28sResponse Time (total)61.28s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.71sResponse Time (max)7.10sResponse Time (total)22.85s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)51.66sResponse Time (max)60.27sResponse Time (total)154.98s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)55.55sResponse Time (max)80.16sResponse Time (total)111.10s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.01sResponse Time (max)7.41sResponse Time (total)14.02s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)174.56sResponse Time (max)251.53sResponse Time (total)523.68s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.49sResponse Time (max)9.49sResponse Time (total)9.49s
Puzzle Solving
: 8.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)38.42sResponse Time (max)100.24sResponse Time (total)115.25s
Tool Calling
: 9.6 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)33.95sResponse Time (max)33.95sResponse Time (total)33.95s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)140.05sResponse Time (max)140.05sResponse Time (total)140.05s
A test is fully passed only if every run passed for that test.Wrong answer: 3Invalid tool call: 1Response Time (avg)33.47sResponse Time (max)143.33sResponse Time (total)769.84s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)76.54sResponse Time (max)76.54sResponse Time (total)76.54s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.39sResponse Time (max)6.78sResponse Time (total)25.58s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)50.12sResponse Time (max)71.69sResponse Time (total)150.35s
Combined
: 7.2 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)53.54sResponse Time (max)97.74sResponse Time (total)107.07s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.57sResponse Time (max)2.78sResponse Time (total)5.15s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)98.85sResponse Time (max)143.33sResponse Time (total)296.55s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.63sResponse Time (max)8.63sResponse Time (total)8.63s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.95sResponse Time (max)7.27sResponse Time (total)9.91s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)18.24sResponse Time (max)23.48sResponse Time (total)54.71s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.29sResponse Time (max)3.29sResponse Time (total)3.29s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)32.07sResponse Time (max)32.07sResponse Time (total)32.07s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)94.84sResponse Time (max)94.84sResponse Time (total)94.84s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)47.01sResponse Time (max)84.42sResponse Time (total)188.05s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)336.02sResponse Time (max)436.54sResponse Time (total)1008.06s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)408.85sResponse Time (max)441.41sResponse Time (total)817.69s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)33.70sResponse Time (max)50.78sResponse Time (total)67.39s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)506.22sResponse Time (max)584.71sResponse Time (total)1518.67s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.66sResponse Time (max)9.33sResponse Time (total)15.32s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.26sResponse Time (max)49.35sResponse Time (total)81.77s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)25.97sResponse Time (max)25.97sResponse Time (total)25.97s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)78.58sResponse Time (max)78.58sResponse Time (total)78.58s
A test is fully passed only if every run passed for that test.Wrong answer: 3Invalid tool call: 1Response Time (avg)7.85sResponse Time (max)53.74sResponse Time (total)180.45s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)53.74sResponse Time (max)53.74sResponse Time (total)53.74s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.52sResponse Time (max)5.40sResponse Time (total)10.08s
Coding
: 7.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.71sResponse Time (max)9.05sResponse Time (total)20.13s
Combined
: 8.2 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)29.99sResponse Time (max)53.55sResponse Time (total)59.98s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.81sResponse Time (max)2.32sResponse Time (total)3.63s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)4.89sResponse Time (max)6.40sResponse Time (total)14.68s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.27sResponse Time (max)2.27sResponse Time (total)2.27s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.86sResponse Time (max)2.10sResponse Time (total)3.73s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.35sResponse Time (max)3.25sResponse Time (total)7.06s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.27sResponse Time (max)3.27sResponse Time (total)3.27s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.88sResponse Time (max)1.88sResponse Time (total)1.88s
A test is fully passed only if every run passed for that test.Wrong answer: 5Response Time (avg)30.42sResponse Time (max)168.09sResponse Time (total)699.68s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)127.50sResponse Time (max)127.50sResponse Time (total)127.50s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.03sResponse Time (max)8.44sResponse Time (total)20.13s
Coding
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)45.74sResponse Time (max)71.38sResponse Time (total)137.23s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)94.38sResponse Time (max)168.09sResponse Time (total)188.77s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.54sResponse Time (max)11.98sResponse Time (total)21.08s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)49.45sResponse Time (max)72.93sResponse Time (total)148.35s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.56sResponse Time (max)7.56sResponse Time (total)7.56s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.24sResponse Time (max)4.90sResponse Time (total)8.48s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.89sResponse Time (max)7.13sResponse Time (total)17.66s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.93sResponse Time (max)5.93sResponse Time (total)5.93s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)17.01sResponse Time (max)17.01sResponse Time (total)17.01s
A test is fully passed only if every run passed for that test.Wrong answer: 4Invalid tool call: 1Response Time (avg)39.83sResponse Time (max)219.77sResponse Time (total)916.20s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)67.61sResponse Time (max)67.61sResponse Time (total)67.61s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.83sResponse Time (max)8.75sResponse Time (total)23.33s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)41.14sResponse Time (max)51.03sResponse Time (total)123.42s
Combined
: 7.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)34.71sResponse Time (max)50.45sResponse Time (total)69.41s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.75sResponse Time (max)12.36sResponse Time (total)17.50s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)132.33sResponse Time (max)219.77sResponse Time (total)397.00s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.95sResponse Time (max)7.95sResponse Time (total)7.95s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.49sResponse Time (max)11.42sResponse Time (total)20.99s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)25.03sResponse Time (max)61.30sResponse Time (total)75.09s
Tool Calling
: 9.6 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)28.30sResponse Time (max)28.30sResponse Time (total)28.30s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)85.61sResponse Time (max)85.61sResponse Time (total)85.61s
A test is fully passed only if every run passed for that test.Wrong answer: 5Response Time (avg)11.92sResponse Time (max)53.09sResponse Time (total)274.14s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)53.09sResponse Time (max)53.09sResponse Time (total)53.09s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.96sResponse Time (max)5.00sResponse Time (total)11.83s
Coding
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)16.58sResponse Time (max)28.69sResponse Time (total)49.74s
Combined
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.90sResponse Time (max)34.63sResponse Time (total)55.80s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.17sResponse Time (max)3.27sResponse Time (total)6.35s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)23.14sResponse Time (max)36.22sResponse Time (total)69.43s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.10sResponse Time (max)3.10sResponse Time (total)3.10s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.16sResponse Time (max)2.17sResponse Time (total)4.31s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.09sResponse Time (max)2.91sResponse Time (total)6.26s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.55sResponse Time (max)4.55sResponse Time (total)4.55s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)9.68sResponse Time (max)9.68sResponse Time (total)9.68s
A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)6.63sResponse Time (max)62.49sResponse Time (total)152.50s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)62.49sResponse Time (max)62.49sResponse Time (total)62.49s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.29sResponse Time (max)2.70sResponse Time (total)9.17s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.86sResponse Time (max)8.35sResponse Time (total)14.59s
Combined
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)15.06sResponse Time (max)22.25sResponse Time (total)30.12s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.39sResponse Time (max)2.57sResponse Time (total)4.77s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)2.44sResponse Time (max)3.71sResponse Time (total)7.33s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.40sResponse Time (max)2.40sResponse Time (total)2.40s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.71sResponse Time (max)2.99sResponse Time (total)5.42s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.10sResponse Time (max)2.19sResponse Time (total)6.29s
Tool Calling
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.01sResponse Time (max)8.01sResponse Time (total)8.01s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.91sResponse Time (max)1.91sResponse Time (total)1.91s
A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)9.87sResponse Time (max)73.15sResponse Time (total)226.95s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)73.15sResponse Time (max)73.15sResponse Time (total)73.15s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.32sResponse Time (max)6.83sResponse Time (total)17.28s
Coding
: 7.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.70sResponse Time (max)7.45sResponse Time (total)20.10s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)21.05sResponse Time (max)30.67sResponse Time (total)42.11s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.69sResponse Time (max)3.85sResponse Time (total)7.38s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)8.91sResponse Time (max)12.08sResponse Time (total)26.73s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.76sResponse Time (max)3.76sResponse Time (total)3.76s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.13sResponse Time (max)4.27sResponse Time (total)8.26s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.23sResponse Time (max)5.55sResponse Time (total)12.69s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.03sResponse Time (max)9.03sResponse Time (total)9.03s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.48sResponse Time (max)6.48sResponse Time (total)6.48s
A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)6.82sResponse Time (max)48.53sResponse Time (total)156.81s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)48.53sResponse Time (max)48.53sResponse Time (total)48.53s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.85sResponse Time (max)2.14sResponse Time (total)7.39s
Coding
: 7.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.95sResponse Time (max)7.71sResponse Time (total)20.84s
Combined
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)19.82sResponse Time (max)30.83sResponse Time (total)39.64s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.66sResponse Time (max)1.71sResponse Time (total)3.33s
Domain specific
: 7.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.65sResponse Time (max)5.23sResponse Time (total)13.95s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.02sResponse Time (max)3.02sResponse Time (total)3.02s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.82sResponse Time (max)3.06sResponse Time (total)5.64s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.38sResponse Time (max)2.65sResponse Time (total)7.15s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.40sResponse Time (max)4.40sResponse Time (total)4.40s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.94sResponse Time (max)2.94sResponse Time (total)2.94s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)96.73sResponse Time (max)96.73sResponse Time (total)96.73s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.15sResponse Time (max)8.80sResponse Time (total)16.58s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)43.37sResponse Time (max)50.63sResponse Time (total)130.12s
Combined
: 7.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)138.66sResponse Time (max)224.68sResponse Time (total)277.31s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.10sResponse Time (max)6.18sResponse Time (total)12.19s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 2Extra formatting: 1Response Time (avg)203.29sResponse Time (max)333.47sResponse Time (total)609.88s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.02sResponse Time (max)10.02sResponse Time (total)10.02s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.65sResponse Time (max)3.72sResponse Time (total)7.31s
Puzzle Solving
: 8.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)5.61sResponse Time (max)7.20sResponse Time (total)16.82s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)19.24sResponse Time (max)19.24sResponse Time (total)19.24s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)46.77sResponse Time (max)46.77sResponse Time (total)46.77s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)56.74sResponse Time (max)56.74sResponse Time (total)56.74s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.49sResponse Time (max)20.83sResponse Time (total)52.46s
Combined
: 8.5 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)24.89sResponse Time (max)34.10sResponse Time (total)49.78s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.42sResponse Time (max)7.81sResponse Time (total)12.83s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)77.22sResponse Time (max)142.49sResponse Time (total)231.67s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.40sResponse Time (max)5.65sResponse Time (total)8.79s
Puzzle Solving
: 8.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)9.45sResponse Time (max)18.47sResponse Time (total)28.34s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.89sResponse Time (max)3.89sResponse Time (total)3.89s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)12.79sResponse Time (max)12.79sResponse Time (total)12.79s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)43.91sResponse Time (max)43.91sResponse Time (total)43.91s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.72sResponse Time (max)13.09sResponse Time (total)22.87s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.66sResponse Time (max)19.49sResponse Time (total)46.98s
Combined
: 8.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)42.62sResponse Time (max)58.91sResponse Time (total)85.24s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.96sResponse Time (max)5.75sResponse Time (total)9.92s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)80.83sResponse Time (max)165.38sResponse Time (total)242.50s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.41sResponse Time (max)4.41sResponse Time (total)4.41s
Puzzle Solving
: 7.9 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)42.49sResponse Time (max)111.97sResponse Time (total)127.48s
Tool Calling
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.99sResponse Time (max)6.99sResponse Time (total)6.99s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)18.45sResponse Time (max)18.45sResponse Time (total)18.45s
A test is fully passed only if every run passed for that test.No answer: 3Invalid tool call: 1Wrong answer: 1Response Time (avg)16.84sResponse Time (max)80.80sResponse Time (total)387.26s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)57.11sResponse Time (max)57.11sResponse Time (total)57.11s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.20sResponse Time (max)6.57sResponse Time (total)24.81s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.59sResponse Time (max)22.20sResponse Time (total)46.76s
Combined
: 6.5 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)27.47sResponse Time (max)33.70sResponse Time (total)54.94s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.18sResponse Time (max)7.44sResponse Time (total)14.35s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)37.32sResponse Time (max)80.80sResponse Time (total)111.95s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.42sResponse Time (max)7.42sResponse Time (total)7.42s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.90sResponse Time (max)5.96sResponse Time (total)11.79s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)5.18sResponse Time (max)5.58sResponse Time (total)15.53s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)16.96sResponse Time (max)16.96sResponse Time (total)16.96s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)25.64sResponse Time (max)25.64sResponse Time (total)25.64s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)54.17sResponse Time (max)54.17sResponse Time (total)54.17s
Anti-AI Tricks
: 7.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)6.44sResponse Time (max)11.13sResponse Time (total)25.75s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)49.15sResponse Time (max)73.90sResponse Time (total)147.45s
Combined
: 8.2 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)81.38sResponse Time (max)151.76sResponse Time (total)162.76s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.63sResponse Time (max)2.69sResponse Time (total)5.25s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)60.97sResponse Time (max)111.23sResponse Time (total)182.92s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.82sResponse Time (max)5.25sResponse Time (total)7.64s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)8.40sResponse Time (max)13.85sResponse Time (total)25.21s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.63sResponse Time (max)3.63sResponse Time (total)3.63s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)28.57sResponse Time (max)28.57sResponse Time (total)28.57s
A test is fully passed only if every run passed for that test.Wrong answer: 5Did not follow instructions: 1Response Time (avg)25.09sResponse Time (max)155.75sResponse Time (total)577.14s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)96.77sResponse Time (max)96.77sResponse Time (total)96.77s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.93sResponse Time (max)6.37sResponse Time (total)15.72s
Coding
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)28.69sResponse Time (max)45.84sResponse Time (total)86.06s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)98.19sResponse Time (max)155.75sResponse Time (total)196.37s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.87sResponse Time (max)8.07sResponse Time (total)15.75s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)40.12sResponse Time (max)51.38sResponse Time (total)120.35s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.01sResponse Time (max)4.69sResponse Time (total)8.03s
Puzzle Solving
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.11sResponse Time (max)5.18sResponse Time (total)12.32s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.06sResponse Time (max)8.06sResponse Time (total)8.06s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)12.43sResponse Time (max)12.43sResponse Time (total)12.43s
A test is fully passed only if every run passed for that test.Wrong answer: 5Did not follow instructions: 2Response Time (avg)24.81sResponse Time (max)100.41sResponse Time (total)570.60s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)67.82sResponse Time (max)67.82sResponse Time (total)67.82s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.11sResponse Time (max)6.42sResponse Time (total)16.42s
Coding
: 8.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)44.36sResponse Time (max)96.94sResponse Time (total)133.08s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)29.77sResponse Time (max)38.97sResponse Time (total)59.55s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.32sResponse Time (max)5.40sResponse Time (total)10.64s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)72.44sResponse Time (max)100.41sResponse Time (total)217.32s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.11sResponse Time (max)3.68sResponse Time (total)6.22s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)9.14sResponse Time (max)18.14sResponse Time (total)27.41s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.28sResponse Time (max)13.28sResponse Time (total)13.28s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)13.95sResponse Time (max)13.95sResponse Time (total)13.95s
A test is fully passed only if every run passed for that test.Wrong answer: 4Did not follow instructions: 3Response Time (avg)11.81sResponse Time (max)56.77sResponse Time (total)271.60s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)56.77sResponse Time (max)56.77sResponse Time (total)56.77s
Anti-AI Tricks
: 9.2 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)3.26sResponse Time (max)4.96sResponse Time (total)13.03s
Coding
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.09sResponse Time (max)13.60sResponse Time (total)30.28s
Combined
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.03sResponse Time (max)19.52sResponse Time (total)34.06s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.22sResponse Time (max)5.57sResponse Time (total)8.44s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)28.53sResponse Time (max)47.80sResponse Time (total)85.59s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.95sResponse Time (max)3.69sResponse Time (total)5.89s
Puzzle Solving
: 8.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)5.17sResponse Time (max)7.82sResponse Time (total)15.52s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.58sResponse Time (max)3.58sResponse Time (total)3.58s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.00sResponse Time (max)10.00sResponse Time (total)10.00s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)75.85sResponse Time (max)75.85sResponse Time (total)75.85s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)22.73sResponse Time (max)31.19sResponse Time (total)68.20s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)58.50sResponse Time (max)102.93sResponse Time (total)116.99s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.15sResponse Time (max)3.15sResponse Time (total)3.15s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)97.33sResponse Time (max)116.86sResponse Time (total)194.65s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.12sResponse Time (max)3.12sResponse Time (total)3.12s
Puzzle Solving
: 7.5 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)5.80sResponse Time (max)6.45sResponse Time (total)11.61s
Tool Calling
: 4.7 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)10.30sResponse Time (max)10.30sResponse Time (total)10.30s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)28.18sResponse Time (max)28.18sResponse Time (total)28.18s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)90.94sResponse Time (max)90.94sResponse Time (total)90.94s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)28.25sResponse Time (max)38.70sResponse Time (total)113.00s
Coding
: 8.2 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)354.87sResponse Time (max)449.66sResponse Time (total)1064.62s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)400.28sResponse Time (max)406.56sResponse Time (total)800.55s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)37.82sResponse Time (max)50.79sResponse Time (total)75.65s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)656.04sResponse Time (max)885.33sResponse Time (total)1968.13s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.48sResponse Time (max)9.84sResponse Time (total)14.96s
Puzzle Solving
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)21.01sResponse Time (max)31.49sResponse Time (total)63.03s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.46sResponse Time (max)27.46sResponse Time (total)27.46s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)91.00sResponse Time (max)91.00sResponse Time (total)91.00s
A test is fully passed only if every run passed for that test.Wrong answer: 5Response Time (avg)8.72sResponse Time (max)48.43sResponse Time (total)200.61s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)48.43sResponse Time (max)48.43sResponse Time (total)48.43s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.43sResponse Time (max)3.18sResponse Time (total)9.74s
Coding
: 6.2 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)8.74sResponse Time (max)16.82sResponse Time (total)26.23s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.13sResponse Time (max)9.76sResponse Time (total)16.26s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.63sResponse Time (max)14.86sResponse Time (total)27.26s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)11.45sResponse Time (max)16.44sResponse Time (total)34.36s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.91sResponse Time (max)17.91sResponse Time (total)17.91s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.37sResponse Time (max)2.57sResponse Time (total)4.75s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.66sResponse Time (max)3.06sResponse Time (total)7.97s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.03sResponse Time (max)4.03sResponse Time (total)4.03s
Trivia
: 4.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.67sResponse Time (max)3.67sResponse Time (total)3.67s
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.