Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)51.53sResponse Time (max)51.53sResponse Time (total)51.53s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.69sResponse Time (max)5.27sResponse Time (total)14.74s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.85sResponse Time (max)11.12sResponse Time (total)29.55s
Combined
: 8.2 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)24.57sResponse Time (max)25.71sResponse Time (total)49.15s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)3.86sResponse Time (max)6.13sResponse Time (total)7.72s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)17.52sResponse Time (max)20.97sResponse Time (total)52.55s
General Intelligence
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.93sResponse Time (max)6.93sResponse Time (total)6.93s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.13sResponse Time (max)5.35sResponse Time (total)10.26s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.54sResponse Time (max)4.64sResponse Time (total)10.63s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.22sResponse Time (max)5.22sResponse Time (total)5.22s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)9.93sResponse Time (max)9.93sResponse Time (total)9.93s
Agentic
: 5.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)79.61sResponse Time (max)79.61sResponse Time (total)79.61s
Anti-AI Tricks
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)4.33sResponse Time (max)9.08sResponse Time (total)17.30s
Coding
: 5.9 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)5.54sResponse Time (max)8.42sResponse Time (total)16.63s
Combined
: 8.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)30.54sResponse Time (max)47.72sResponse Time (total)61.09s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.88sResponse Time (max)4.06sResponse Time (total)7.75s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)11.10sResponse Time (max)26.91sResponse Time (total)33.31s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.70sResponse Time (max)3.70sResponse Time (total)3.70s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.81sResponse Time (max)2.98sResponse Time (total)5.62s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)3.66sResponse Time (max)4.75sResponse Time (total)10.98s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.89sResponse Time (max)7.89sResponse Time (total)7.89s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)4.08sResponse Time (max)4.08sResponse Time (total)4.08s
Agentic
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)75.76sResponse Time (max)75.76sResponse Time (total)75.76s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.28sResponse Time (max)2.09sResponse Time (total)5.13s
Coding
: 3.7 A test is fully passed only if every run passed for that test.Wrong answer: 2Timed out: 1Response Time (avg)4.16sResponse Time (max)7.07sResponse Time (total)12.48s
Combined
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)37.23sResponse Time (max)43.93sResponse Time (total)74.46s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.70sResponse Time (max)2.21sResponse Time (total)3.41s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)2.10sResponse Time (max)4.23sResponse Time (total)6.31s
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)690msResponse Time (max)878msResponse Time (total)1.38s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)57.10sResponse Time (max)57.10sResponse Time (total)57.10s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)778msResponse Time (max)778msResponse Time (total)778ms
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)52.61sResponse Time (max)52.61sResponse Time (total)52.61s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.70sResponse Time (max)3.88sResponse Time (total)10.81s
Coding
: 6.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)9.54sResponse Time (max)12.73sResponse Time (total)28.63s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)30.00sResponse Time (max)37.55sResponse Time (total)59.99s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.77sResponse Time (max)4.30sResponse Time (total)7.53s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.89sResponse Time (max)4.89sResponse Time (total)4.89s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.19sResponse Time (max)3.21sResponse Time (total)6.38s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.34sResponse Time (max)5.34sResponse Time (total)5.34s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)4.49sResponse Time (max)4.49sResponse Time (total)4.49s
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)4.75sResponse Time (max)7.62sResponse Time (total)19.00s
Coding
: 1.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 2.3 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)30.53sResponse Time (max)30.53sResponse Time (total)30.53s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.16sResponse Time (max)26.55sResponse Time (total)46.33s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.18sResponse Time (max)4.46sResponse Time (total)8.36s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.33sResponse Time (max)17.33sResponse Time (total)17.33s
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Agentic
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)1.08sResponse Time (max)1.08sResponse Time (total)1.08s
Anti-AI Tricks
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.50sResponse Time (max)5.89sResponse Time (total)13.99s
Coding
: 3.5 A test is fully passed only if every run passed for that test.Extra formatting: 2Wrong answer: 1Response Time (avg)11.06sResponse Time (max)14.01sResponse Time (total)33.18s
Combined
: 6.4 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)55.86sResponse Time (max)86.23sResponse Time (total)111.72s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.82sResponse Time (max)3.26sResponse Time (total)5.64s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Extra formatting: 2API error: 1Response Time (avg)8.91sResponse Time (max)13.68sResponse Time (total)26.72s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.64sResponse Time (max)2.19sResponse Time (total)3.28s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.47sResponse Time (max)4.47sResponse Time (total)4.47s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)19.98sResponse Time (max)19.98sResponse Time (total)19.98s
Agentic
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)32msResponse Time (max)32msResponse Time (total)32ms
Coding
: 5.3 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)11.21sResponse Time (max)11.21sResponse Time (total)11.21s
Combined
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 2Response Time (avg)35.69sResponse Time (max)36.03sResponse Time (total)71.38s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)8.48sResponse Time (max)12.71sResponse Time (total)16.96s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)5.20sResponse Time (max)7.65sResponse Time (total)15.60s
General Intelligence
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.45sResponse Time (max)1.45sResponse Time (total)1.45s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.52sResponse Time (max)8.19sResponse Time (total)11.04s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)18.80sResponse Time (max)18.80sResponse Time (total)18.80s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.06sResponse Time (max)1.06sResponse Time (total)1.06s
A test is fully passed only if every run passed for that test.Wrong answer: 11Did not follow instructions: 2Response Time (avg)9.98sResponse Time (max)124.53sResponse Time (total)229.52s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)124.53sResponse Time (max)124.53sResponse Time (total)124.53s
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)788msResponse Time (max)1.34sResponse Time (total)3.15s
Coding
: 5.8 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.80sResponse Time (max)2.51sResponse Time (total)5.40s
Combined
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)39.43sResponse Time (max)69.46sResponse Time (total)78.86s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.43sResponse Time (max)1.45sResponse Time (total)2.86s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)634msResponse Time (max)784msResponse Time (total)1.90s
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.03sResponse Time (max)1.40sResponse Time (total)2.06s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.54sResponse Time (max)3.54sResponse Time (total)3.54s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)599msResponse Time (max)599msResponse Time (total)599ms
A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)9.90sResponse Time (max)73.48sResponse Time (total)227.67s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)49.96sResponse Time (max)49.96sResponse Time (total)49.96s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.57sResponse Time (max)3.17sResponse Time (total)10.30s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.95sResponse Time (max)6.12sResponse Time (total)14.85s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.91sResponse Time (max)19.10sResponse Time (total)27.82s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.95sResponse Time (max)1.98sResponse Time (total)3.90s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)30.55sResponse Time (max)73.48sResponse Time (total)91.66s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.13sResponse Time (max)4.13sResponse Time (total)4.13s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.86sResponse Time (max)3.03sResponse Time (total)5.73s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.54sResponse Time (max)3.19sResponse Time (total)7.62s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.72sResponse Time (max)5.72sResponse Time (total)5.72s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)5.98sResponse Time (max)5.98sResponse Time (total)5.98s
Agentic
: 3.9 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)124.23sResponse Time (max)124.23sResponse Time (total)124.23s
Anti-AI Tricks
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)2.19sResponse Time (max)6.85sResponse Time (total)8.74s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.24sResponse Time (max)5.52sResponse Time (total)9.72s
Combined
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)28.86sResponse Time (max)55.36sResponse Time (total)57.72s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)1.01sResponse Time (max)1.18sResponse Time (total)2.03s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.24sResponse Time (max)2.23sResponse Time (total)3.71s
General Intelligence
: 4.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.86sResponse Time (max)6.86sResponse Time (total)6.86s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)751msResponse Time (max)821msResponse Time (total)1.50s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.43sResponse Time (max)2.43sResponse Time (total)2.43s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.89sResponse Time (max)3.89sResponse Time (total)3.89s
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Coding
: 5.6 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)36.89sResponse Time (max)47.10sResponse Time (total)110.66s
Combined
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)21.74sResponse Time (max)21.74sResponse Time (total)21.74s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.60sResponse Time (max)3.92sResponse Time (total)7.19s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.00sResponse Time (max)4.69sResponse Time (total)8.99s
Instructions following
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.63sResponse Time (max)2.77sResponse Time (total)5.27s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)22.78sResponse Time (max)22.78sResponse Time (total)22.78s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.50sResponse Time (max)2.50sResponse Time (total)2.50s
A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)9.87sResponse Time (max)73.15sResponse Time (total)226.95s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)73.15sResponse Time (max)73.15sResponse Time (total)73.15s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.32sResponse Time (max)6.83sResponse Time (total)17.28s
Coding
: 7.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.70sResponse Time (max)7.45sResponse Time (total)20.10s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)21.05sResponse Time (max)30.67sResponse Time (total)42.11s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.69sResponse Time (max)3.85sResponse Time (total)7.38s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)8.91sResponse Time (max)12.08sResponse Time (total)26.73s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.76sResponse Time (max)3.76sResponse Time (total)3.76s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.13sResponse Time (max)4.27sResponse Time (total)8.26s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.23sResponse Time (max)5.55sResponse Time (total)12.69s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.03sResponse Time (max)9.03sResponse Time (total)9.03s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.48sResponse Time (max)6.48sResponse Time (total)6.48s
A test is fully passed only if every run passed for that test.Wrong answer: 3Did not follow instructions: 1Response Time (avg)9.75sResponse Time (max)31.36sResponse Time (total)175.48s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.16sResponse Time (max)3.44sResponse Time (total)12.65s
Coding
: 3.3 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)31.36sResponse Time (max)31.36sResponse Time (total)31.36s
Combined
: 5.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.93sResponse Time (max)20.93sResponse Time (total)20.93s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.01sResponse Time (max)4.27sResponse Time (total)8.02s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)21.33sResponse Time (max)24.21sResponse Time (total)64.00s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.78sResponse Time (max)5.78sResponse Time (total)5.78s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.89sResponse Time (max)5.89sResponse Time (total)9.78s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.52sResponse Time (max)4.53sResponse Time (total)10.57s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)12.39sResponse Time (max)12.39sResponse Time (total)12.39s
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 6.9 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)3.46sResponse Time (max)4.38sResponse Time (total)13.86s
Coding
: 3.3 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.11sResponse Time (max)27.11sResponse Time (total)27.11s
Combined
: 1.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.54sResponse Time (max)7.51sResponse Time (total)11.08s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.52sResponse Time (max)3.80sResponse Time (total)7.04s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Agentic
: 4.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)77.99sResponse Time (max)77.99sResponse Time (total)77.99s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.56sResponse Time (max)2.05sResponse Time (total)6.26s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)5.45sResponse Time (max)6.31sResponse Time (total)16.36s
Combined
: 2.8 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)42.40sResponse Time (max)73.01sResponse Time (total)84.79s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.59sResponse Time (max)1.63sResponse Time (total)3.17s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)3.87sResponse Time (max)4.85sResponse Time (total)11.62s
General Intelligence
: 4.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.07sResponse Time (max)2.07sResponse Time (total)2.07s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.34sResponse Time (max)1.42sResponse Time (total)2.69s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.89sResponse Time (max)2.38sResponse Time (total)5.68s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.52sResponse Time (max)9.52sResponse Time (total)9.52s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)2.69sResponse Time (max)2.69sResponse Time (total)2.69s
Agentic
: 5.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)66.15sResponse Time (max)66.15sResponse Time (total)66.15s
Anti-AI Tricks
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)1.87sResponse Time (max)5.31sResponse Time (total)7.50s
Coding
: 5.6 A test is fully passed only if every run passed for that test.Extra formatting: 2Response Time (avg)3.69sResponse Time (max)5.45sResponse Time (total)11.08s
Combined
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)7.78sResponse Time (max)12.50sResponse Time (total)15.56s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.05sResponse Time (max)1.22sResponse Time (total)2.11s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)791msResponse Time (max)860msResponse Time (total)2.37s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)803msResponse Time (max)870msResponse Time (total)1.61s
Puzzle Solving
: 7.9 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.67sResponse Time (max)2.31sResponse Time (total)5.01s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.44sResponse Time (max)2.44sResponse Time (total)2.44s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)106.86sResponse Time (max)106.86sResponse Time (total)106.86s
A test is fully passed only if every run passed for that test.Wrong answer: 12No answer: 1Response Time (avg)9.65sResponse Time (max)71.45sResponse Time (total)221.91s…
Agentic
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)71.45sResponse Time (max)71.45sResponse Time (total)71.45s
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)4.04sResponse Time (max)10.18sResponse Time (total)16.17s
Coding
: 4.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)2.35sResponse Time (max)4.27sResponse Time (total)7.05s
Combined
: 3.8 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)41.25sResponse Time (max)55.92sResponse Time (total)82.51s
Data parsing and extraction
: 7.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.63sResponse Time (max)3.40sResponse Time (total)5.26s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.36sResponse Time (max)1.63sResponse Time (total)4.07s
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.44sResponse Time (max)2.44sResponse Time (total)2.44s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.82sResponse Time (max)1.89sResponse Time (total)3.64s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.31sResponse Time (max)4.48sResponse Time (total)6.93s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.28sResponse Time (max)20.28sResponse Time (total)20.28s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.12sResponse Time (max)2.12sResponse Time (total)2.12s
A test is fully passed only if every run passed for that test.Wrong answer: 9Invalid tool call: 1Response Time (avg)9.64sResponse Time (max)58.09sResponse Time (total)221.62s…
Agentic
: 7.4 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)58.09sResponse Time (max)58.09sResponse Time (total)58.09s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.52sResponse Time (max)3.90sResponse Time (total)10.08s
Coding
: 5.4 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)10.38sResponse Time (max)17.15sResponse Time (total)31.15s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.59sResponse Time (max)19.65sResponse Time (total)29.17s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.95sResponse Time (max)2.42sResponse Time (total)3.89s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)18.45sResponse Time (max)29.85sResponse Time (total)55.36s
General Intelligence
: 5.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.34sResponse Time (max)4.34sResponse Time (total)4.34s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.38sResponse Time (max)3.43sResponse Time (total)4.77s
Puzzle Solving
: 7.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.04sResponse Time (max)6.14sResponse Time (total)12.12s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.02sResponse Time (max)6.02sResponse Time (total)6.02s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.64sResponse Time (max)6.64sResponse Time (total)6.64s
A test is fully passed only if every run passed for that test.Wrong answer: 8API error: 3Response Time (avg)9.18sResponse Time (max)44.64sResponse Time (total)211.12s…
Agentic
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)44.64sResponse Time (max)44.64sResponse Time (total)44.64s
Anti-AI Tricks
: 9.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.52sResponse Time (max)2.98sResponse Time (total)6.08s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.68sResponse Time (max)33.46sResponse Time (total)62.05s
Combined
: 3.0 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)2.68sResponse Time (max)3.43sResponse Time (total)5.37s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.60sResponse Time (max)1.93sResponse Time (total)3.20s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)20.22sResponse Time (max)24.34sResponse Time (total)60.66s
General Intelligence
: 5.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.50sResponse Time (max)2.50sResponse Time (total)2.50s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.15sResponse Time (max)1.41sResponse Time (total)2.30s
Puzzle Solving
: 5.8 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)4.46sResponse Time (max)7.42sResponse Time (total)13.38s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)1.84sResponse Time (max)1.84sResponse Time (total)1.84s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)9.10sResponse Time (max)9.10sResponse Time (total)9.10s
A test is fully passed only if every run passed for that test.API error: 4Wrong answer: 3Response Time (avg)9.05sResponse Time (max)26.24sResponse Time (total)90.53s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.99sResponse Time (max)26.24sResponse Time (total)29.99s
Coding
: 3.0 A test is fully passed only if every run passed for that test.API error: 3Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.37sResponse Time (max)10.37sResponse Time (total)10.37s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.84sResponse Time (max)10.84sResponse Time (total)10.84s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)7.01sResponse Time (max)7.01sResponse Time (total)7.01s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.34sResponse Time (max)9.34sResponse Time (total)9.34s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.26sResponse Time (max)3.26sResponse Time (total)3.26s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.88sResponse Time (max)4.23sResponse Time (total)7.77s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.96sResponse Time (max)11.96sResponse Time (total)11.96s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Agentic
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)33.55sResponse Time (max)33.55sResponse Time (total)33.55s
Anti-AI Tricks
: 8.8 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)1.36sResponse Time (max)2.48sResponse Time (total)5.43s
Coding
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)21.05sResponse Time (max)36.04sResponse Time (total)63.15s
Combined
: 3.0 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)2.68sResponse Time (max)3.80sResponse Time (total)5.36s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.66sResponse Time (max)2.18sResponse Time (total)3.32s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)20.70sResponse Time (max)32.05sResponse Time (total)62.11s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.27sResponse Time (max)1.60sResponse Time (total)2.55s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.02sResponse Time (max)6.66sResponse Time (total)12.06s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)1.82sResponse Time (max)1.82sResponse Time (total)1.82s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)16.40sResponse Time (max)16.40sResponse Time (total)16.40s
A test is fully passed only if every run passed for that test.Wrong answer: 10Response Time (avg)9.02sResponse Time (max)57.02sResponse Time (total)207.45s…
Agentic
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)57.02sResponse Time (max)57.02sResponse Time (total)57.02s
Anti-AI Tricks
: 6.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.23sResponse Time (max)1.68sResponse Time (total)4.90s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)12.23sResponse Time (max)23.55sResponse Time (total)36.69s
Combined
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.61sResponse Time (max)16.46sResponse Time (total)21.22s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.98sResponse Time (max)23.53sResponse Time (total)41.97s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.41sResponse Time (max)7.53sResponse Time (total)10.22s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.89sResponse Time (max)23.89sResponse Time (total)23.89s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.23sResponse Time (max)1.40sResponse Time (total)2.46s
Puzzle Solving
: 7.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.40sResponse Time (max)1.64sResponse Time (total)4.20s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.43sResponse Time (max)3.43sResponse Time (total)3.43s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.45sResponse Time (max)1.45sResponse Time (total)1.45s
A test is fully passed only if every run passed for that test.Wrong answer: 8Response Time (avg)8.93sResponse Time (max)54.74sResponse Time (total)205.39s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)54.74sResponse Time (max)54.74sResponse Time (total)54.74s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.22sResponse Time (max)3.03sResponse Time (total)8.87s
Coding
: 6.1 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)7.19sResponse Time (max)9.73sResponse Time (total)21.57s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.10sResponse Time (max)15.93sResponse Time (total)22.19s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)872msResponse Time (max)920msResponse Time (total)1.74s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)21.52sResponse Time (max)41.68sResponse Time (total)64.57s
General Intelligence
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.37sResponse Time (max)2.37sResponse Time (total)2.37s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.43sResponse Time (max)1.84sResponse Time (total)2.87s
Puzzle Solving
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.78sResponse Time (max)6.96sResponse Time (total)11.33s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.09sResponse Time (max)5.09sResponse Time (total)5.09s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.05sResponse Time (max)10.05sResponse Time (total)10.05s
A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)8.90sResponse Time (max)51.03sResponse Time (total)204.78s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)51.03sResponse Time (max)51.03sResponse Time (total)51.03s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.64sResponse Time (max)2.82sResponse Time (total)10.56s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.74sResponse Time (max)5.66sResponse Time (total)14.22s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.62sResponse Time (max)18.03sResponse Time (total)27.24s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.76sResponse Time (max)1.83sResponse Time (total)3.52s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)23.84sResponse Time (max)50.74sResponse Time (total)71.53s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.09sResponse Time (max)3.09sResponse Time (total)3.09s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.11sResponse Time (max)3.21sResponse Time (total)6.22s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.99sResponse Time (max)3.75sResponse Time (total)8.97s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.59sResponse Time (max)4.59sResponse Time (total)4.59s
Trivia
: 4.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.83sResponse Time (max)3.83sResponse Time (total)3.83s
A test is fully passed only if every run passed for that test.Wrong answer: 13Response Time (avg)8.74sResponse Time (max)74.80sResponse Time (total)131.17s…
Agentic
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)74.80sResponse Time (max)74.80sResponse Time (total)74.80s
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)2.37sResponse Time (max)3.39sResponse Time (total)4.75s
Coding
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)5.12sResponse Time (max)8.84sResponse Time (total)15.36s
Combined
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.98sResponse Time (max)4.98sResponse Time (total)4.98s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.78sResponse Time (max)5.78sResponse Time (total)5.78s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)2.24sResponse Time (max)2.24sResponse Time (total)2.24s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.27sResponse Time (max)3.27sResponse Time (total)3.27s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.48sResponse Time (max)1.48sResponse Time (total)1.48s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.91sResponse Time (max)2.08sResponse Time (total)3.82s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.07sResponse Time (max)11.07sResponse Time (total)11.07s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.62sResponse Time (max)3.62sResponse Time (total)3.62s
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.