A test is fully passed only if every run passed for that test.Wrong answer: 12No answer: 1Response Time (avg)9.65sResponse Time (max)71.45sResponse Time (total)221.91s…
Agentic
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)71.45sResponse Time (max)71.45sResponse Time (total)71.45s
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)4.04sResponse Time (max)10.18sResponse Time (total)16.17s
Coding
: 4.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)2.35sResponse Time (max)4.27sResponse Time (total)7.05s
Combined
: 3.8 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)41.25sResponse Time (max)55.92sResponse Time (total)82.51s
Data parsing and extraction
: 7.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.63sResponse Time (max)3.40sResponse Time (total)5.26s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.36sResponse Time (max)1.63sResponse Time (total)4.07s
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.44sResponse Time (max)2.44sResponse Time (total)2.44s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.82sResponse Time (max)1.89sResponse Time (total)3.64s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.31sResponse Time (max)4.48sResponse Time (total)6.93s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.28sResponse Time (max)20.28sResponse Time (total)20.28s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.12sResponse Time (max)2.12sResponse Time (total)2.12s
Agentic
: 5.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)66.15sResponse Time (max)66.15sResponse Time (total)66.15s
Anti-AI Tricks
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)1.87sResponse Time (max)5.31sResponse Time (total)7.50s
Coding
: 5.6 A test is fully passed only if every run passed for that test.Extra formatting: 2Response Time (avg)3.69sResponse Time (max)5.45sResponse Time (total)11.08s
Combined
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)7.78sResponse Time (max)12.50sResponse Time (total)15.56s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.05sResponse Time (max)1.22sResponse Time (total)2.11s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)791msResponse Time (max)860msResponse Time (total)2.37s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)803msResponse Time (max)870msResponse Time (total)1.61s
Puzzle Solving
: 7.9 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.67sResponse Time (max)2.31sResponse Time (total)5.01s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.44sResponse Time (max)2.44sResponse Time (total)2.44s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)106.86sResponse Time (max)106.86sResponse Time (total)106.86s
Agentic
: 4.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)77.99sResponse Time (max)77.99sResponse Time (total)77.99s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.56sResponse Time (max)2.05sResponse Time (total)6.26s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)5.45sResponse Time (max)6.31sResponse Time (total)16.36s
Combined
: 2.8 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)42.40sResponse Time (max)73.01sResponse Time (total)84.79s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.59sResponse Time (max)1.63sResponse Time (total)3.17s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)3.87sResponse Time (max)4.85sResponse Time (total)11.62s
General Intelligence
: 4.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.07sResponse Time (max)2.07sResponse Time (total)2.07s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.34sResponse Time (max)1.42sResponse Time (total)2.69s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.89sResponse Time (max)2.38sResponse Time (total)5.68s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.52sResponse Time (max)9.52sResponse Time (total)9.52s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)2.69sResponse Time (max)2.69sResponse Time (total)2.69s
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 6.9 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)3.46sResponse Time (max)4.38sResponse Time (total)13.86s
Coding
: 3.3 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.11sResponse Time (max)27.11sResponse Time (total)27.11s
Combined
: 1.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.54sResponse Time (max)7.51sResponse Time (total)11.08s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.52sResponse Time (max)3.80sResponse Time (total)7.04s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 3Did not follow instructions: 1Response Time (avg)9.75sResponse Time (max)31.36sResponse Time (total)175.48s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.16sResponse Time (max)3.44sResponse Time (total)12.65s
Coding
: 3.3 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)31.36sResponse Time (max)31.36sResponse Time (total)31.36s
Combined
: 5.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.93sResponse Time (max)20.93sResponse Time (total)20.93s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.01sResponse Time (max)4.27sResponse Time (total)8.02s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)21.33sResponse Time (max)24.21sResponse Time (total)64.00s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.78sResponse Time (max)5.78sResponse Time (total)5.78s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.89sResponse Time (max)5.89sResponse Time (total)9.78s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.52sResponse Time (max)4.53sResponse Time (total)10.57s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)12.39sResponse Time (max)12.39sResponse Time (total)12.39s
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)9.87sResponse Time (max)73.15sResponse Time (total)226.95s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)73.15sResponse Time (max)73.15sResponse Time (total)73.15s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.32sResponse Time (max)6.83sResponse Time (total)17.28s
Coding
: 7.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.70sResponse Time (max)7.45sResponse Time (total)20.10s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)21.05sResponse Time (max)30.67sResponse Time (total)42.11s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.69sResponse Time (max)3.85sResponse Time (total)7.38s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)8.91sResponse Time (max)12.08sResponse Time (total)26.73s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.76sResponse Time (max)3.76sResponse Time (total)3.76s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.13sResponse Time (max)4.27sResponse Time (total)8.26s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.23sResponse Time (max)5.55sResponse Time (total)12.69s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.03sResponse Time (max)9.03sResponse Time (total)9.03s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.48sResponse Time (max)6.48sResponse Time (total)6.48s
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Coding
: 5.6 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)36.89sResponse Time (max)47.10sResponse Time (total)110.66s
Combined
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)21.74sResponse Time (max)21.74sResponse Time (total)21.74s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.60sResponse Time (max)3.92sResponse Time (total)7.19s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.00sResponse Time (max)4.69sResponse Time (total)8.99s
Instructions following
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.63sResponse Time (max)2.77sResponse Time (total)5.27s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)22.78sResponse Time (max)22.78sResponse Time (total)22.78s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.50sResponse Time (max)2.50sResponse Time (total)2.50s
Agentic
: 3.9 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)124.23sResponse Time (max)124.23sResponse Time (total)124.23s
Anti-AI Tricks
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)2.19sResponse Time (max)6.85sResponse Time (total)8.74s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.24sResponse Time (max)5.52sResponse Time (total)9.72s
Combined
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)28.86sResponse Time (max)55.36sResponse Time (total)57.72s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)1.01sResponse Time (max)1.18sResponse Time (total)2.03s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.24sResponse Time (max)2.23sResponse Time (total)3.71s
General Intelligence
: 4.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.86sResponse Time (max)6.86sResponse Time (total)6.86s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)751msResponse Time (max)821msResponse Time (total)1.50s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.43sResponse Time (max)2.43sResponse Time (total)2.43s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.89sResponse Time (max)3.89sResponse Time (total)3.89s
A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)9.90sResponse Time (max)73.48sResponse Time (total)227.67s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)49.96sResponse Time (max)49.96sResponse Time (total)49.96s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.57sResponse Time (max)3.17sResponse Time (total)10.30s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.95sResponse Time (max)6.12sResponse Time (total)14.85s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.91sResponse Time (max)19.10sResponse Time (total)27.82s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.95sResponse Time (max)1.98sResponse Time (total)3.90s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)30.55sResponse Time (max)73.48sResponse Time (total)91.66s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.13sResponse Time (max)4.13sResponse Time (total)4.13s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.86sResponse Time (max)3.03sResponse Time (total)5.73s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.54sResponse Time (max)3.19sResponse Time (total)7.62s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.72sResponse Time (max)5.72sResponse Time (total)5.72s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)5.98sResponse Time (max)5.98sResponse Time (total)5.98s
A test is fully passed only if every run passed for that test.Wrong answer: 11Did not follow instructions: 2Response Time (avg)9.98sResponse Time (max)124.53sResponse Time (total)229.52s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)124.53sResponse Time (max)124.53sResponse Time (total)124.53s
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)788msResponse Time (max)1.34sResponse Time (total)3.15s
Coding
: 5.8 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.80sResponse Time (max)2.51sResponse Time (total)5.40s
Combined
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)39.43sResponse Time (max)69.46sResponse Time (total)78.86s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.43sResponse Time (max)1.45sResponse Time (total)2.86s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)634msResponse Time (max)784msResponse Time (total)1.90s
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.03sResponse Time (max)1.40sResponse Time (total)2.06s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.54sResponse Time (max)3.54sResponse Time (total)3.54s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)599msResponse Time (max)599msResponse Time (total)599ms
Agentic
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)32msResponse Time (max)32msResponse Time (total)32ms
Coding
: 5.3 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)11.21sResponse Time (max)11.21sResponse Time (total)11.21s
Combined
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 2Response Time (avg)35.69sResponse Time (max)36.03sResponse Time (total)71.38s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)8.48sResponse Time (max)12.71sResponse Time (total)16.96s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)5.20sResponse Time (max)7.65sResponse Time (total)15.60s
General Intelligence
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.45sResponse Time (max)1.45sResponse Time (total)1.45s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.52sResponse Time (max)8.19sResponse Time (total)11.04s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)18.80sResponse Time (max)18.80sResponse Time (total)18.80s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.06sResponse Time (max)1.06sResponse Time (total)1.06s
Agentic
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)1.08sResponse Time (max)1.08sResponse Time (total)1.08s
Anti-AI Tricks
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.50sResponse Time (max)5.89sResponse Time (total)13.99s
Coding
: 3.5 A test is fully passed only if every run passed for that test.Extra formatting: 2Wrong answer: 1Response Time (avg)11.06sResponse Time (max)14.01sResponse Time (total)33.18s
Combined
: 6.4 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)55.86sResponse Time (max)86.23sResponse Time (total)111.72s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.82sResponse Time (max)3.26sResponse Time (total)5.64s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Extra formatting: 2API error: 1Response Time (avg)8.91sResponse Time (max)13.68sResponse Time (total)26.72s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.64sResponse Time (max)2.19sResponse Time (total)3.28s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.47sResponse Time (max)4.47sResponse Time (total)4.47s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)19.98sResponse Time (max)19.98sResponse Time (total)19.98s
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)4.75sResponse Time (max)7.62sResponse Time (total)19.00s
Coding
: 1.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 2.3 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)30.53sResponse Time (max)30.53sResponse Time (total)30.53s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.16sResponse Time (max)26.55sResponse Time (total)46.33s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.18sResponse Time (max)4.46sResponse Time (total)8.36s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.33sResponse Time (max)17.33sResponse Time (total)17.33s
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)52.61sResponse Time (max)52.61sResponse Time (total)52.61s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.70sResponse Time (max)3.88sResponse Time (total)10.81s
Coding
: 6.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)9.54sResponse Time (max)12.73sResponse Time (total)28.63s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)30.00sResponse Time (max)37.55sResponse Time (total)59.99s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.77sResponse Time (max)4.30sResponse Time (total)7.53s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.89sResponse Time (max)4.89sResponse Time (total)4.89s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.19sResponse Time (max)3.21sResponse Time (total)6.38s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.34sResponse Time (max)5.34sResponse Time (total)5.34s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)4.49sResponse Time (max)4.49sResponse Time (total)4.49s
Agentic
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)75.76sResponse Time (max)75.76sResponse Time (total)75.76s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.28sResponse Time (max)2.09sResponse Time (total)5.13s
Coding
: 3.7 A test is fully passed only if every run passed for that test.Wrong answer: 2Timed out: 1Response Time (avg)4.16sResponse Time (max)7.07sResponse Time (total)12.48s
Combined
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)37.23sResponse Time (max)43.93sResponse Time (total)74.46s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.70sResponse Time (max)2.21sResponse Time (total)3.41s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)2.10sResponse Time (max)4.23sResponse Time (total)6.31s
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)690msResponse Time (max)878msResponse Time (total)1.38s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)57.10sResponse Time (max)57.10sResponse Time (total)57.10s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)778msResponse Time (max)778msResponse Time (total)778ms
Agentic
: 5.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)79.61sResponse Time (max)79.61sResponse Time (total)79.61s
Anti-AI Tricks
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)4.33sResponse Time (max)9.08sResponse Time (total)17.30s
Coding
: 5.9 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)5.54sResponse Time (max)8.42sResponse Time (total)16.63s
Combined
: 8.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)30.54sResponse Time (max)47.72sResponse Time (total)61.09s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.88sResponse Time (max)4.06sResponse Time (total)7.75s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)11.10sResponse Time (max)26.91sResponse Time (total)33.31s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.70sResponse Time (max)3.70sResponse Time (total)3.70s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.81sResponse Time (max)2.98sResponse Time (total)5.62s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)3.66sResponse Time (max)4.75sResponse Time (total)10.98s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.89sResponse Time (max)7.89sResponse Time (total)7.89s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)4.08sResponse Time (max)4.08sResponse Time (total)4.08s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)51.53sResponse Time (max)51.53sResponse Time (total)51.53s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.69sResponse Time (max)5.27sResponse Time (total)14.74s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.85sResponse Time (max)11.12sResponse Time (total)29.55s
Combined
: 8.2 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)24.57sResponse Time (max)25.71sResponse Time (total)49.15s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)3.86sResponse Time (max)6.13sResponse Time (total)7.72s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)17.52sResponse Time (max)20.97sResponse Time (total)52.55s
General Intelligence
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.93sResponse Time (max)6.93sResponse Time (total)6.93s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.13sResponse Time (max)5.35sResponse Time (total)10.26s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.54sResponse Time (max)4.64sResponse Time (total)10.63s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.22sResponse Time (max)5.22sResponse Time (total)5.22s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)9.93sResponse Time (max)9.93sResponse Time (total)9.93s
Agentic
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)50.05sResponse Time (max)50.05sResponse Time (total)50.05s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.42sResponse Time (max)2.72sResponse Time (total)5.66s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.15sResponse Time (max)24.93sResponse Time (total)51.46s
Combined
: 3.0 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)3.04sResponse Time (max)4.53sResponse Time (total)6.08s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.23sResponse Time (max)1.43sResponse Time (total)2.46s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)31.89sResponse Time (max)54.48sResponse Time (total)95.68s
General Intelligence
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.63sResponse Time (max)3.63sResponse Time (total)3.63s
Puzzle Solving
: 7.8 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)3.94sResponse Time (max)5.76sResponse Time (total)11.82s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)2.15sResponse Time (max)2.15sResponse Time (total)2.15s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)24.53sResponse Time (max)24.53sResponse Time (total)24.53s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)107.19sResponse Time (max)107.19sResponse Time (total)107.19s
Anti-AI Tricks
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)2.11sResponse Time (max)3.94sResponse Time (total)8.46s
Coding
: 3.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)4.96sResponse Time (max)9.79sResponse Time (total)14.89s
Combined
: 2.8 A test is fully passed only if every run passed for that test.Invalid tool call: 1No answer: 1Response Time (avg)46.88sResponse Time (max)61.20sResponse Time (total)93.77s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.08sResponse Time (max)1.62sResponse Time (total)2.15s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)2.27sResponse Time (max)3.99sResponse Time (total)6.80s
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)790msResponse Time (max)790msResponse Time (total)790ms
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.98sResponse Time (max)2.28sResponse Time (total)3.97s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.45sResponse Time (max)2.09sResponse Time (total)4.36s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.68sResponse Time (max)10.68sResponse Time (total)10.68s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.34sResponse Time (max)2.34sResponse Time (total)2.34s
A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)11.13sResponse Time (max)57.11sResponse Time (total)256.08s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)57.11sResponse Time (max)57.11sResponse Time (total)57.11s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.60sResponse Time (max)3.46sResponse Time (total)10.42s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.25sResponse Time (max)22.67sResponse Time (total)33.75s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.58sResponse Time (max)19.29sResponse Time (total)29.16s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.82sResponse Time (max)2.12sResponse Time (total)3.64s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)30.95sResponse Time (max)53.91sResponse Time (total)92.86s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.07sResponse Time (max)3.07sResponse Time (total)3.07s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.27sResponse Time (max)3.37sResponse Time (total)4.54s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.44sResponse Time (max)3.98sResponse Time (total)10.31s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.56sResponse Time (max)7.56sResponse Time (total)7.56s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.67sResponse Time (max)3.67sResponse Time (total)3.67s
Agentic
: 6.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)46.94sResponse Time (max)46.94sResponse Time (total)46.94s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.70sResponse Time (max)5.66sResponse Time (total)14.80s
Combined
: 6.9 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)50.17sResponse Time (max)79.65sResponse Time (total)100.33s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.17sResponse Time (max)11.71sResponse Time (total)14.35s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.35sResponse Time (max)7.33sResponse Time (total)19.05s
General Intelligence
: 6.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.42sResponse Time (max)4.42sResponse Time (total)4.42s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.84sResponse Time (max)4.88sResponse Time (total)7.68s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.31sResponse Time (max)3.63sResponse Time (total)9.92s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.76sResponse Time (max)15.76sResponse Time (total)15.76s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.41sResponse Time (max)3.41sResponse Time (total)3.41s
Agentic
: 2.8 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)34.77sResponse Time (max)34.77sResponse Time (total)34.77s
Anti-AI Tricks
: 6.5 A test is fully passed only if every run passed for that test.Extra formatting: 2Response Time (avg)4.54sResponse Time (max)4.91sResponse Time (total)18.16s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)29.40sResponse Time (max)33.10sResponse Time (total)58.80s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.71sResponse Time (max)4.86sResponse Time (total)9.43s
Domain specific
: 4.1 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)19.30sResponse Time (max)19.72sResponse Time (total)57.90s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.62sResponse Time (max)5.62sResponse Time (total)5.62s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)5.24sResponse Time (max)5.70sResponse Time (total)10.49s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)4.78sResponse Time (max)5.07sResponse Time (total)14.33s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.22sResponse Time (max)13.22sResponse Time (total)13.22s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)19.18sResponse Time (max)19.18sResponse Time (total)19.18s
Agentic
: 2.8 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)84.47sResponse Time (max)84.47sResponse Time (total)84.47s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.09sResponse Time (max)2.56sResponse Time (total)8.35s
Coding
: 7.9 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)12.63sResponse Time (max)18.07sResponse Time (total)37.89s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)44.36sResponse Time (max)76.68sResponse Time (total)88.72s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.07sResponse Time (max)5.60sResponse Time (total)8.14s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)7.28sResponse Time (max)10.39sResponse Time (total)21.83s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.52sResponse Time (max)2.52sResponse Time (total)2.52s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.70sResponse Time (max)3.07sResponse Time (total)5.40s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.38sResponse Time (max)2.55sResponse Time (total)7.15s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.81sResponse Time (max)3.81sResponse Time (total)3.81s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.75sResponse Time (max)2.75sResponse Time (total)2.75s
A test is fully passed only if every run passed for that test.Wrong answer: 4Did not follow instructions: 3Response Time (avg)11.81sResponse Time (max)56.77sResponse Time (total)271.60s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)56.77sResponse Time (max)56.77sResponse Time (total)56.77s
Anti-AI Tricks
: 9.2 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)3.26sResponse Time (max)4.96sResponse Time (total)13.03s
Coding
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.09sResponse Time (max)13.60sResponse Time (total)30.28s
Combined
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.03sResponse Time (max)19.52sResponse Time (total)34.06s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.22sResponse Time (max)5.57sResponse Time (total)8.44s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)28.53sResponse Time (max)47.80sResponse Time (total)85.59s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.95sResponse Time (max)3.69sResponse Time (total)5.89s
Puzzle Solving
: 8.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)5.17sResponse Time (max)7.82sResponse Time (total)15.52s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.58sResponse Time (max)3.58sResponse Time (total)3.58s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.00sResponse Time (max)10.00sResponse Time (total)10.00s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)59.70sResponse Time (max)59.70sResponse Time (total)59.70s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.14sResponse Time (max)2.97sResponse Time (total)8.57s
Coding
: 5.4 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)10.38sResponse Time (max)16.53sResponse Time (total)31.15s
Combined
: 3.8 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)54.70sResponse Time (max)90.45sResponse Time (total)109.40s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)2.39sResponse Time (max)2.80sResponse Time (total)4.78s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)7.93sResponse Time (max)13.69sResponse Time (total)23.78s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.65sResponse Time (max)1.82sResponse Time (total)3.30s
Puzzle Solving
: 7.8 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)2.67sResponse Time (max)3.68sResponse Time (total)8.00s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.00sResponse Time (max)17.00sResponse Time (total)17.00s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.54sResponse Time (max)4.54sResponse Time (total)4.54s
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.