A test is fully passed only if every run passed for that test.Wrong answer: 11Did not follow instructions: 2Response Time (avg)2.99sResponse Time (max)6.51sResponse Time (total)62.74s…
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)3.13sResponse Time (max)5.90sResponse Time (total)12.50s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.13sResponse Time (max)5.30sResponse Time (total)9.40s
Combined
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.51sResponse Time (max)6.51sResponse Time (total)6.51s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.81sResponse Time (max)5.69sResponse Time (total)7.62s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)2.09sResponse Time (max)2.39sResponse Time (total)6.26s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.97sResponse Time (max)2.43sResponse Time (total)3.93s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.86sResponse Time (max)4.86sResponse Time (total)4.86s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.23sResponse Time (max)2.23sResponse Time (total)2.23s
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)3.97sResponse Time (max)7.48sResponse Time (total)15.89s
Coding
: 5.4 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)18.74sResponse Time (max)30.81sResponse Time (total)56.21s
Combined
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.01sResponse Time (max)10.01sResponse Time (total)10.01s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)21.64sResponse Time (max)29.16sResponse Time (total)43.28s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)8.58sResponse Time (max)9.48sResponse Time (total)25.74s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.15sResponse Time (max)15.94sResponse Time (total)20.30s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.26sResponse Time (max)8.26sResponse Time (total)8.26s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.38sResponse Time (max)2.38sResponse Time (total)2.38s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.28sResponse Time (max)2.09sResponse Time (total)5.13s
Coding
: 3.7 A test is fully passed only if every run passed for that test.Wrong answer: 2Timed out: 1Response Time (avg)4.16sResponse Time (max)7.07sResponse Time (total)12.48s
Combined
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)37.23sResponse Time (max)43.93sResponse Time (total)74.46s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.70sResponse Time (max)2.21sResponse Time (total)3.41s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)2.10sResponse Time (max)4.23sResponse Time (total)6.31s
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)690msResponse Time (max)878msResponse Time (total)1.38s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)57.10sResponse Time (max)57.10sResponse Time (total)57.10s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)778msResponse Time (max)778msResponse Time (total)778ms
Anti-AI Tricks
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)1.80sResponse Time (max)2.62sResponse Time (total)7.19s
Coding
: 5.5 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)2.65sResponse Time (max)3.82sResponse Time (total)5.30s
Combined
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.58sResponse Time (max)6.58sResponse Time (total)6.58s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.39sResponse Time (max)1.42sResponse Time (total)2.78s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.78sResponse Time (max)2.49sResponse Time (total)5.34s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.51sResponse Time (max)2.95sResponse Time (total)5.02s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.39sResponse Time (max)4.39sResponse Time (total)4.39s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.63sResponse Time (max)1.63sResponse Time (total)1.63s
Coding
: 5.6 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)36.89sResponse Time (max)47.10sResponse Time (total)110.66s
Combined
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)21.74sResponse Time (max)21.74sResponse Time (total)21.74s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.60sResponse Time (max)3.92sResponse Time (total)7.19s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.00sResponse Time (max)4.69sResponse Time (total)8.99s
Instructions following
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.63sResponse Time (max)2.77sResponse Time (total)5.27s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)22.78sResponse Time (max)22.78sResponse Time (total)22.78s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.50sResponse Time (max)2.50sResponse Time (total)2.50s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.79sResponse Time (max)9.97sResponse Time (total)15.17s
Coding
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 2Extra formatting: 1Response Time (avg)23.37sResponse Time (max)48.19sResponse Time (total)70.10s
Combined
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)19.56sResponse Time (max)27.68sResponse Time (total)39.11s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.65sResponse Time (max)4.88sResponse Time (total)7.31s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Timed out: 1Response Time (avg)6.58sResponse Time (max)7.90sResponse Time (total)19.73s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.50sResponse Time (max)1.88sResponse Time (total)3.00s
Puzzle Solving
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.87sResponse Time (max)2.41sResponse Time (total)5.61s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.77sResponse Time (max)4.77sResponse Time (total)4.77s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)15.74sResponse Time (max)15.74sResponse Time (total)15.74s
Anti-AI Tricks
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)10.29sResponse Time (max)17.68sResponse Time (total)41.16s
Coding
: 4.4 A test is fully passed only if every run passed for that test.Wrong answer: 2Extra formatting: 1Response Time (avg)168.41sResponse Time (max)280.94sResponse Time (total)505.22s
Combined
: 6.4 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)160.45sResponse Time (max)285.26sResponse Time (total)320.90s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)88.61sResponse Time (max)226.92sResponse Time (total)265.83s
General Intelligence
: 3.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.58sResponse Time (max)7.58sResponse Time (total)7.58s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.92sResponse Time (max)6.92sResponse Time (total)6.92s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)77.98sResponse Time (max)77.98sResponse Time (total)77.98s
Anti-AI Tricks
: 6.0 A test is fully passed only if every run passed for that test.API error: 4Response Time (avg)129.60sResponse Time (max)237.97sResponse Time (total)518.41s
Coding
: 5.2 A test is fully passed only if every run passed for that test.API error: 3Response Time (avg)219.15sResponse Time (max)259.22sResponse Time (total)657.45s
Combined
: 2.9 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)139.43sResponse Time (max)171.85sResponse Time (total)278.85s
Data parsing and extraction
: 8.7 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)88.53sResponse Time (max)120.56sResponse Time (total)177.06s
Domain specific
: 4.5 A test is fully passed only if every run passed for that test.Wrong answer: 2API error: 1Response Time (avg)470.24sResponse Time (max)547.52sResponse Time (total)1410.71s
General Intelligence
: 7.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)110.43sResponse Time (max)110.43sResponse Time (total)110.43s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)77.72sResponse Time (max)91.04sResponse Time (total)155.43s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)93.67sResponse Time (max)93.67sResponse Time (total)93.67s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)597.45sResponse Time (max)597.45sResponse Time (total)597.45s
Anti-AI Tricks
: 3.8 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)2.83sResponse Time (max)7.62sResponse Time (total)11.33s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)4.16sResponse Time (max)10.18sResponse Time (total)12.49s
Combined
: 3.2 A test is fully passed only if every run passed for that test.Invalid tool call: 2Response Time (avg)83.13sResponse Time (max)156.31sResponse Time (total)166.26s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.06sResponse Time (max)2.39sResponse Time (total)4.11s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.79sResponse Time (max)4.83sResponse Time (total)8.37s
Instructions following
: 6.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.92sResponse Time (max)1.94sResponse Time (total)3.83s
Tool Calling
: 9.5 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.74sResponse Time (max)6.74sResponse Time (total)6.74s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.03sResponse Time (max)4.03sResponse Time (total)4.03s
A test is fully passed only if every run passed for that test.API error: 7Wrong answer: 4Response Time (avg)24.56sResponse Time (max)78.74sResponse Time (total)368.35s…
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)9.32sResponse Time (max)12.36sResponse Time (total)27.96s
Coding
: 5.3 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)27.94sResponse Time (max)27.94sResponse Time (total)27.94s
Combined
: 5.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)78.74sResponse Time (max)78.74sResponse Time (total)78.74s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)5.85sResponse Time (max)5.85sResponse Time (total)5.85s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)40.44sResponse Time (max)46.32sResponse Time (total)121.31s
General Intelligence
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.98sResponse Time (max)22.24sResponse Time (total)31.97s
Puzzle Solving
: 5.3 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)7.51sResponse Time (max)7.86sResponse Time (total)15.02s
Tool Calling
: 2.8 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)17.84sResponse Time (max)17.84sResponse Time (total)17.84s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)41.74sResponse Time (max)41.74sResponse Time (total)41.74s
Anti-AI Tricks
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)828msResponse Time (max)1.95sResponse Time (total)3.31s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.19sResponse Time (max)1.97sResponse Time (total)3.56s
Combined
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)24.10sResponse Time (max)44.76sResponse Time (total)48.21s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.14sResponse Time (max)1.18sResponse Time (total)2.27s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)552msResponse Time (max)675msResponse Time (total)1.66s
General Intelligence
: 4.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.31sResponse Time (max)1.31sResponse Time (total)1.31s
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)582msResponse Time (max)633msResponse Time (total)1.16s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.75sResponse Time (max)2.75sResponse Time (total)2.75s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)703msResponse Time (max)703msResponse Time (total)703ms
Combined
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)5.96sResponse Time (max)5.96sResponse Time (total)5.96s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.76sResponse Time (max)2.60sResponse Time (total)3.51s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)2.10sResponse Time (max)3.58sResponse Time (total)6.30s
General Intelligence
: 4.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.33sResponse Time (max)2.33sResponse Time (total)2.33s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.26sResponse Time (max)6.81sResponse Time (total)8.51s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.16sResponse Time (max)1.55sResponse Time (total)3.48s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.40sResponse Time (max)5.40sResponse Time (total)5.40s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.30sResponse Time (max)1.30sResponse Time (total)1.30s
Anti-AI Tricks
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)20.18sResponse Time (max)26.54sResponse Time (total)80.73s
Coding
: 4.2 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)17.13sResponse Time (max)24.90sResponse Time (total)51.40s
Combined
: 4.6 A test is fully passed only if every run passed for that test.Invalid tool call: 2Response Time (avg)179.61sResponse Time (max)247.27sResponse Time (total)359.23s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.79sResponse Time (max)23.85sResponse Time (total)47.57s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)15.31sResponse Time (max)27.66sResponse Time (total)45.92s
General Intelligence
: 4.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)23.74sResponse Time (max)23.74sResponse Time (total)23.74s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)17.54sResponse Time (max)18.51sResponse Time (total)35.08s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)77.93sResponse Time (max)77.93sResponse Time (total)77.93s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.07sResponse Time (max)3.07sResponse Time (total)3.07s
Anti-AI Tricks
: 3.4 A test is fully passed only if every run passed for that test.Wrong answer: 3No answer: 1Response Time (avg)51.82sResponse Time (max)205.67sResponse Time (total)207.27s
Coding
: 5.3 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)158.98sResponse Time (max)441.13sResponse Time (total)476.95s
Combined
: 3.2 A test is fully passed only if every run passed for that test.Invalid tool call: 2Response Time (avg)284.71sResponse Time (max)560.31sResponse Time (total)569.43s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.42sResponse Time (max)4.25sResponse Time (total)4.84s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)2.68sResponse Time (max)7.28sResponse Time (total)8.03s
General Intelligence
: 4.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)739msResponse Time (max)739msResponse Time (total)739ms
Puzzle Solving
: 3.1 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)2.62sResponse Time (max)6.83sResponse Time (total)7.86s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.24sResponse Time (max)2.24sResponse Time (total)2.24s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.11sResponse Time (max)7.11sResponse Time (total)7.11s
Anti-AI Tricks
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.50sResponse Time (max)5.89sResponse Time (total)13.99s
Coding
: 3.5 A test is fully passed only if every run passed for that test.Extra formatting: 2Wrong answer: 1Response Time (avg)11.06sResponse Time (max)14.01sResponse Time (total)33.18s
Combined
: 6.4 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)55.86sResponse Time (max)86.23sResponse Time (total)111.72s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.82sResponse Time (max)3.26sResponse Time (total)5.64s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Extra formatting: 2API error: 1Response Time (avg)8.91sResponse Time (max)13.68sResponse Time (total)26.72s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.64sResponse Time (max)2.19sResponse Time (total)3.28s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.47sResponse Time (max)4.47sResponse Time (total)4.47s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)19.98sResponse Time (max)19.98sResponse Time (total)19.98s
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)901msResponse Time (max)1.45sResponse Time (total)3.60s
Coding
: 3.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)980msResponse Time (max)1.57sResponse Time (total)2.94s
Combined
: 3.2 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)6.68sResponse Time (max)10.57sResponse Time (total)13.35s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)758msResponse Time (max)803msResponse Time (total)1.52s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)784msResponse Time (max)855msResponse Time (total)2.35s
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.00sResponse Time (max)1.00sResponse Time (total)1.00s
Instructions following
: 7.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.23sResponse Time (max)1.66sResponse Time (total)2.47s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.80sResponse Time (max)2.80sResponse Time (total)2.80s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)651msResponse Time (max)651msResponse Time (total)651ms
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.32sResponse Time (max)1.42sResponse Time (total)2.64s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.79sResponse Time (max)3.59sResponse Time (total)5.36s
General Intelligence
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.58sResponse Time (max)2.58sResponse Time (total)2.58s
Instructions following
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.03sResponse Time (max)1.10sResponse Time (total)2.06s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.30sResponse Time (max)3.30sResponse Time (total)3.30s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.89sResponse Time (max)1.89sResponse Time (total)1.89s
A test is fully passed only if every run passed for that test.Wrong answer: 16No answer: 1Response Time (avg)18.03sResponse Time (max)102.83sResponse Time (total)288.42s…
Anti-AI Tricks
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)6.24sResponse Time (max)11.38sResponse Time (total)12.48s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)24.56sResponse Time (max)38.78sResponse Time (total)73.69s
Combined
: 2.8 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)61.00sResponse Time (max)102.83sResponse Time (total)121.99s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)42.13sResponse Time (max)42.13sResponse Time (total)42.13s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)2.75sResponse Time (max)4.38sResponse Time (total)5.49s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.00sResponse Time (max)4.00sResponse Time (total)4.00s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.67sResponse Time (max)2.67sResponse Time (total)2.67s
Puzzle Solving
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)4.04sResponse Time (max)7.81sResponse Time (total)8.08s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.99sResponse Time (max)13.99sResponse Time (total)13.99s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.90sResponse Time (max)3.90sResponse Time (total)3.90s
Coding
: 4.3 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.72sResponse Time (max)3.55sResponse Time (total)5.16s
Combined
: 3.7 A test is fully passed only if every run passed for that test.Invalid tool call: 2Response Time (avg)202.44sResponse Time (max)387.15sResponse Time (total)404.87s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.37sResponse Time (max)2.66sResponse Time (total)4.75s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.17sResponse Time (max)1.66sResponse Time (total)3.50s
General Intelligence
: 4.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.22sResponse Time (max)3.22sResponse Time (total)3.22s
Tool Calling
: 9.5 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.61sResponse Time (max)4.61sResponse Time (total)4.61s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.85sResponse Time (max)1.85sResponse Time (total)1.85s
Anti-AI Tricks
: 3.4 A test is fully passed only if every run passed for that test.Wrong answer: 3No answer: 1Response Time (avg)52.20sResponse Time (max)207.32sResponse Time (total)208.79s
Coding
: 5.3 A test is fully passed only if every run passed for that test.API error: 1No answer: 1Response Time (avg)271.42sResponse Time (max)423.72sResponse Time (total)814.25s
Combined
: 2.9 A test is fully passed only if every run passed for that test.Invalid tool call: 2Response Time (avg)702.26sResponse Time (max)1190.11sResponse Time (total)1404.52s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.96sResponse Time (max)3.41sResponse Time (total)3.91s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)2.51sResponse Time (max)6.82sResponse Time (total)7.52s
General Intelligence
: 4.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)855msResponse Time (max)855msResponse Time (total)855ms
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.69sResponse Time (max)2.69sResponse Time (total)2.69s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.94sResponse Time (max)6.94sResponse Time (total)6.94s
Anti-AI Tricks
: 3.1 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)526msResponse Time (max)1.03sResponse Time (total)2.10s
Coding
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)759msResponse Time (max)1.52sResponse Time (total)2.28s
Combined
: 6.5 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)9.33sResponse Time (max)12.35sResponse Time (total)18.66s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)782msResponse Time (max)961msResponse Time (total)1.56s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)442msResponse Time (max)517msResponse Time (total)1.33s
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)964msResponse Time (max)964msResponse Time (total)964ms
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)767msResponse Time (max)1.02sResponse Time (total)1.53s
Puzzle Solving
: 3.2 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)665msResponse Time (max)734msResponse Time (total)2.00s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)2.31sResponse Time (max)2.31sResponse Time (total)2.31s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)481msResponse Time (max)481msResponse Time (total)481ms
Coding
: 4.3 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)623msResponse Time (max)1.34sResponse Time (total)1.87s
Combined
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)10.39sResponse Time (max)19.02sResponse Time (total)20.78s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)768msResponse Time (max)824msResponse Time (total)1.54s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)303msResponse Time (max)379msResponse Time (total)910ms
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)529msResponse Time (max)529msResponse Time (total)529ms
Puzzle Solving
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.01sResponse Time (max)1.92sResponse Time (total)3.02s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.36sResponse Time (max)1.36sResponse Time (total)1.36s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)254msResponse Time (max)254msResponse Time (total)254ms
Coding
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)13.42sResponse Time (max)22.57sResponse Time (total)40.25s
Combined
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)78.38sResponse Time (max)132.84sResponse Time (total)156.76s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.53sResponse Time (max)6.63sResponse Time (total)9.05s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.91sResponse Time (max)4.51sResponse Time (total)5.72s
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.82sResponse Time (max)2.82sResponse Time (total)2.82s
Instructions following
: 6.2 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)1.80sResponse Time (max)2.04sResponse Time (total)3.60s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)10.04sResponse Time (max)15.52sResponse Time (total)30.11s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)48.81sResponse Time (max)48.81sResponse Time (total)48.81s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)5.36sResponse Time (max)5.36sResponse Time (total)5.36s
Anti-AI Tricks
: 3.4 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)6.55sResponse Time (max)9.41sResponse Time (total)26.19s
Coding
: 3.8 A test is fully passed only if every run passed for that test.API error: 2Wrong answer: 1Response Time (avg)10.57sResponse Time (max)10.57sResponse Time (total)10.57s
Combined
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)23.79sResponse Time (max)24.05sResponse Time (total)47.59s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.37sResponse Time (max)1.37sResponse Time (total)2.73s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.08sResponse Time (max)1.22sResponse Time (total)3.25s
Instructions following
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)5.36sResponse Time (max)9.81sResponse Time (total)10.73s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)25.72sResponse Time (max)25.72sResponse Time (total)25.72s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 2Did not follow instructions: 1Response Time (avg)68.14sResponse Time (max)280.52sResponse Time (total)1090.28s…
Anti-AI Tricks
: 7.5 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)43.87sResponse Time (max)121.88sResponse Time (total)131.62s
Coding
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 5.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)280.52sResponse Time (max)280.52sResponse Time (total)280.52s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.16sResponse Time (max)8.54sResponse Time (total)14.31s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)127.58sResponse Time (max)133.93sResponse Time (total)382.74s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.25sResponse Time (max)5.25sResponse Time (total)5.25s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)64.03sResponse Time (max)124.45sResponse Time (total)128.06s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)46.68sResponse Time (max)134.22sResponse Time (total)140.04s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.73sResponse Time (max)7.73sResponse Time (total)7.73s
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.