Anti-AI Tricks
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)3.81sResponse Time (max)6.85sResponse Time (total)15.23s
Coding
: 9.8 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)15.17sResponse Time (max)15.17sResponse Time (total)15.17s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.49sResponse Time (max)14.02sResponse Time (total)16.98s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)2.33sResponse Time (max)2.94sResponse Time (total)6.99s
Instructions following
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.82sResponse Time (max)2.92sResponse Time (total)5.65s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.02sResponse Time (max)6.02sResponse Time (total)6.02s
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)501msResponse Time (max)839msResponse Time (total)2.01s
Coding
: 1.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.22sResponse Time (max)1.22sResponse Time (total)1.22s
Combined
: 1.5 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)6.04sResponse Time (max)6.04sResponse Time (total)6.04s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)522msResponse Time (max)537msResponse Time (total)1.04s
General Intelligence
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)659msResponse Time (max)659msResponse Time (total)659ms
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)445msResponse Time (max)505msResponse Time (total)889ms
Puzzle Solving
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)473msResponse Time (max)502msResponse Time (total)1.42s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.63sResponse Time (max)4.63sResponse Time (total)4.63s
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 5.3 A test is fully passed only if every run passed for that test.Extra formatting: 2Wrong answer: 1Response Time (avg)3.60sResponse Time (max)7.10sResponse Time (total)14.39s
Coding
: 4.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)3.67sResponse Time (max)5.83sResponse Time (total)11.02s
Combined
: 6.5 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)31.43sResponse Time (max)33.39sResponse Time (total)62.86s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.01sResponse Time (max)3.29sResponse Time (total)6.02s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)3.32sResponse Time (max)4.75sResponse Time (total)9.96s
Instructions following
: 6.4 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)2.58sResponse Time (max)2.89sResponse Time (total)5.17s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.80sResponse Time (max)6.80sResponse Time (total)6.80s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)4.31sResponse Time (max)4.31sResponse Time (total)4.31s
Anti-AI Tricks
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)2.55sResponse Time (max)6.80sResponse Time (total)10.19s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.55sResponse Time (max)2.70sResponse Time (total)4.65s
Combined
: 3.8 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)94.59sResponse Time (max)186.24sResponse Time (total)189.18s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.09sResponse Time (max)3.22sResponse Time (total)4.18s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)814msResponse Time (max)979msResponse Time (total)2.44s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)963msResponse Time (max)963msResponse Time (total)963ms
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)892msResponse Time (max)990msResponse Time (total)1.78s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.80sResponse Time (max)2.80sResponse Time (total)2.80s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)766msResponse Time (max)766msResponse Time (total)766ms
Anti-AI Tricks
: 3.1 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)1.63sResponse Time (max)4.60sResponse Time (total)6.51s
Coding
: 5.4 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.79sResponse Time (max)2.46sResponse Time (total)5.36s
Combined
: 3.8 A test is fully passed only if every run passed for that test.Invalid tool call: 2Response Time (avg)26.50sResponse Time (max)48.79sResponse Time (total)53.01s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.13sResponse Time (max)3.35sResponse Time (total)4.26s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)963msResponse Time (max)1.89sResponse Time (total)2.89s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)947msResponse Time (max)947msResponse Time (total)947ms
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.10sResponse Time (max)1.36sResponse Time (total)2.19s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.49sResponse Time (max)2.49sResponse Time (total)2.49s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)649msResponse Time (max)649msResponse Time (total)649ms
A test is fully passed only if every run passed for that test.Wrong answer: 14Invalid tool call: 1Response Time (avg)25.28sResponse Time (max)480.96sResponse Time (total)556.14s…
Anti-AI Tricks
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)1.32sResponse Time (max)3.89sResponse Time (total)5.30s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)850msResponse Time (max)1.29sResponse Time (total)2.55s
Combined
: 2.9 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)243.59sResponse Time (max)480.96sResponse Time (total)487.17s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.57sResponse Time (max)1.83sResponse Time (total)3.14s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)873msResponse Time (max)1.10sResponse Time (total)2.62s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)803msResponse Time (max)803msResponse Time (total)803ms
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)8.81sResponse Time (max)13.73sResponse Time (total)17.61s
Puzzle Solving
: 3.1 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)10.89sResponse Time (max)27.18sResponse Time (total)32.68s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.67sResponse Time (max)3.67sResponse Time (total)3.67s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)588msResponse Time (max)588msResponse Time (total)588ms
A test is fully passed only if every run passed for that test.Wrong answer: 14Did not follow instructions: 1Response Time (avg)2.08sResponse Time (max)15.63sResponse Time (total)45.75s…
Anti-AI Tricks
: 3.2 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)1.21sResponse Time (max)2.58sResponse Time (total)4.85s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.62sResponse Time (max)2.95sResponse Time (total)4.85s
Combined
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)9.26sResponse Time (max)15.63sResponse Time (total)18.52s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.04sResponse Time (max)1.06sResponse Time (total)2.08s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.15sResponse Time (max)1.54sResponse Time (total)3.46s
General Intelligence
: 4.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.78sResponse Time (max)1.78sResponse Time (total)1.78s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.07sResponse Time (max)1.17sResponse Time (total)2.15s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.75sResponse Time (max)2.75sResponse Time (total)2.75s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)990msResponse Time (max)990msResponse Time (total)990ms
A test is fully passed only if every run passed for that test.Wrong answer: 14No answer: 1Response Time (avg)5.37sResponse Time (max)64.67sResponse Time (total)118.06s…
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.38sResponse Time (max)2.37sResponse Time (total)5.53s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)2.61sResponse Time (max)6.18sResponse Time (total)7.83s
Combined
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)35.11sResponse Time (max)64.67sResponse Time (total)70.22s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.85sResponse Time (max)2.02sResponse Time (total)3.70s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)4.65sResponse Time (max)11.59sResponse Time (total)13.95s
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.40sResponse Time (max)1.40sResponse Time (total)1.40s
Instructions following
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.67sResponse Time (max)2.12sResponse Time (total)3.34s
Puzzle Solving
: 5.4 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)2.33sResponse Time (max)2.91sResponse Time (total)6.98s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.83sResponse Time (max)3.83sResponse Time (total)3.83s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.29sResponse Time (max)1.29sResponse Time (total)1.29s
A test is fully passed only if every run passed for that test.Wrong answer: 9API error: 3Extra formatting: 3Response Time (avg)15.87sResponse Time (max)118.35sResponse Time (total)349.16s…
Anti-AI Tricks
: 6.9 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)2.49sResponse Time (max)3.97sResponse Time (total)9.97s
Combined
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)74.48sResponse Time (max)118.35sResponse Time (total)148.95s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.59sResponse Time (max)4.92sResponse Time (total)7.18s
General Intelligence
: 5.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.10sResponse Time (max)7.10sResponse Time (total)7.10s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.51sResponse Time (max)1.91sResponse Time (total)3.01s
Puzzle Solving
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)2.47sResponse Time (max)2.86sResponse Time (total)7.40s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.77sResponse Time (max)4.77sResponse Time (total)4.77s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)21.72sResponse Time (max)21.72sResponse Time (total)21.72s
Anti-AI Tricks
: 3.8 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)2.83sResponse Time (max)7.62sResponse Time (total)11.33s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)4.16sResponse Time (max)10.18sResponse Time (total)12.49s
Combined
: 3.2 A test is fully passed only if every run passed for that test.Invalid tool call: 2Response Time (avg)83.13sResponse Time (max)156.31sResponse Time (total)166.26s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.06sResponse Time (max)2.39sResponse Time (total)4.11s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.79sResponse Time (max)4.83sResponse Time (total)8.37s
Instructions following
: 6.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.92sResponse Time (max)1.94sResponse Time (total)3.83s
Tool Calling
: 9.5 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.74sResponse Time (max)6.74sResponse Time (total)6.74s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.03sResponse Time (max)4.03sResponse Time (total)4.03s
Anti-AI Tricks
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.50sResponse Time (max)5.89sResponse Time (total)13.99s
Coding
: 3.5 A test is fully passed only if every run passed for that test.Extra formatting: 2Wrong answer: 1Response Time (avg)11.06sResponse Time (max)14.01sResponse Time (total)33.18s
Combined
: 6.4 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)55.86sResponse Time (max)86.23sResponse Time (total)111.72s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.82sResponse Time (max)3.26sResponse Time (total)5.64s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Extra formatting: 2API error: 1Response Time (avg)8.91sResponse Time (max)13.68sResponse Time (total)26.72s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.64sResponse Time (max)2.19sResponse Time (total)3.28s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.47sResponse Time (max)4.47sResponse Time (total)4.47s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)19.98sResponse Time (max)19.98sResponse Time (total)19.98s
Anti-AI Tricks
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.34sResponse Time (max)35.62sResponse Time (total)41.36s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)12.09sResponse Time (max)21.31sResponse Time (total)36.27s
Combined
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Timed out: 1Response Time (avg)291.12sResponse Time (max)557.96sResponse Time (total)582.25s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.43sResponse Time (max)2.31sResponse Time (total)2.87s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)13.96sResponse Time (max)40.61sResponse Time (total)41.88s
Puzzle Solving
: 3.1 A test is fully passed only if every run passed for that test.Timed out: 2Wrong answer: 1Response Time (avg)75.99sResponse Time (max)116.19sResponse Time (total)227.96s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.28sResponse Time (max)2.28sResponse Time (total)2.28s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.24sResponse Time (max)2.24sResponse Time (total)2.24s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)11.68sResponse Time (max)40.72sResponse Time (total)46.73s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)13.01sResponse Time (max)27.71sResponse Time (total)39.04s
Combined
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Timed out: 1Response Time (avg)298.21sResponse Time (max)566.80sResponse Time (total)596.42s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.39sResponse Time (max)2.27sResponse Time (total)2.78s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)26.16sResponse Time (max)77.41sResponse Time (total)78.47s
Instructions following
: 3.0 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)75.80sResponse Time (max)150.25sResponse Time (total)151.60s
Puzzle Solving
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Timed out: 1Response Time (avg)90.84sResponse Time (max)169.53sResponse Time (total)272.52s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.23sResponse Time (max)2.23sResponse Time (total)2.23s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)5.53sResponse Time (max)5.53sResponse Time (total)5.53s
Anti-AI Tricks
: 6.9 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)2.68sResponse Time (max)3.09sResponse Time (total)8.04s
Coding
: 2.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)14.36sResponse Time (max)14.36sResponse Time (total)14.36s
Combined
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)15.92sResponse Time (max)15.92sResponse Time (total)15.92s
Data parsing and extraction
: 7.1 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)9.34sResponse Time (max)16.71sResponse Time (total)18.68s
Domain specific
: 4.1 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)11.12sResponse Time (max)29.11sResponse Time (total)33.35s
General Intelligence
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.68sResponse Time (max)2.03sResponse Time (total)3.36s
Puzzle Solving
: 5.3 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)1.93sResponse Time (max)1.97sResponse Time (total)3.87s
Tool Calling
: 4.7 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)3.39sResponse Time (max)3.39sResponse Time (total)3.39s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Coding
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)9.57sResponse Time (max)9.57sResponse Time (total)9.57s
Combined
: 1.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)7.12sResponse Time (max)7.12sResponse Time (total)7.12s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)34.98sResponse Time (max)68.97sResponse Time (total)104.94s
General Intelligence
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.79sResponse Time (max)10.79sResponse Time (total)10.79s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.06sResponse Time (max)5.85sResponse Time (total)10.12s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)47.29sResponse Time (max)47.29sResponse Time (total)47.29s
A test is fully passed only if every run passed for that test.Wrong answer: 13Did not follow instructions: 2Response Time (avg)2.82sResponse Time (max)8.21sResponse Time (total)59.29s…
Anti-AI Tricks
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)2.84sResponse Time (max)4.15sResponse Time (total)11.35s
Coding
: 3.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)2.41sResponse Time (max)3.93sResponse Time (total)7.22s
Combined
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.89sResponse Time (max)4.89sResponse Time (total)4.89s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.47sResponse Time (max)2.48sResponse Time (total)4.95s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.97sResponse Time (max)2.65sResponse Time (total)5.92s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.13sResponse Time (max)2.53sResponse Time (total)4.27s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.21sResponse Time (max)8.21sResponse Time (total)8.21s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.37sResponse Time (max)2.37sResponse Time (total)2.37s
Anti-AI Tricks
: 6.6 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.19sResponse Time (max)2.04sResponse Time (total)4.75s
Coding
: 3.7 A test is fully passed only if every run passed for that test.API error: 2Wrong answer: 1Response Time (avg)1.30sResponse Time (max)1.30sResponse Time (total)1.30s
Combined
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.70sResponse Time (max)3.70sResponse Time (total)3.70s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)979msResponse Time (max)1.02sResponse Time (total)1.96s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)925msResponse Time (max)1.16sResponse Time (total)2.77s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)987msResponse Time (max)1.13sResponse Time (total)1.97s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)2.83sResponse Time (max)2.83sResponse Time (total)2.83s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 3.4 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)1.43sResponse Time (max)4.39sResponse Time (total)5.71s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.39sResponse Time (max)2.67sResponse Time (total)4.18s
Combined
: 3.8 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)128.29sResponse Time (max)209.15sResponse Time (total)256.58s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.16sResponse Time (max)1.42sResponse Time (total)2.33s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)507msResponse Time (max)549msResponse Time (total)1.52s
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)809msResponse Time (max)983msResponse Time (total)1.62s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.30sResponse Time (max)2.30sResponse Time (total)2.30s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)493msResponse Time (max)493msResponse Time (total)493ms
A test is fully passed only if every run passed for that test.Wrong answer: 13Did not follow instructions: 3Response Time (avg)1.58sResponse Time (max)9.92sResponse Time (total)34.86s…
Anti-AI Tricks
: 3.1 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)929msResponse Time (max)1.55sResponse Time (total)3.72s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)913msResponse Time (max)1.19sResponse Time (total)2.74s
Combined
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.22sResponse Time (max)9.92sResponse Time (total)12.43s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.30sResponse Time (max)1.58sResponse Time (total)2.61s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.31sResponse Time (max)1.78sResponse Time (total)3.93s
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)728msResponse Time (max)731msResponse Time (total)1.46s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)2.32sResponse Time (max)2.32sResponse Time (total)2.32s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.33sResponse Time (max)1.33sResponse Time (total)1.33s
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)3.34sResponse Time (max)9.88sResponse Time (total)13.36s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)6.39sResponse Time (max)17.51sResponse Time (total)19.16s
Combined
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)8.58sResponse Time (max)11.54sResponse Time (total)17.17s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.10sResponse Time (max)1.23sResponse Time (total)2.21s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2API error: 1Response Time (avg)840msResponse Time (max)892msResponse Time (total)1.68s
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.58sResponse Time (max)1.58sResponse Time (total)1.58s
Puzzle Solving
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.49sResponse Time (max)2.55sResponse Time (total)4.46s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.85sResponse Time (max)2.85sResponse Time (total)2.85s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.61sResponse Time (max)10.61sResponse Time (total)10.61s
Anti-AI Tricks
: 4.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.39sResponse Time (max)2.96sResponse Time (total)5.56s
Combined
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)77.83sResponse Time (max)152.28sResponse Time (total)155.66s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.32sResponse Time (max)1.39sResponse Time (total)2.64s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.39sResponse Time (max)1.77sResponse Time (total)4.18s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.64sResponse Time (max)1.80sResponse Time (total)3.28s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.46sResponse Time (max)4.46sResponse Time (total)4.46s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.36sResponse Time (max)1.36sResponse Time (total)1.36s
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.59sResponse Time (max)3.60sResponse Time (total)6.38s
Coding
: 3.7 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)2.77sResponse Time (max)4.03sResponse Time (total)8.32s
Combined
: 5.2 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)129.31sResponse Time (max)212.63sResponse Time (total)258.63s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.01sResponse Time (max)1.06sResponse Time (total)2.02s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)523msResponse Time (max)609msResponse Time (total)1.57s
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)513msResponse Time (max)570msResponse Time (total)1.03s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.04sResponse Time (max)2.04sResponse Time (total)2.04s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)295msResponse Time (max)295msResponse Time (total)295ms
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)901msResponse Time (max)1.45sResponse Time (total)3.60s
Coding
: 3.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)980msResponse Time (max)1.57sResponse Time (total)2.94s
Combined
: 3.2 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)6.68sResponse Time (max)10.57sResponse Time (total)13.35s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)758msResponse Time (max)803msResponse Time (total)1.52s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)784msResponse Time (max)855msResponse Time (total)2.35s
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.00sResponse Time (max)1.00sResponse Time (total)1.00s
Instructions following
: 7.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.23sResponse Time (max)1.66sResponse Time (total)2.47s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.80sResponse Time (max)2.80sResponse Time (total)2.80s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)651msResponse Time (max)651msResponse Time (total)651ms
Coding
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)13.42sResponse Time (max)22.57sResponse Time (total)40.25s
Combined
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)78.38sResponse Time (max)132.84sResponse Time (total)156.76s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.53sResponse Time (max)6.63sResponse Time (total)9.05s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.91sResponse Time (max)4.51sResponse Time (total)5.72s
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.82sResponse Time (max)2.82sResponse Time (total)2.82s
Instructions following
: 6.2 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)1.80sResponse Time (max)2.04sResponse Time (total)3.60s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)10.04sResponse Time (max)15.52sResponse Time (total)30.11s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)48.81sResponse Time (max)48.81sResponse Time (total)48.81s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)5.36sResponse Time (max)5.36sResponse Time (total)5.36s
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.43sResponse Time (max)2.89sResponse Time (total)5.72s
Coding
: 4.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.01sResponse Time (max)2.25sResponse Time (total)3.02s
Combined
: 2.9 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)25.74sResponse Time (max)48.02sResponse Time (total)51.48s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.14sResponse Time (max)1.33sResponse Time (total)2.27s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.18sResponse Time (max)2.66sResponse Time (total)3.54s
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)859msResponse Time (max)859msResponse Time (total)859ms
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.72sResponse Time (max)2.59sResponse Time (total)3.43s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)2.50sResponse Time (max)2.50sResponse Time (total)2.50s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)670msResponse Time (max)670msResponse Time (total)670ms
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.