Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)16.01sResponse Time (max)32.13sResponse Time (total)64.02s
Coding
: 6.6 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)312.17sResponse Time (max)660.89sResponse Time (total)936.52s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)96.50sResponse Time (max)165.82sResponse Time (total)193.01s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.16sResponse Time (max)5.54sResponse Time (total)10.32s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)300.37sResponse Time (max)481.36sResponse Time (total)901.10s
General Intelligence
: 5.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)32.39sResponse Time (max)32.39sResponse Time (total)32.39s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)18.46sResponse Time (max)31.99sResponse Time (total)55.39s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.79sResponse Time (max)4.79sResponse Time (total)4.79s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)123.05sResponse Time (max)123.05sResponse Time (total)123.05s
A test is fully passed only if every run passed for that test.Wrong answer: 2Did not follow instructions: 1Response Time (avg)68.14sResponse Time (max)280.52sResponse Time (total)1090.28s…
Anti-AI Tricks
: 7.5 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)43.87sResponse Time (max)121.88sResponse Time (total)131.62s
Coding
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 5.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)280.52sResponse Time (max)280.52sResponse Time (total)280.52s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.16sResponse Time (max)8.54sResponse Time (total)14.31s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)127.58sResponse Time (max)133.93sResponse Time (total)382.74s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.25sResponse Time (max)5.25sResponse Time (total)5.25s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)64.03sResponse Time (max)124.45sResponse Time (total)128.06s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)46.68sResponse Time (max)134.22sResponse Time (total)140.04s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.73sResponse Time (max)7.73sResponse Time (total)7.73s
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.22sResponse Time (max)63.59sResponse Time (total)96.87s
Coding
: 5.9 A test is fully passed only if every run passed for that test.Did not follow instructions: 1No answer: 1Response Time (avg)160.52sResponse Time (max)311.89sResponse Time (total)481.57s
Combined
: 6.9 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)266.12sResponse Time (max)328.22sResponse Time (total)532.25s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.67sResponse Time (max)19.13sResponse Time (total)27.34s
Domain specific
: 4.1 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)301.08sResponse Time (max)532.28sResponse Time (total)903.25s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.45sResponse Time (max)15.77sResponse Time (total)22.90s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)65.54sResponse Time (max)156.63sResponse Time (total)196.61s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)32.93sResponse Time (max)32.93sResponse Time (total)32.93s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)347.95sResponse Time (max)347.95sResponse Time (total)347.95s
Anti-AI Tricks
: 6.5 A test is fully passed only if every run passed for that test.Extra formatting: 2Response Time (avg)4.54sResponse Time (max)4.91sResponse Time (total)18.16s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)29.40sResponse Time (max)33.10sResponse Time (total)58.80s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.71sResponse Time (max)4.86sResponse Time (total)9.43s
Domain specific
: 4.1 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)19.30sResponse Time (max)19.72sResponse Time (total)57.90s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.62sResponse Time (max)5.62sResponse Time (total)5.62s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)5.24sResponse Time (max)5.70sResponse Time (total)10.49s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)4.78sResponse Time (max)5.07sResponse Time (total)14.33s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.22sResponse Time (max)13.22sResponse Time (total)13.22s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)19.18sResponse Time (max)19.18sResponse Time (total)19.18s
A test is fully passed only if every run passed for that test.No answer: 4Wrong answer: 3API error: 1Response Time (avg)115.74sResponse Time (max)775.64sResponse Time (total)2546.31s…
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)35.37sResponse Time (max)83.16sResponse Time (total)141.48s
Coding
: 5.3 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)414.53sResponse Time (max)775.64sResponse Time (total)1243.59s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)170.10sResponse Time (max)307.48sResponse Time (total)340.19s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.50sResponse Time (max)8.31sResponse Time (total)15.00s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.No answer: 2Wrong answer: 1Response Time (avg)190.55sResponse Time (max)240.86sResponse Time (total)571.65s
General Intelligence
: 4.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)26.32sResponse Time (max)26.32sResponse Time (total)26.32s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.31sResponse Time (max)27.10sResponse Time (total)34.62s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.50sResponse Time (max)30.41sResponse Time (total)61.50s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.36sResponse Time (max)5.36sResponse Time (total)5.36s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)106.61sResponse Time (max)106.61sResponse Time (total)106.61s
A test is fully passed only if every run passed for that test.Wrong answer: 4No answer: 2Invalid tool call: 1Response Time (avg)118.97sResponse Time (max)534.21sResponse Time (total)2617.41s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)22.04sResponse Time (max)42.15sResponse Time (total)88.14s
Coding
: 7.8 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)172.53sResponse Time (max)384.94sResponse Time (total)517.59s
Combined
: 8.2 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)231.85sResponse Time (max)331.16sResponse Time (total)463.69s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)22.27sResponse Time (max)37.21sResponse Time (total)44.54s
Domain specific
: 3.2 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)287.65sResponse Time (max)534.21sResponse Time (total)862.96s
General Intelligence
: 6.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)22.97sResponse Time (max)22.97sResponse Time (total)22.97s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)19.54sResponse Time (max)28.63sResponse Time (total)39.07s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)43.37sResponse Time (max)96.64sResponse Time (total)130.12s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)25.88sResponse Time (max)25.88sResponse Time (total)25.88s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)422.46sResponse Time (max)422.46sResponse Time (total)422.46s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.86sResponse Time (max)43.91sResponse Time (total)63.42s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)253.22sResponse Time (max)465.35sResponse Time (total)759.66s
Combined
: 8.7 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)110.39sResponse Time (max)193.76sResponse Time (total)220.77s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)16.37sResponse Time (max)21.48sResponse Time (total)32.74s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)658.46sResponse Time (max)912.78sResponse Time (total)1975.38s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.55sResponse Time (max)8.10sResponse Time (total)15.11s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)134.14sResponse Time (max)355.52sResponse Time (total)402.43s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.21sResponse Time (max)5.21sResponse Time (total)5.21s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)532.59sResponse Time (max)532.59sResponse Time (total)532.59s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)5.18sResponse Time (max)6.20sResponse Time (total)20.72s
Coding
: 7.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)10.99sResponse Time (max)13.14sResponse Time (total)32.96s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)32.59sResponse Time (max)36.59sResponse Time (total)65.17s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.47sResponse Time (max)4.60sResponse Time (total)8.93s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)19.29sResponse Time (max)23.88sResponse Time (total)57.86s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.14sResponse Time (max)5.14sResponse Time (total)5.14s
Puzzle Solving
: 7.6 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)5.70sResponse Time (max)6.78sResponse Time (total)17.10s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.99sResponse Time (max)12.99sResponse Time (total)12.99s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)24.32sResponse Time (max)24.32sResponse Time (total)24.32s
Anti-AI Tricks
: 6.4 A test is fully passed only if every run passed for that test.Extra formatting: 2Response Time (avg)7.45sResponse Time (max)11.88sResponse Time (total)14.90s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)114.08sResponse Time (max)151.51sResponse Time (total)228.16s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.37sResponse Time (max)7.37sResponse Time (total)7.37s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.04sResponse Time (max)5.04sResponse Time (total)5.04s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.43sResponse Time (max)2.43sResponse Time (total)2.43s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.71sResponse Time (max)4.75sResponse Time (total)9.41s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.73sResponse Time (max)9.73sResponse Time (total)9.73s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)63.24sResponse Time (max)63.24sResponse Time (total)63.24s
A test is fully passed only if every run passed for that test.No answer: 3Invalid tool call: 1Wrong answer: 1Response Time (avg)15.01sResponse Time (max)80.80sResponse Time (total)330.15s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.20sResponse Time (max)6.57sResponse Time (total)24.81s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.59sResponse Time (max)22.20sResponse Time (total)46.76s
Combined
: 6.5 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)27.47sResponse Time (max)33.70sResponse Time (total)54.94s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.18sResponse Time (max)7.44sResponse Time (total)14.35s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)37.32sResponse Time (max)80.80sResponse Time (total)111.95s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.42sResponse Time (max)7.42sResponse Time (total)7.42s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.90sResponse Time (max)5.96sResponse Time (total)11.79s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)5.18sResponse Time (max)5.58sResponse Time (total)15.53s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)16.96sResponse Time (max)16.96sResponse Time (total)16.96s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)25.64sResponse Time (max)25.64sResponse Time (total)25.64s
A test is fully passed only if every run passed for that test.Wrong answer: 2Extra formatting: 1No answer: 1Response Time (avg)22.51sResponse Time (max)159.01sResponse Time (total)495.12s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.91sResponse Time (max)10.95sResponse Time (total)23.66s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.73sResponse Time (max)15.75sResponse Time (total)38.19s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)31.11sResponse Time (max)42.48sResponse Time (total)62.21s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.22sResponse Time (max)4.27sResponse Time (total)8.43s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Extra formatting: 1Response Time (avg)104.24sResponse Time (max)159.01sResponse Time (total)312.73s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.79sResponse Time (max)3.79sResponse Time (total)3.79s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.78sResponse Time (max)4.91sResponse Time (total)9.56s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.66sResponse Time (max)5.51sResponse Time (total)13.97s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.44sResponse Time (max)8.44sResponse Time (total)8.44s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)14.14sResponse Time (max)14.14sResponse Time (total)14.14s
A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)13.59sResponse Time (max)40.17sResponse Time (total)298.90s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.90sResponse Time (max)6.70sResponse Time (total)23.59s
Coding
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)13.91sResponse Time (max)19.46sResponse Time (total)41.74s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)34.59sResponse Time (max)40.17sResponse Time (total)69.18s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.30sResponse Time (max)7.96sResponse Time (total)12.59s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)24.34sResponse Time (max)29.92sResponse Time (total)73.01s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.40sResponse Time (max)5.40sResponse Time (total)5.40s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.60sResponse Time (max)5.76sResponse Time (total)11.20s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.11sResponse Time (max)6.93sResponse Time (total)18.32s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.30sResponse Time (max)13.30sResponse Time (total)13.30s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)30.58sResponse Time (max)30.58sResponse Time (total)30.58s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.24sResponse Time (max)15.21sResponse Time (total)40.97s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)325.79sResponse Time (max)589.43sResponse Time (total)977.36s
Combined
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)223.03sResponse Time (max)223.03sResponse Time (total)223.03s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)16.72sResponse Time (max)18.73sResponse Time (total)33.44s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.No answer: 1Timed out: 1Response Time (avg)683.62sResponse Time (max)766.58sResponse Time (total)1367.25s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.91sResponse Time (max)14.91sResponse Time (total)14.91s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.66sResponse Time (max)7.99sResponse Time (total)15.33s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.36sResponse Time (max)12.30sResponse Time (total)22.07s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)19.67sResponse Time (max)19.67sResponse Time (total)19.67s
A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)18.65sResponse Time (max)254.93sResponse Time (total)410.28s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.25sResponse Time (max)4.01sResponse Time (total)13.02s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.86sResponse Time (max)6.97sResponse Time (total)17.59s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.38sResponse Time (max)35.76sResponse Time (total)48.76s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.32sResponse Time (max)2.45sResponse Time (total)4.64s
Domain specific
: 7.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)95.10sResponse Time (max)254.93sResponse Time (total)285.30s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.28sResponse Time (max)8.28sResponse Time (total)8.28s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.58sResponse Time (max)3.77sResponse Time (total)7.15s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.60sResponse Time (max)4.52sResponse Time (total)10.79s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.92sResponse Time (max)8.92sResponse Time (total)8.92s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.83sResponse Time (max)5.83sResponse Time (total)5.83s
A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)61.27sResponse Time (max)960.01sResponse Time (total)1347.96s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.87sResponse Time (max)8.14sResponse Time (total)19.46s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.64sResponse Time (max)23.54sResponse Time (total)43.92s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)64.02sResponse Time (max)96.57sResponse Time (total)128.04s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.78sResponse Time (max)4.82sResponse Time (total)9.56s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)356.37sResponse Time (max)960.01sResponse Time (total)1069.12s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.69sResponse Time (max)13.69sResponse Time (total)13.69s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.34sResponse Time (max)8.87sResponse Time (total)12.67s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.32sResponse Time (max)10.41sResponse Time (total)21.95s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.65sResponse Time (max)20.65sResponse Time (total)20.65s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.91sResponse Time (max)8.91sResponse Time (total)8.91s
A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)38.97sResponse Time (max)332.10sResponse Time (total)857.43s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.66sResponse Time (max)6.74sResponse Time (total)18.65s
Coding
: 8.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)59.77sResponse Time (max)130.26sResponse Time (total)179.30s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)33.52sResponse Time (max)47.74sResponse Time (total)67.03s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.18sResponse Time (max)4.35sResponse Time (total)8.36s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)168.16sResponse Time (max)332.10sResponse Time (total)504.49s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.16sResponse Time (max)4.16sResponse Time (total)4.16s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.36sResponse Time (max)3.46sResponse Time (total)6.73s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.76sResponse Time (max)10.54sResponse Time (total)20.28s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.57sResponse Time (max)10.57sResponse Time (total)10.57s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)37.86sResponse Time (max)37.86sResponse Time (total)37.86s
A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)28.44sResponse Time (max)381.11sResponse Time (total)625.68s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.71sResponse Time (max)5.18sResponse Time (total)14.85s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.27sResponse Time (max)11.08sResponse Time (total)24.81s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)41.20sResponse Time (max)63.24sResponse Time (total)82.41s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.34sResponse Time (max)3.64sResponse Time (total)6.69s
Domain specific
: 7.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)146.97sResponse Time (max)381.11sResponse Time (total)440.90s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.68sResponse Time (max)7.68sResponse Time (total)7.68s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.91sResponse Time (max)5.08sResponse Time (total)9.82s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.48sResponse Time (max)5.60sResponse Time (total)13.44s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.04sResponse Time (max)11.04sResponse Time (total)11.04s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.06sResponse Time (max)14.06sResponse Time (total)14.06s
Anti-AI Tricks
: 6.9 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)3.46sResponse Time (max)4.38sResponse Time (total)13.86s
Coding
: 3.3 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.11sResponse Time (max)27.11sResponse Time (total)27.11s
Combined
: 1.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.54sResponse Time (max)7.51sResponse Time (total)11.08s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.52sResponse Time (max)3.80sResponse Time (total)7.04s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.