Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 2API error: 1Response Time (avg)584msResponse Time (max)772msResponse Time (total)1.75s
Coding
: 3.3 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.27sResponse Time (max)1.27sResponse Time (total)1.27s
Combined
: 1.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 3.8 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.42sResponse Time (max)2.21sResponse Time (total)2.84s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)489msResponse Time (max)513msResponse Time (total)1.47s
General Intelligence
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)34.99sResponse Time (max)109.60sResponse Time (total)139.95s
Coding
: 9.8 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 1.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 1.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Domain specific
: 3.3 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)34.54sResponse Time (max)34.54sResponse Time (total)34.54s
Instructions following
: 5.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.30sResponse Time (max)9.30sResponse Time (total)9.30s
Puzzle Solving
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)114.12sResponse Time (max)114.12sResponse Time (total)114.12s
A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)18.65sResponse Time (max)254.93sResponse Time (total)410.28s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.25sResponse Time (max)4.01sResponse Time (total)13.02s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.86sResponse Time (max)6.97sResponse Time (total)17.59s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.38sResponse Time (max)35.76sResponse Time (total)48.76s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.32sResponse Time (max)2.45sResponse Time (total)4.64s
Domain specific
: 7.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)95.10sResponse Time (max)254.93sResponse Time (total)285.30s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.28sResponse Time (max)8.28sResponse Time (total)8.28s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.58sResponse Time (max)3.77sResponse Time (total)7.15s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.60sResponse Time (max)4.52sResponse Time (total)10.79s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.92sResponse Time (max)8.92sResponse Time (total)8.92s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.83sResponse Time (max)5.83sResponse Time (total)5.83s
A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)28.44sResponse Time (max)381.11sResponse Time (total)625.68s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.71sResponse Time (max)5.18sResponse Time (total)14.85s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.27sResponse Time (max)11.08sResponse Time (total)24.81s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)41.20sResponse Time (max)63.24sResponse Time (total)82.41s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.34sResponse Time (max)3.64sResponse Time (total)6.69s
Domain specific
: 7.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)146.97sResponse Time (max)381.11sResponse Time (total)440.90s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.68sResponse Time (max)7.68sResponse Time (total)7.68s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.91sResponse Time (max)5.08sResponse Time (total)9.82s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.48sResponse Time (max)5.60sResponse Time (total)13.44s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.04sResponse Time (max)11.04sResponse Time (total)11.04s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.06sResponse Time (max)14.06sResponse Time (total)14.06s
A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)5.09sResponse Time (max)28.60sResponse Time (total)112.04s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.05sResponse Time (max)2.37sResponse Time (total)8.22s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.97sResponse Time (max)4.12sResponse Time (total)11.92s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.45sResponse Time (max)14.47sResponse Time (total)20.91s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.22sResponse Time (max)2.50sResponse Time (total)4.44s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)13.92sResponse Time (max)28.60sResponse Time (total)41.76s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.11sResponse Time (max)3.11sResponse Time (total)3.11s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.65sResponse Time (max)2.98sResponse Time (total)5.29s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.44sResponse Time (max)2.85sResponse Time (total)7.32s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.95sResponse Time (max)4.95sResponse Time (total)4.95s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.12sResponse Time (max)4.12sResponse Time (total)4.12s
A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)8.08sResponse Time (max)73.48sResponse Time (total)177.70s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.57sResponse Time (max)3.17sResponse Time (total)10.30s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.95sResponse Time (max)6.12sResponse Time (total)14.85s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.91sResponse Time (max)19.10sResponse Time (total)27.82s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.95sResponse Time (max)1.98sResponse Time (total)3.90s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)30.55sResponse Time (max)73.48sResponse Time (total)91.66s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.13sResponse Time (max)4.13sResponse Time (total)4.13s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.86sResponse Time (max)3.03sResponse Time (total)5.73s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.54sResponse Time (max)3.19sResponse Time (total)7.62s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.72sResponse Time (max)5.72sResponse Time (total)5.72s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)5.98sResponse Time (max)5.98sResponse Time (total)5.98s
Anti-AI Tricks
: 7.1 A test is fully passed only if every run passed for that test.Did not follow instructions: 2Response Time (avg)6.00sResponse Time (max)10.62sResponse Time (total)23.99s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)22.24sResponse Time (max)28.05sResponse Time (total)66.72s
Combined
: 8.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)39.89sResponse Time (max)52.46sResponse Time (total)79.78s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.93sResponse Time (max)8.10sResponse Time (total)13.85s
Domain specific
: 4.1 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)108.85sResponse Time (max)192.00sResponse Time (total)326.56s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.93sResponse Time (max)13.93sResponse Time (total)13.93s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.43sResponse Time (max)6.96sResponse Time (total)10.86s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)10.07sResponse Time (max)18.77sResponse Time (total)30.22s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.00sResponse Time (max)4.00sResponse Time (total)4.00s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)14.99sResponse Time (max)14.99sResponse Time (total)14.99s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.01sResponse Time (max)33.19sResponse Time (total)52.06s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)105.91sResponse Time (max)159.45sResponse Time (total)317.72s
Combined
: 6.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1No answer: 1Response Time (avg)272.74sResponse Time (max)467.25sResponse Time (total)545.49s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)19.84sResponse Time (max)23.87sResponse Time (total)39.68s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)142.55sResponse Time (max)292.27sResponse Time (total)427.66s
General Intelligence
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.41sResponse Time (max)7.41sResponse Time (total)7.41s
Puzzle Solving
: 7.8 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)199.67sResponse Time (max)576.79sResponse Time (total)599.00s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.08sResponse Time (max)8.08sResponse Time (total)8.08s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)87.23sResponse Time (max)87.23sResponse Time (total)87.23s
A test is fully passed only if every run passed for that test.Wrong answer: 7Response Time (avg)4.56sResponse Time (max)72.30sResponse Time (total)100.30s…
Anti-AI Tricks
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.08sResponse Time (max)1.39sResponse Time (total)4.30s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.35sResponse Time (max)1.63sResponse Time (total)4.04s
Combined
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)37.23sResponse Time (max)72.30sResponse Time (total)74.47s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.35sResponse Time (max)1.43sResponse Time (total)2.69s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.24sResponse Time (max)1.87sResponse Time (total)3.71s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.04sResponse Time (max)1.04sResponse Time (total)1.04s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)943msResponse Time (max)974msResponse Time (total)1.89s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.13sResponse Time (max)1.29sResponse Time (total)3.40s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.92sResponse Time (max)3.92sResponse Time (total)3.92s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)856msResponse Time (max)856msResponse Time (total)856ms
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)53.37sResponse Time (max)74.40sResponse Time (total)213.47s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)310.39sResponse Time (max)518.33sResponse Time (total)931.17s
Combined
: 6.4 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)294.82sResponse Time (max)519.91sResponse Time (total)589.65s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)43.08sResponse Time (max)47.23sResponse Time (total)86.16s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)201.85sResponse Time (max)333.26sResponse Time (total)605.54s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)40.08sResponse Time (max)56.63sResponse Time (total)80.15s
Puzzle Solving
: 9.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)45.83sResponse Time (max)74.11sResponse Time (total)137.48s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.86sResponse Time (max)7.86sResponse Time (total)7.86s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)108.62sResponse Time (max)108.62sResponse Time (total)108.62s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.04sResponse Time (max)17.24sResponse Time (total)36.14s
Coding
: 6.6 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)479.30sResponse Time (max)560.39sResponse Time (total)1437.91s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)130.21sResponse Time (max)197.80sResponse Time (total)260.43s
Data parsing and extraction
: 6.3 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)10.77sResponse Time (max)18.66sResponse Time (total)21.54s
General Intelligence
: 3.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)22.45sResponse Time (max)22.45sResponse Time (total)22.45s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.39sResponse Time (max)6.65sResponse Time (total)12.78s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.81sResponse Time (max)10.81sResponse Time (total)10.81s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)122.07sResponse Time (max)122.07sResponse Time (total)122.07s
A test is fully passed only if every run passed for that test.Wrong answer: 11Response Time (avg)7.82sResponse Time (max)102.62sResponse Time (total)172.04s…
Anti-AI Tricks
: 5.2 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)2.63sResponse Time (max)5.57sResponse Time (total)10.53s
Coding
: 3.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)3.12sResponse Time (max)3.45sResponse Time (total)9.35s
Combined
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)61.56sResponse Time (max)102.62sResponse Time (total)123.12s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.87sResponse Time (max)3.54sResponse Time (total)5.74s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.23sResponse Time (max)1.27sResponse Time (total)3.70s
General Intelligence
: 4.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.62sResponse Time (max)1.62sResponse Time (total)1.62s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.40sResponse Time (max)1.46sResponse Time (total)2.79s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.65sResponse Time (max)3.59sResponse Time (total)7.94s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.27sResponse Time (max)5.27sResponse Time (total)5.27s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.97sResponse Time (max)1.97sResponse Time (total)1.97s
Anti-AI Tricks
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)10.29sResponse Time (max)17.68sResponse Time (total)41.16s
Coding
: 4.4 A test is fully passed only if every run passed for that test.Wrong answer: 2Extra formatting: 1Response Time (avg)168.41sResponse Time (max)280.94sResponse Time (total)505.22s
Combined
: 6.4 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)160.45sResponse Time (max)285.26sResponse Time (total)320.90s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)88.61sResponse Time (max)226.92sResponse Time (total)265.83s
General Intelligence
: 3.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.58sResponse Time (max)7.58sResponse Time (total)7.58s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.92sResponse Time (max)6.92sResponse Time (total)6.92s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)77.98sResponse Time (max)77.98sResponse Time (total)77.98s
Anti-AI Tricks
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.50sResponse Time (max)5.89sResponse Time (total)13.99s
Coding
: 3.5 A test is fully passed only if every run passed for that test.Extra formatting: 2Wrong answer: 1Response Time (avg)11.06sResponse Time (max)14.01sResponse Time (total)33.18s
Combined
: 6.4 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)55.86sResponse Time (max)86.23sResponse Time (total)111.72s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.82sResponse Time (max)3.26sResponse Time (total)5.64s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Extra formatting: 2API error: 1Response Time (avg)8.91sResponse Time (max)13.68sResponse Time (total)26.72s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.64sResponse Time (max)2.19sResponse Time (total)3.28s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.47sResponse Time (max)4.47sResponse Time (total)4.47s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)19.98sResponse Time (max)19.98sResponse Time (total)19.98s
Anti-AI Tricks
: 6.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)12.34sResponse Time (max)41.00sResponse Time (total)49.37s
Coding
: 4.4 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)285.47sResponse Time (max)437.11sResponse Time (total)856.41s
Combined
: 6.2 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)136.91sResponse Time (max)250.92sResponse Time (total)273.82s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)74.73sResponse Time (max)179.37sResponse Time (total)224.19s
Puzzle Solving
: 4.2 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)10.49sResponse Time (max)22.61sResponse Time (total)31.46s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.92sResponse Time (max)4.92sResponse Time (total)4.92s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)44.02sResponse Time (max)44.02sResponse Time (total)44.02s
A test is fully passed only if every run passed for that test.Wrong answer: 7API error: 1Invalid tool call: 1Response Time (avg)33.62sResponse Time (max)392.56sResponse Time (total)739.59s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.62sResponse Time (max)16.86sResponse Time (total)34.49s
Coding
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)26.53sResponse Time (max)31.91sResponse Time (total)79.58s
Combined
: 6.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)218.25sResponse Time (max)392.56sResponse Time (total)436.49s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.68sResponse Time (max)7.94sResponse Time (total)11.36s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)35.22sResponse Time (max)49.56sResponse Time (total)105.65s
General Intelligence
: 3.7 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)2.52sResponse Time (max)2.52sResponse Time (total)2.52s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.35sResponse Time (max)9.38sResponse Time (total)12.69s
Puzzle Solving
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.54sResponse Time (max)6.03sResponse Time (total)10.62s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.72sResponse Time (max)7.72sResponse Time (total)7.72s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)38.47sResponse Time (max)38.47sResponse Time (total)38.47s
A test is fully passed only if every run passed for that test.Wrong answer: 7Invalid tool call: 2API error: 1Response Time (avg)13.70sResponse Time (max)75.27sResponse Time (total)287.75s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.26sResponse Time (max)10.43sResponse Time (total)17.02s
Coding
: 6.7 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)14.85sResponse Time (max)23.25sResponse Time (total)44.56s
Combined
: 2.9 A test is fully passed only if every run passed for that test.Invalid tool call: 2Response Time (avg)50.41sResponse Time (max)75.27sResponse Time (total)100.82s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.15sResponse Time (max)11.16sResponse Time (total)14.31s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2API error: 1Response Time (avg)30.29sResponse Time (max)40.12sResponse Time (total)60.58s
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.98sResponse Time (max)2.98sResponse Time (total)2.98s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.85sResponse Time (max)1.99sResponse Time (total)3.70s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.33sResponse Time (max)6.40sResponse Time (total)12.98s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.47sResponse Time (max)6.47sResponse Time (total)6.47s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)24.35sResponse Time (max)24.35sResponse Time (total)24.35s
A test is fully passed only if every run passed for that test.Wrong answer: 9API error: 3Extra formatting: 3Response Time (avg)15.87sResponse Time (max)118.35sResponse Time (total)349.16s…
Anti-AI Tricks
: 6.9 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)2.49sResponse Time (max)3.97sResponse Time (total)9.97s
Combined
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)74.48sResponse Time (max)118.35sResponse Time (total)148.95s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.59sResponse Time (max)4.92sResponse Time (total)7.18s
General Intelligence
: 5.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.10sResponse Time (max)7.10sResponse Time (total)7.10s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.51sResponse Time (max)1.91sResponse Time (total)3.01s
Puzzle Solving
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)2.47sResponse Time (max)2.86sResponse Time (total)7.40s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.77sResponse Time (max)4.77sResponse Time (total)4.77s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)21.72sResponse Time (max)21.72sResponse Time (total)21.72s
Anti-AI Tricks
: 6.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)14.82sResponse Time (max)27.06sResponse Time (total)59.28s
Coding
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)224.42sResponse Time (max)312.21sResponse Time (total)673.27s
Combined
: 6.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)142.36sResponse Time (max)259.10sResponse Time (total)284.72s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)52.66sResponse Time (max)123.93sResponse Time (total)157.97s
General Intelligence
: 3.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.61sResponse Time (max)4.61sResponse Time (total)4.61s
Puzzle Solving
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)6.21sResponse Time (max)11.28sResponse Time (total)18.64s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.08sResponse Time (max)5.08sResponse Time (total)5.08s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)38.68sResponse Time (max)38.68sResponse Time (total)38.68s
Anti-AI Tricks
: 3.4 A test is fully passed only if every run passed for that test.Wrong answer: 3API error: 1Response Time (avg)705msResponse Time (max)975msResponse Time (total)2.12s
Coding
: 2.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.93sResponse Time (max)2.93sResponse Time (total)2.93s
Combined
: 1.5 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)4.32sResponse Time (max)4.32sResponse Time (total)4.32s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.37sResponse Time (max)5.76sResponse Time (total)6.73s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)5.50sResponse Time (max)15.42sResponse Time (total)16.50s
General Intelligence
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)683msResponse Time (max)691msResponse Time (total)1.37s
Puzzle Solving
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2API error: 1Response Time (avg)891msResponse Time (max)1.21sResponse Time (total)1.78s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.54sResponse Time (max)7.54sResponse Time (total)7.54s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 2Extra formatting: 1Response Time (avg)5.14sResponse Time (max)14.88sResponse Time (total)20.55s
Coding
: 4.2 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.19sResponse Time (max)1.84sResponse Time (total)3.56s
Combined
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Wrong answer: 1Response Time (avg)124.21sResponse Time (max)240.61sResponse Time (total)248.43s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2API error: 1Response Time (avg)880msResponse Time (max)917msResponse Time (total)1.76s
Puzzle Solving
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)2.64sResponse Time (max)5.23sResponse Time (total)7.91s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)3.05sResponse Time (max)3.05sResponse Time (total)3.05s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)988msResponse Time (max)988msResponse Time (total)988ms
Coding
: 6.1 A test is fully passed only if every run passed for that test.Extra formatting: 1Timed out: 1Response Time (avg)144.74sResponse Time (max)218.40sResponse Time (total)434.22s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)138.24sResponse Time (max)211.18sResponse Time (total)276.48s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.92sResponse Time (max)16.89sResponse Time (total)29.85s
Domain specific
: 3.2 A test is fully passed only if every run passed for that test.Timed out: 2Wrong answer: 1Response Time (avg)234.97sResponse Time (max)431.03sResponse Time (total)469.94s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.14sResponse Time (max)6.80sResponse Time (total)12.27s
Puzzle Solving
: 7.9 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)49.91sResponse Time (max)128.09sResponse Time (total)149.74s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.91sResponse Time (max)11.91sResponse Time (total)11.91s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)100.80sResponse Time (max)100.80sResponse Time (total)100.80s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.10sResponse Time (max)21.48sResponse Time (total)32.40s
Coding
: 8.1 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)248.62sResponse Time (max)458.25sResponse Time (total)745.85s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)185.57sResponse Time (max)333.21sResponse Time (total)371.15s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)34.85sResponse Time (max)57.71sResponse Time (total)69.71s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)526.74sResponse Time (max)640.85sResponse Time (total)1580.21s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.24sResponse Time (max)10.18sResponse Time (total)16.49s
Puzzle Solving
: 7.6 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)199.90sResponse Time (max)569.33sResponse Time (total)599.69s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.62sResponse Time (max)5.62sResponse Time (total)5.62s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)263.98sResponse Time (max)263.98sResponse Time (total)263.98s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.93sResponse Time (max)5.18sResponse Time (total)11.70s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)40.50sResponse Time (max)72.14sResponse Time (total)121.51s
Combined
: 8.7 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)124.48sResponse Time (max)214.63sResponse Time (total)248.96s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)8.76sResponse Time (max)10.36sResponse Time (total)17.53s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)76.98sResponse Time (max)144.07sResponse Time (total)230.93s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.54sResponse Time (max)2.67sResponse Time (total)5.07s
Puzzle Solving
: 8.3 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)12.62sResponse Time (max)29.62sResponse Time (total)37.85s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)11.29sResponse Time (max)11.29sResponse Time (total)11.29s
A test is fully passed only if every run passed for that test.Wrong answer: 8Timed out: 1Response Time (avg)46.97sResponse Time (max)189.38sResponse Time (total)986.35s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.84sResponse Time (max)15.11sResponse Time (total)43.36s
Coding
: 6.2 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)125.25sResponse Time (max)189.38sResponse Time (total)375.76s
Combined
: 6.5 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)92.41sResponse Time (max)92.41sResponse Time (total)92.41s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)38.32sResponse Time (max)41.70sResponse Time (total)76.63s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)57.36sResponse Time (max)90.70sResponse Time (total)172.08s
General Intelligence
: 4.9 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)25.30sResponse Time (max)25.30sResponse Time (total)25.30s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.25sResponse Time (max)21.65sResponse Time (total)40.50s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)17.67sResponse Time (max)24.83sResponse Time (total)53.02s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.72sResponse Time (max)14.72sResponse Time (total)14.72s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)92.57sResponse Time (max)92.57sResponse Time (total)92.57s
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.