Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.95sResponse Time (max)5.68sResponse Time (total)15.80s
Coding
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)109.93sResponse Time (max)199.66sResponse Time (total)329.79s
Combined
: 8.7 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)42.25sResponse Time (max)67.09sResponse Time (total)84.49s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.17sResponse Time (max)5.02sResponse Time (total)8.34s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Extra formatting: 2Wrong answer: 1Response Time (avg)49.71sResponse Time (max)94.92sResponse Time (total)149.12s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.26sResponse Time (max)4.46sResponse Time (total)8.52s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.22sResponse Time (max)11.63sResponse Time (total)18.66s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)13.68sResponse Time (max)13.68sResponse Time (total)13.68s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)63.48sResponse Time (max)63.48sResponse Time (total)63.48s
A test is fully passed only if every run passed for that test.Wrong answer: 7Invalid tool call: 1Response Time (avg)11.22sResponse Time (max)91.49sResponse Time (total)246.77s…
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.54sResponse Time (max)3.19sResponse Time (total)10.15s
Coding
: 7.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)9.14sResponse Time (max)15.19sResponse Time (total)27.43s
Combined
: 8.7 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)13.72sResponse Time (max)20.49sResponse Time (total)27.43s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)938msResponse Time (max)1.01sResponse Time (total)1.88s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)42.65sResponse Time (max)91.49sResponse Time (total)127.94s
General Intelligence
: 5.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.03sResponse Time (max)3.03sResponse Time (total)3.03s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.14sResponse Time (max)2.48sResponse Time (total)4.28s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)5.45sResponse Time (max)10.40sResponse Time (total)16.36s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.97sResponse Time (max)4.97sResponse Time (total)4.97s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)23.30sResponse Time (max)23.30sResponse Time (total)23.30s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.80sResponse Time (max)5.73sResponse Time (total)15.21s
Coding
: 9.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)17.28sResponse Time (max)31.73sResponse Time (total)51.84s
Combined
: 7.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)51.86sResponse Time (max)66.71sResponse Time (total)103.73s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.16sResponse Time (max)3.47sResponse Time (total)6.32s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)20.54sResponse Time (max)56.94sResponse Time (total)61.61s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.10sResponse Time (max)3.61sResponse Time (total)6.20s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.98sResponse Time (max)3.20sResponse Time (total)8.93s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.70sResponse Time (max)10.70sResponse Time (total)10.70s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.06sResponse Time (max)7.06sResponse Time (total)7.06s
A test is fully passed only if every run passed for that test.Wrong answer: 6Response Time (avg)16.17sResponse Time (max)205.28sResponse Time (total)355.67s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.75sResponse Time (max)3.42sResponse Time (total)10.99s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.72sResponse Time (max)17.72sResponse Time (total)41.16s
Combined
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)12.75sResponse Time (max)17.34sResponse Time (total)25.50s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.44sResponse Time (max)3.78sResponse Time (total)6.88s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)77.09sResponse Time (max)205.28sResponse Time (total)231.27s
General Intelligence
: 6.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.88sResponse Time (max)4.88sResponse Time (total)4.88s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.80sResponse Time (max)2.84sResponse Time (total)5.59s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.20sResponse Time (max)5.51sResponse Time (total)9.59s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.83sResponse Time (max)5.83sResponse Time (total)5.83s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)13.98sResponse Time (max)13.98sResponse Time (total)13.98s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)19.75sResponse Time (max)49.95sResponse Time (total)79.01s
Coding
: 6.2 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)160.69sResponse Time (max)234.36sResponse Time (total)482.07s
Combined
: 7.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)595.19sResponse Time (max)1026.43sResponse Time (total)1190.39s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)30.26sResponse Time (max)32.03sResponse Time (total)60.52s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)89.39sResponse Time (max)95.52sResponse Time (total)268.18s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)19.66sResponse Time (max)32.25sResponse Time (total)39.32s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)59.60sResponse Time (max)123.57sResponse Time (total)178.80s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.45sResponse Time (max)7.45sResponse Time (total)7.45s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)85.11sResponse Time (max)85.11sResponse Time (total)85.11s
A test is fully passed only if every run passed for that test.Wrong answer: 4Did not follow instructions: 2Response Time (avg)16.91sResponse Time (max)100.93sResponse Time (total)372.03s…
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.16sResponse Time (max)6.68sResponse Time (total)16.63s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)19.50sResponse Time (max)27.96sResponse Time (total)58.49s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)26.04sResponse Time (max)32.53sResponse Time (total)52.08s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.07sResponse Time (max)3.59sResponse Time (total)6.15s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)63.93sResponse Time (max)100.93sResponse Time (total)191.78s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.04sResponse Time (max)3.44sResponse Time (total)6.07s
Puzzle Solving
: 9.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)5.05sResponse Time (max)8.73sResponse Time (total)15.15s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.37sResponse Time (max)6.37sResponse Time (total)6.37s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)14.43sResponse Time (max)14.43sResponse Time (total)14.43s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)12.62sResponse Time (max)18.61sResponse Time (total)50.50s
Coding
: 7.7 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)142.99sResponse Time (max)168.22sResponse Time (total)428.96s
Combined
: 6.7 A test is fully passed only if every run passed for that test.Invalid tool call: 2Response Time (avg)584.09sResponse Time (max)1085.11sResponse Time (total)1168.18s
Data parsing and extraction
: 3.5 A test is fully passed only if every run passed for that test.No answer: 2Response Time (avg)37.30sResponse Time (max)54.01sResponse Time (total)74.60s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Extra formatting: 1Response Time (avg)71.47sResponse Time (max)101.55sResponse Time (total)214.40s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)37.96sResponse Time (max)47.48sResponse Time (total)75.92s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)61.14sResponse Time (max)97.76sResponse Time (total)183.42s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)16.88sResponse Time (max)16.88sResponse Time (total)16.88s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)80.99sResponse Time (max)80.99sResponse Time (total)80.99s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.68sResponse Time (max)26.90sResponse Time (total)50.73s
Coding
: 8.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)148.36sResponse Time (max)327.51sResponse Time (total)445.07s
Combined
: 7.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)63.78sResponse Time (max)103.34sResponse Time (total)127.56s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.19sResponse Time (max)11.82sResponse Time (total)16.38s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)174.68sResponse Time (max)325.98sResponse Time (total)524.04s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.53sResponse Time (max)6.53sResponse Time (total)6.53s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.00sResponse Time (max)7.33sResponse Time (total)14.01s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)6.52sResponse Time (max)6.52sResponse Time (total)6.52s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)153.57sResponse Time (max)153.57sResponse Time (total)153.57s
A test is fully passed only if every run passed for that test.API error: 4Wrong answer: 4Response Time (avg)10.18sResponse Time (max)64.36sResponse Time (total)183.29s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.53sResponse Time (max)3.43sResponse Time (total)10.12s
Coding
: 8.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)34.69sResponse Time (max)64.36sResponse Time (total)104.06s
Combined
: 3.0 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)8.10sResponse Time (max)8.10sResponse Time (total)8.10s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)12.18sResponse Time (max)14.00sResponse Time (total)36.54s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.46sResponse Time (max)3.46sResponse Time (total)3.46s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.38sResponse Time (max)3.40sResponse Time (total)6.76s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.13sResponse Time (max)3.33sResponse Time (total)9.39s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.87sResponse Time (max)4.87sResponse Time (total)4.87s
A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)6.99sResponse Time (max)30.67sResponse Time (total)153.80s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.32sResponse Time (max)6.83sResponse Time (total)17.28s
Coding
: 7.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.70sResponse Time (max)7.45sResponse Time (total)20.10s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)21.05sResponse Time (max)30.67sResponse Time (total)42.11s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.69sResponse Time (max)3.85sResponse Time (total)7.38s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)8.91sResponse Time (max)12.08sResponse Time (total)26.73s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.76sResponse Time (max)3.76sResponse Time (total)3.76s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.13sResponse Time (max)4.27sResponse Time (total)8.26s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.23sResponse Time (max)5.55sResponse Time (total)12.69s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.03sResponse Time (max)9.03sResponse Time (total)9.03s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.48sResponse Time (max)6.48sResponse Time (total)6.48s
A test is fully passed only if every run passed for that test.Wrong answer: 6Extra formatting: 3Response Time (avg)54.50sResponse Time (max)252.69sResponse Time (total)1199.07s…
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)7.43sResponse Time (max)10.89sResponse Time (total)29.72s
Coding
: 5.7 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)108.46sResponse Time (max)200.16sResponse Time (total)325.39s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)65.08sResponse Time (max)97.35sResponse Time (total)130.16s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.72sResponse Time (max)12.13sResponse Time (total)21.44s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Extra formatting: 1Response Time (avg)175.94sResponse Time (max)252.69sResponse Time (total)527.81s
General Intelligence
: 4.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)18.41sResponse Time (max)18.41sResponse Time (total)18.41s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.36sResponse Time (max)20.80sResponse Time (total)24.73s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)18.26sResponse Time (max)44.40sResponse Time (total)54.79s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.12sResponse Time (max)13.12sResponse Time (total)13.12s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)53.51sResponse Time (max)53.51sResponse Time (total)53.51s
A test is fully passed only if every run passed for that test.Wrong answer: 4Timed out: 1Response Time (avg)66.52sResponse Time (max)238.07sResponse Time (total)1463.50s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)22.13sResponse Time (max)28.70sResponse Time (total)88.50s
Coding
: 8.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)146.48sResponse Time (max)238.07sResponse Time (total)439.45s
Combined
: 7.3 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)177.48sResponse Time (max)233.47sResponse Time (total)354.96s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)41.15sResponse Time (max)48.02sResponse Time (total)82.30s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)88.53sResponse Time (max)186.74sResponse Time (total)265.58s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)32.24sResponse Time (max)32.24sResponse Time (total)32.24s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.31sResponse Time (max)27.94sResponse Time (total)48.63s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.32sResponse Time (max)37.68sResponse Time (total)72.96s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)18.32sResponse Time (max)18.32sResponse Time (total)18.32s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)60.56sResponse Time (max)60.56sResponse Time (total)60.56s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)21.13sResponse Time (max)34.96sResponse Time (total)84.53s
Coding
: 5.9 A test is fully passed only if every run passed for that test.No answer: 1Timed out: 1Response Time (avg)206.65sResponse Time (max)409.98sResponse Time (total)619.94s
Combined
: 3.8 A test is fully passed only if every run passed for that test.Invalid tool call: 1No answer: 1Response Time (avg)512.79sResponse Time (max)950.25sResponse Time (total)1025.59s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)59.33sResponse Time (max)97.12sResponse Time (total)118.65s
General Intelligence
: 2.8 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)30.30sResponse Time (max)30.30sResponse Time (total)30.30s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.45sResponse Time (max)43.36sResponse Time (total)48.89s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)33.13sResponse Time (max)64.81sResponse Time (total)99.38s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.65sResponse Time (max)4.65sResponse Time (total)4.65s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)177.35sResponse Time (max)177.35sResponse Time (total)177.35s
Anti-AI Tricks
: 6.9 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)45.98sResponse Time (max)130.73sResponse Time (total)183.93s
Coding
: 8.9 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)89.94sResponse Time (max)105.48sResponse Time (total)269.82s
Combined
: 4.7 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)102.33sResponse Time (max)177.88sResponse Time (total)204.66s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)18.78sResponse Time (max)27.01sResponse Time (total)37.56s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)429.77sResponse Time (max)626.58sResponse Time (total)1289.31s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.34sResponse Time (max)15.43sResponse Time (total)20.67s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)34.30sResponse Time (max)46.61sResponse Time (total)102.91s
Tool Calling
: 4.7 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)36.36sResponse Time (max)36.36sResponse Time (total)36.36s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)66.56sResponse Time (max)66.56sResponse Time (total)66.56s
A test is fully passed only if every run passed for that test.Wrong answer: 4Invalid tool call: 1Response Time (avg)44.32sResponse Time (max)556.06sResponse Time (total)975.11s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.36sResponse Time (max)8.75sResponse Time (total)25.44s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)35.31sResponse Time (max)59.98sResponse Time (total)105.93s
Combined
: 8.7 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)287.83sResponse Time (max)556.06sResponse Time (total)575.66s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.80sResponse Time (max)10.25sResponse Time (total)17.60s
Domain specific
: 4.1 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)52.45sResponse Time (max)102.71sResponse Time (total)157.35s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.70sResponse Time (max)11.70sResponse Time (total)11.70s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.46sResponse Time (max)10.17sResponse Time (total)14.92s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.84sResponse Time (max)11.71sResponse Time (total)26.51s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.63sResponse Time (max)6.63sResponse Time (total)6.63s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)33.37sResponse Time (max)33.37sResponse Time (total)33.37s
Anti-AI Tricks
: 6.5 A test is fully passed only if every run passed for that test.Extra formatting: 2Response Time (avg)3.40sResponse Time (max)6.36sResponse Time (total)13.58s
Combined
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)26.38sResponse Time (max)35.03sResponse Time (total)52.76s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.77sResponse Time (max)1.93sResponse Time (total)3.53s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.76sResponse Time (max)2.16sResponse Time (total)5.29s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.48sResponse Time (max)3.48sResponse Time (total)3.48s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.37sResponse Time (max)1.40sResponse Time (total)2.73s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)2.74sResponse Time (max)3.46sResponse Time (total)8.22s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.35sResponse Time (max)5.35sResponse Time (total)5.35s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)3.41sResponse Time (max)3.41sResponse Time (total)3.41s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)22.73sResponse Time (max)31.19sResponse Time (total)68.20s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)58.50sResponse Time (max)102.93sResponse Time (total)116.99s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.15sResponse Time (max)3.15sResponse Time (total)3.15s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)97.33sResponse Time (max)116.86sResponse Time (total)194.65s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.12sResponse Time (max)3.12sResponse Time (total)3.12s
Puzzle Solving
: 7.5 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)5.80sResponse Time (max)6.45sResponse Time (total)11.61s
Tool Calling
: 4.7 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)10.30sResponse Time (max)10.30sResponse Time (total)10.30s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)28.18sResponse Time (max)28.18sResponse Time (total)28.18s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.80sResponse Time (max)7.00sResponse Time (total)23.18s
Coding
: 6.4 A test is fully passed only if every run passed for that test.Timed out: 2Response Time (avg)73.03sResponse Time (max)129.73sResponse Time (total)219.09s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)321.47sResponse Time (max)599.43sResponse Time (total)642.94s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.81sResponse Time (max)9.80sResponse Time (total)11.62s
Domain specific
: 3.1 A test is fully passed only if every run passed for that test.No answer: 2Timed out: 1Response Time (avg)126.85sResponse Time (max)180.69sResponse Time (total)380.54s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.90sResponse Time (max)12.90sResponse Time (total)12.90s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.26sResponse Time (max)5.88sResponse Time (total)8.52s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.25sResponse Time (max)9.25sResponse Time (total)9.25s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)127.82sResponse Time (max)127.82sResponse Time (total)127.82s
A test is fully passed only if every run passed for that test.Wrong answer: 5Timed out: 2Invalid tool call: 1Response Time (avg)65.67sResponse Time (max)519.30sResponse Time (total)1444.68s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.75sResponse Time (max)18.03sResponse Time (total)39.01s
Coding
: 6.0 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)114.48sResponse Time (max)168.16sResponse Time (total)343.44s
Combined
: 6.4 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)313.55sResponse Time (max)519.30sResponse Time (total)627.09s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.41sResponse Time (max)29.79sResponse Time (total)46.83s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)74.43sResponse Time (max)119.29sResponse Time (total)223.29s
General Intelligence
: 3.4 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)34.11sResponse Time (max)34.11sResponse Time (total)34.11s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.88sResponse Time (max)15.44sResponse Time (total)19.76s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.89sResponse Time (max)31.99sResponse Time (total)53.68s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.60sResponse Time (max)4.60sResponse Time (total)4.60s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)52.87sResponse Time (max)52.87sResponse Time (total)52.87s
A test is fully passed only if every run passed for that test.Wrong answer: 7No answer: 3Invalid tool call: 1Response Time (avg)70.10sResponse Time (max)364.99sResponse Time (total)1542.14s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.40sResponse Time (max)45.73sResponse Time (total)53.58s
Coding
: 4.0 A test is fully passed only if every run passed for that test.No answer: 2Wrong answer: 1Response Time (avg)206.21sResponse Time (max)364.99sResponse Time (total)618.64s
Combined
: 8.7 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)41.23sResponse Time (max)69.44sResponse Time (total)82.45s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.72sResponse Time (max)24.97sResponse Time (total)29.43s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)189.35sResponse Time (max)261.94sResponse Time (total)568.04s
General Intelligence
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.17sResponse Time (max)4.17sResponse Time (total)4.17s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.52sResponse Time (max)1.89sResponse Time (total)3.03s
Puzzle Solving
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)10.22sResponse Time (max)23.65sResponse Time (total)30.66s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.79sResponse Time (max)2.79sResponse Time (total)2.79s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)149.34sResponse Time (max)149.34sResponse Time (total)149.34s
Coding
: 5.7 A test is fully passed only if every run passed for that test.No answer: 1Timed out: 1Response Time (avg)214.42sResponse Time (max)406.78sResponse Time (total)643.25s
Combined
: 6.9 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)458.58sResponse Time (max)876.20sResponse Time (total)917.16s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.38sResponse Time (max)22.88sResponse Time (total)40.76s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Timed out: 2Response Time (avg)264.43sResponse Time (max)339.95sResponse Time (total)528.86s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.83sResponse Time (max)17.83sResponse Time (total)17.83s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.53sResponse Time (max)19.15sResponse Time (total)25.06s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.92sResponse Time (max)8.92sResponse Time (total)8.92s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)130.27sResponse Time (max)130.27sResponse Time (total)130.27s
A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)10.15sResponse Time (max)56.19sResponse Time (total)223.24s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.41sResponse Time (max)6.32sResponse Time (total)17.64s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.04sResponse Time (max)21.06sResponse Time (total)45.11s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.73sResponse Time (max)17.90sResponse Time (total)27.46s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.28sResponse Time (max)5.13sResponse Time (total)6.56s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)28.19sResponse Time (max)56.19sResponse Time (total)84.58s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.17sResponse Time (max)5.17sResponse Time (total)5.17s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.74sResponse Time (max)3.99sResponse Time (total)7.48s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.74sResponse Time (max)5.61sResponse Time (total)14.21s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.96sResponse Time (max)4.96sResponse Time (total)4.96s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)10.06sResponse Time (max)10.06sResponse Time (total)10.06s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)35.07sResponse Time (max)82.43sResponse Time (total)140.28s
Coding
: 6.2 A test is fully passed only if every run passed for that test.API error: 1Did not follow instructions: 1Response Time (avg)266.74sResponse Time (max)443.32sResponse Time (total)800.23s
Combined
: 7.3 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)144.87sResponse Time (max)236.85sResponse Time (total)289.75s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.28sResponse Time (max)34.05sResponse Time (total)48.55s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)419.73sResponse Time (max)675.30sResponse Time (total)1259.19s
General Intelligence
: 4.6 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)36.45sResponse Time (max)36.45sResponse Time (total)36.45s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.26sResponse Time (max)19.26sResponse Time (total)22.53s
Puzzle Solving
: 7.8 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)15.91sResponse Time (max)17.11sResponse Time (total)47.73s
Tool Calling
: 4.7 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)35.09sResponse Time (max)35.09sResponse Time (total)35.09s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)52.23sResponse Time (max)52.23sResponse Time (total)52.23s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.49sResponse Time (max)20.83sResponse Time (total)52.46s
Combined
: 8.5 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)24.89sResponse Time (max)34.10sResponse Time (total)49.78s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.42sResponse Time (max)7.81sResponse Time (total)12.83s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)77.22sResponse Time (max)142.49sResponse Time (total)231.67s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.40sResponse Time (max)5.65sResponse Time (total)8.79s
Puzzle Solving
: 8.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)9.45sResponse Time (max)18.47sResponse Time (total)28.34s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.89sResponse Time (max)3.89sResponse Time (total)3.89s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)12.79sResponse Time (max)12.79sResponse Time (total)12.79s
A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)20.62sResponse Time (max)88.68sResponse Time (total)329.94s…
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.90sResponse Time (max)9.52sResponse Time (total)15.80s
Coding
: 7.9 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)40.17sResponse Time (max)88.68sResponse Time (total)120.52s
Combined
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)40.39sResponse Time (max)40.61sResponse Time (total)80.77s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.72sResponse Time (max)7.72sResponse Time (total)7.72s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)20.29sResponse Time (max)32.73sResponse Time (total)40.59s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.77sResponse Time (max)11.77sResponse Time (total)11.77s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.56sResponse Time (max)9.56sResponse Time (total)9.56s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.90sResponse Time (max)8.49sResponse Time (total)13.79s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.15sResponse Time (max)23.15sResponse Time (total)23.15s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.27sResponse Time (max)6.27sResponse Time (total)6.27s
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.