Agentic
: 6.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)174.08sResponse Time (max)174.08sResponse Time (total)174.08s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.65sResponse Time (max)13.92sResponse Time (total)38.61s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)455.00sResponse Time (max)493.86sResponse Time (total)1364.99s
Combined
: 7.3 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)151.04sResponse Time (max)195.58sResponse Time (total)302.08s
Data parsing and extraction
: 6.3 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)10.63sResponse Time (max)18.16sResponse Time (total)21.27s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Timed out: 1Response Time (avg)390.56sResponse Time (max)939.52sResponse Time (total)1171.67s
General Intelligence
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)16.35sResponse Time (max)16.35sResponse Time (total)16.35s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.38sResponse Time (max)8.27sResponse Time (total)14.75s
Puzzle Solving
: 5.4 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)8.84sResponse Time (max)14.18sResponse Time (total)26.51s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.67sResponse Time (max)10.67sResponse Time (total)10.67s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)191.19sResponse Time (max)191.19sResponse Time (total)191.19s
Agentic
: 6.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)345.38sResponse Time (max)345.38sResponse Time (total)345.38s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)40.16sResponse Time (max)75.92sResponse Time (total)160.66s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)259.63sResponse Time (max)429.18sResponse Time (total)778.90s
Combined
: 6.3 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)358.12sResponse Time (max)640.89sResponse Time (total)716.24s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)62.38sResponse Time (max)70.74sResponse Time (total)124.76s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)279.04sResponse Time (max)538.60sResponse Time (total)837.12s
General Intelligence
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)61.21sResponse Time (max)61.21sResponse Time (total)61.21s
Puzzle Solving
: 9.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)42.14sResponse Time (max)60.06sResponse Time (total)126.43s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.12sResponse Time (max)7.12sResponse Time (total)7.12s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)69.22sResponse Time (max)69.22sResponse Time (total)69.22s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)161.45sResponse Time (max)161.45sResponse Time (total)161.45s
Anti-AI Tricks
: 7.3 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)2.76sResponse Time (max)4.92sResponse Time (total)11.02s
Coding
: 8.2 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)150.44sResponse Time (max)390.15sResponse Time (total)451.33s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)50.80sResponse Time (max)77.07sResponse Time (total)101.61s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.71sResponse Time (max)3.20sResponse Time (total)5.41s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.70sResponse Time (max)5.70sResponse Time (total)5.70s
Puzzle Solving
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)92.20sResponse Time (max)266.38sResponse Time (total)276.61s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.60sResponse Time (max)3.60sResponse Time (total)3.60s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)527.13sResponse Time (max)527.13sResponse Time (total)527.13s
Agentic
: 3.9 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)399.20sResponse Time (max)399.20sResponse Time (total)399.20s
Coding
: 3.2 A test is fully passed only if every run passed for that test.Timed out: 2No answer: 1Response Time (avg)55.33sResponse Time (max)89.40sResponse Time (total)110.66s
Combined
: 2.9 A test is fully passed only if every run passed for that test.Invalid tool call: 2Response Time (avg)802.77sResponse Time (max)1539.97sResponse Time (total)1605.54s
Data parsing and extraction
: 6.3 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)1.51sResponse Time (max)1.51sResponse Time (total)1.51s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)96.74sResponse Time (max)174.55sResponse Time (total)193.47s
General Intelligence
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)18.14sResponse Time (max)18.14sResponse Time (total)18.14s
Instructions following
: 6.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.97sResponse Time (max)2.97sResponse Time (total)2.97s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.95sResponse Time (max)15.95sResponse Time (total)15.95s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)11.13sResponse Time (max)11.13sResponse Time (total)11.13s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)116.07sResponse Time (max)116.07sResponse Time (total)116.07s
Anti-AI Tricks
: 8.9 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)7.76sResponse Time (max)11.40sResponse Time (total)31.04s
Coding
: 7.8 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)505.33sResponse Time (max)656.90sResponse Time (total)1515.99s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)167.13sResponse Time (max)226.90sResponse Time (total)334.26s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 2Timed out: 1Response Time (avg)433.73sResponse Time (max)941.66sResponse Time (total)1301.18s
General Intelligence
: 5.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)17.00sResponse Time (max)17.00sResponse Time (total)17.00s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.96sResponse Time (max)7.82sResponse Time (total)13.92s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.02sResponse Time (max)10.02sResponse Time (total)10.02s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)99.44sResponse Time (max)99.44sResponse Time (total)99.44s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)50.14sResponse Time (max)50.14sResponse Time (total)50.14s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)252.99sResponse Time (max)960.01sResponse Time (total)1011.96s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)33.49sResponse Time (max)79.41sResponse Time (total)100.47s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)111.75sResponse Time (max)191.35sResponse Time (total)223.49s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.72sResponse Time (max)27.84sResponse Time (total)29.44s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 2Timed out: 1Response Time (avg)412.11sResponse Time (max)730.94sResponse Time (total)1236.34s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.35sResponse Time (max)8.35sResponse Time (total)8.35s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)28.50sResponse Time (max)38.63sResponse Time (total)57.00s
Puzzle Solving
: 7.9 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)145.68sResponse Time (max)407.90sResponse Time (total)437.03s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.65sResponse Time (max)10.65sResponse Time (total)10.65s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)330.14sResponse Time (max)330.14sResponse Time (total)330.14s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)55.73sResponse Time (max)55.73sResponse Time (total)55.73s
Anti-AI Tricks
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)14.70sResponse Time (max)47.55sResponse Time (total)58.79s
Coding
: 2.9 A test is fully passed only if every run passed for that test.No answer: 2Did not follow instructions: 1Response Time (avg)421.68sResponse Time (max)455.72sResponse Time (total)1265.05s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)115.30sResponse Time (max)205.40sResponse Time (total)230.60s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.55sResponse Time (max)8.35sResponse Time (total)13.11s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.No answer: 3Response Time (avg)333.41sResponse Time (max)384.57sResponse Time (total)1000.23s
General Intelligence
: 3.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)36.56sResponse Time (max)36.56sResponse Time (total)36.56s
Instructions following
: 7.3 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)20.53sResponse Time (max)33.28sResponse Time (total)41.06s
Puzzle Solving
: 5.8 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)143.16sResponse Time (max)415.83sResponse Time (total)429.48s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.34sResponse Time (max)4.34sResponse Time (total)4.34s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)416.44sResponse Time (max)416.44sResponse Time (total)416.44s
A test is fully passed only if every run passed for that test.Wrong answer: 3No answer: 2Response Time (avg)161.25sResponse Time (max)739.98sResponse Time (total)3708.70s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)102.83sResponse Time (max)102.83sResponse Time (total)102.83s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)34.78sResponse Time (max)49.10sResponse Time (total)139.11s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)360.85sResponse Time (max)496.34sResponse Time (total)1082.55s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)359.97sResponse Time (max)433.13sResponse Time (total)719.94s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)34.55sResponse Time (max)51.05sResponse Time (total)69.10s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.No answer: 2Wrong answer: 1Response Time (avg)424.53sResponse Time (max)739.98sResponse Time (total)1273.59s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)41.83sResponse Time (max)41.83sResponse Time (total)41.83s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.05sResponse Time (max)5.90sResponse Time (total)10.09s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.45sResponse Time (max)45.04sResponse Time (total)70.36s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.40sResponse Time (max)27.40sResponse Time (total)27.40s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)171.92sResponse Time (max)171.92sResponse Time (total)171.92s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)132.27sResponse Time (max)132.27sResponse Time (total)132.27s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.10sResponse Time (max)21.48sResponse Time (total)32.40s
Coding
: 8.1 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)248.62sResponse Time (max)458.25sResponse Time (total)745.85s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)185.57sResponse Time (max)333.21sResponse Time (total)371.15s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)34.85sResponse Time (max)57.71sResponse Time (total)69.71s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)526.74sResponse Time (max)640.85sResponse Time (total)1580.21s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.24sResponse Time (max)10.18sResponse Time (total)16.49s
Puzzle Solving
: 7.6 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)199.90sResponse Time (max)569.33sResponse Time (total)599.69s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.62sResponse Time (max)5.62sResponse Time (total)5.62s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)263.98sResponse Time (max)263.98sResponse Time (total)263.98s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)94.84sResponse Time (max)94.84sResponse Time (total)94.84s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)47.01sResponse Time (max)84.42sResponse Time (total)188.05s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)336.02sResponse Time (max)436.54sResponse Time (total)1008.06s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)408.85sResponse Time (max)441.41sResponse Time (total)817.69s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)33.70sResponse Time (max)50.78sResponse Time (total)67.39s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)506.22sResponse Time (max)584.71sResponse Time (total)1518.67s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.66sResponse Time (max)9.33sResponse Time (total)15.32s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.26sResponse Time (max)49.35sResponse Time (total)81.77s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)25.97sResponse Time (max)25.97sResponse Time (total)25.97s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)78.58sResponse Time (max)78.58sResponse Time (total)78.58s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)197.08sResponse Time (max)197.08sResponse Time (total)197.08s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.86sResponse Time (max)43.91sResponse Time (total)63.42s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)253.22sResponse Time (max)465.35sResponse Time (total)759.66s
Combined
: 8.7 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)110.39sResponse Time (max)193.76sResponse Time (total)220.77s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)16.37sResponse Time (max)21.48sResponse Time (total)32.74s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)658.46sResponse Time (max)912.78sResponse Time (total)1975.38s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.55sResponse Time (max)8.10sResponse Time (total)15.11s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)134.14sResponse Time (max)355.52sResponse Time (total)402.43s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.21sResponse Time (max)5.21sResponse Time (total)5.21s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)532.59sResponse Time (max)532.59sResponse Time (total)532.59s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)90.94sResponse Time (max)90.94sResponse Time (total)90.94s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)28.25sResponse Time (max)38.70sResponse Time (total)113.00s
Coding
: 8.2 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)354.87sResponse Time (max)449.66sResponse Time (total)1064.62s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)400.28sResponse Time (max)406.56sResponse Time (total)800.55s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)37.82sResponse Time (max)50.79sResponse Time (total)75.65s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)656.04sResponse Time (max)885.33sResponse Time (total)1968.13s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.48sResponse Time (max)9.84sResponse Time (total)14.96s
Puzzle Solving
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)21.01sResponse Time (max)31.49sResponse Time (total)63.03s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.46sResponse Time (max)27.46sResponse Time (total)27.46s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)91.00sResponse Time (max)91.00sResponse Time (total)91.00s
Agentic
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)172.16sResponse Time (max)172.16sResponse Time (total)172.16s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)40.57sResponse Time (max)110.43sResponse Time (total)121.72s
Coding
: 2.4 A test is fully passed only if every run passed for that test.No answer: 1Timed out: 1Response Time (avg)258.38sResponse Time (max)453.94sResponse Time (total)516.77s
Combined
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)813.71sResponse Time (max)1597.85sResponse Time (total)1627.41s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.01sResponse Time (max)15.01sResponse Time (total)15.01s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)311.60sResponse Time (max)452.75sResponse Time (total)623.20s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.91sResponse Time (max)11.91sResponse Time (total)11.91s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)108.45sResponse Time (max)108.45sResponse Time (total)108.45s
Agentic
: 4.7 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)52.36sResponse Time (max)52.36sResponse Time (total)52.36s
Anti-AI Tricks
: 6.0 A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)129.60sResponse Time (max)237.97sResponse Time (total)518.41s
Coding
: 5.2 A test is fully passed only if every run passed for that test.Wrong answer: 2API error: 1Response Time (avg)219.15sResponse Time (max)259.22sResponse Time (total)657.45s
Combined
: 2.9 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)139.43sResponse Time (max)171.85sResponse Time (total)278.85s
Data parsing and extraction
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)88.53sResponse Time (max)120.56sResponse Time (total)177.06s
Domain specific
: 4.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)470.24sResponse Time (max)547.52sResponse Time (total)1410.71s
General Intelligence
: 7.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)110.43sResponse Time (max)110.43sResponse Time (total)110.43s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)77.72sResponse Time (max)91.04sResponse Time (total)155.43s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)93.67sResponse Time (max)93.67sResponse Time (total)93.67s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)597.45sResponse Time (max)597.45sResponse Time (total)597.45s
Agentic
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)223.46sResponse Time (max)223.46sResponse Time (total)223.46s
Anti-AI Tricks
: 6.9 A test is fully passed only if every run passed for that test.Timed out: 2Response Time (avg)205.31sResponse Time (max)413.57sResponse Time (total)821.25s
Coding
: 3.8 A test is fully passed only if every run passed for that test.Timed out: 2Wrong answer: 1Response Time (avg)515.34sResponse Time (max)567.74sResponse Time (total)1546.02s
Combined
: 5.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Timed out: 1Response Time (avg)570.43sResponse Time (max)685.87sResponse Time (total)1140.86s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Timed out: 1Response Time (avg)167.15sResponse Time (max)183.96sResponse Time (total)501.46s
General Intelligence
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)16.37sResponse Time (max)16.37sResponse Time (total)16.37s
Instructions following
: 6.4 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)87.47sResponse Time (max)150.79sResponse Time (total)174.94s
Puzzle Solving
: 2.9 A test is fully passed only if every run passed for that test.Timed out: 2No answer: 1Response Time (avg)202.69sResponse Time (max)252.93sResponse Time (total)608.07s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.08sResponse Time (max)15.08sResponse Time (total)15.08s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)252.49sResponse Time (max)252.49sResponse Time (total)252.49s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)85.76sResponse Time (max)85.76sResponse Time (total)85.76s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)14.97sResponse Time (max)39.34sResponse Time (total)59.87s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)391.89sResponse Time (max)707.01sResponse Time (total)783.78s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)34.99sResponse Time (max)36.31sResponse Time (total)69.98s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)289.43sResponse Time (max)392.05sResponse Time (total)868.29s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)41.23sResponse Time (max)41.23sResponse Time (total)41.23s
Puzzle Solving
: 5.4 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)55.18sResponse Time (max)76.48sResponse Time (total)165.54s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.21sResponse Time (max)24.21sResponse Time (total)24.21s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)88.77sResponse Time (max)88.77sResponse Time (total)88.77s
Agentic
: 3.0 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)579.54sResponse Time (max)579.54sResponse Time (total)579.54s
Anti-AI Tricks
: 3.8 A test is fully passed only if every run passed for that test.Wrong answer: 3API error: 1Response Time (avg)145.43sResponse Time (max)435.60sResponse Time (total)581.70s
Coding
: 4.2 A test is fully passed only if every run passed for that test.Timed out: 2Wrong answer: 1Response Time (avg)798.00sResponse Time (max)960.02sResponse Time (total)2394.01s
Combined
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Timed out: 1Response Time (avg)898.87sResponse Time (max)971.85sResponse Time (total)1797.74s
Data parsing and extraction
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)147.51sResponse Time (max)252.91sResponse Time (total)295.02s
General Intelligence
: 3.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)121.15sResponse Time (max)121.15sResponse Time (total)121.15s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)56.09sResponse Time (max)56.09sResponse Time (total)56.09s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)755.91sResponse Time (max)755.91sResponse Time (total)755.91s
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.