A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)6.24sResponse Time (max)58.75sResponse Time (total)143.56s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)58.75sResponse Time (max)58.75sResponse Time (total)58.75s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.54sResponse Time (max)1.76sResponse Time (total)6.17s
Coding
: 7.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.20sResponse Time (max)11.25sResponse Time (total)18.59s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.00sResponse Time (max)19.44sResponse Time (total)26.00s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.15sResponse Time (max)2.17sResponse Time (total)4.29s
Domain specific
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.09sResponse Time (max)3.60sResponse Time (total)9.26s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.76sResponse Time (max)2.76sResponse Time (total)2.76s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.47sResponse Time (max)2.82sResponse Time (total)4.94s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.92sResponse Time (max)2.35sResponse Time (total)5.77s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.10sResponse Time (max)4.10sResponse Time (total)4.10s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.92sResponse Time (max)2.92sResponse Time (total)2.92s
A test is fully passed only if every run passed for that test.Wrong answer: 2Extra formatting: 1No answer: 1Response Time (avg)25.31sResponse Time (max)159.01sResponse Time (total)582.11s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)86.99sResponse Time (max)86.99sResponse Time (total)86.99s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.91sResponse Time (max)10.95sResponse Time (total)23.66s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.73sResponse Time (max)15.75sResponse Time (total)38.19s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)31.11sResponse Time (max)42.48sResponse Time (total)62.21s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.22sResponse Time (max)4.27sResponse Time (total)8.43s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Extra formatting: 1Response Time (avg)104.24sResponse Time (max)159.01sResponse Time (total)312.73s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.79sResponse Time (max)3.79sResponse Time (total)3.79s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.78sResponse Time (max)4.91sResponse Time (total)9.56s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.66sResponse Time (max)5.51sResponse Time (total)13.97s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.44sResponse Time (max)8.44sResponse Time (total)8.44s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)14.14sResponse Time (max)14.14sResponse Time (total)14.14s
A test is fully passed only if every run passed for that test.Wrong answer: 3No answer: 1Response Time (avg)13.24sResponse Time (max)78.80sResponse Time (total)304.46s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)78.80sResponse Time (max)78.80sResponse Time (total)78.80s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.46sResponse Time (max)9.44sResponse Time (total)21.82s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.56sResponse Time (max)13.54sResponse Time (total)28.69s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.89sResponse Time (max)35.05sResponse Time (total)47.78s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.92sResponse Time (max)4.28sResponse Time (total)7.83s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)26.35sResponse Time (max)35.43sResponse Time (total)79.04s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.56sResponse Time (max)3.56sResponse Time (total)3.56s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.16sResponse Time (max)4.89sResponse Time (total)8.32s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.27sResponse Time (max)5.00sResponse Time (total)12.82s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.76sResponse Time (max)8.76sResponse Time (total)8.76s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)7.03sResponse Time (max)7.03sResponse Time (total)7.03s
A test is fully passed only if every run passed for that test.Wrong answer: 3No answer: 2Response Time (avg)161.25sResponse Time (max)739.98sResponse Time (total)3708.70s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)102.83sResponse Time (max)102.83sResponse Time (total)102.83s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)34.78sResponse Time (max)49.10sResponse Time (total)139.11s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)360.85sResponse Time (max)496.34sResponse Time (total)1082.55s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)359.97sResponse Time (max)433.13sResponse Time (total)719.94s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)34.55sResponse Time (max)51.05sResponse Time (total)69.10s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.No answer: 2Wrong answer: 1Response Time (avg)424.53sResponse Time (max)739.98sResponse Time (total)1273.59s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)41.83sResponse Time (max)41.83sResponse Time (total)41.83s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.05sResponse Time (max)5.90sResponse Time (total)10.09s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.45sResponse Time (max)45.04sResponse Time (total)70.36s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.40sResponse Time (max)27.40sResponse Time (total)27.40s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)171.92sResponse Time (max)171.92sResponse Time (total)171.92s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)50.14sResponse Time (max)50.14sResponse Time (total)50.14s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)252.99sResponse Time (max)960.01sResponse Time (total)1011.96s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)33.49sResponse Time (max)79.41sResponse Time (total)100.47s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)111.75sResponse Time (max)191.35sResponse Time (total)223.49s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.72sResponse Time (max)27.84sResponse Time (total)29.44s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 2Timed out: 1Response Time (avg)412.11sResponse Time (max)730.94sResponse Time (total)1236.34s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.35sResponse Time (max)8.35sResponse Time (total)8.35s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)28.50sResponse Time (max)38.63sResponse Time (total)57.00s
Puzzle Solving
: 7.9 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)145.68sResponse Time (max)407.90sResponse Time (total)437.03s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.65sResponse Time (max)10.65sResponse Time (total)10.65s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)330.14sResponse Time (max)330.14sResponse Time (total)330.14s
A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)25.85sResponse Time (max)90.20sResponse Time (total)594.63s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)62.59sResponse Time (max)62.59sResponse Time (total)62.59s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.42sResponse Time (max)21.36sResponse Time (total)49.67s
Coding
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)13.50sResponse Time (max)24.19sResponse Time (total)40.50s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)55.69sResponse Time (max)90.20sResponse Time (total)111.37s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.65sResponse Time (max)17.96sResponse Time (total)25.31s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)21.35sResponse Time (max)31.14sResponse Time (total)64.05s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.17sResponse Time (max)6.17sResponse Time (total)6.17s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)21.33sResponse Time (max)22.80sResponse Time (total)42.66s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)30.12sResponse Time (max)32.93sResponse Time (total)90.36s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)74.20sResponse Time (max)74.20sResponse Time (total)74.20s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)27.75sResponse Time (max)27.75sResponse Time (total)27.75s
A test is fully passed only if every run passed for that test.API error: 4Wrong answer: 2Response Time (avg)21.58sResponse Time (max)162.73sResponse Time (total)496.40s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)46.05sResponse Time (max)46.05sResponse Time (total)46.05s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)4.84sResponse Time (max)9.81sResponse Time (total)19.36s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)26.87sResponse Time (max)35.98sResponse Time (total)80.62s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)28.23sResponse Time (max)35.12sResponse Time (total)56.46s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.12sResponse Time (max)7.58sResponse Time (total)12.23s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)70.72sResponse Time (max)162.73sResponse Time (total)212.15s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.32sResponse Time (max)7.32sResponse Time (total)7.32s
Instructions following
: 6.6 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)3.88sResponse Time (max)4.42sResponse Time (total)7.77s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)9.63sResponse Time (max)16.54sResponse Time (total)28.88s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.26sResponse Time (max)9.26sResponse Time (total)9.26s
Trivia
: 4.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)16.33sResponse Time (max)16.33sResponse Time (total)16.33s
A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)39.86sResponse Time (max)332.10sResponse Time (total)916.82s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)59.39sResponse Time (max)59.39sResponse Time (total)59.39s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.66sResponse Time (max)6.74sResponse Time (total)18.65s
Coding
: 8.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)59.77sResponse Time (max)130.26sResponse Time (total)179.30s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)33.52sResponse Time (max)47.74sResponse Time (total)67.03s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.18sResponse Time (max)4.35sResponse Time (total)8.36s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)168.16sResponse Time (max)332.10sResponse Time (total)504.49s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.16sResponse Time (max)4.16sResponse Time (total)4.16s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.36sResponse Time (max)3.46sResponse Time (total)6.73s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.76sResponse Time (max)10.54sResponse Time (total)20.28s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.57sResponse Time (max)10.57sResponse Time (total)10.57s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)37.86sResponse Time (max)37.86sResponse Time (total)37.86s
A test is fully passed only if every run passed for that test.No answer: 3Did not follow instructions: 2Response Time (avg)84.26sResponse Time (max)488.39sResponse Time (total)1937.91s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)111.06sResponse Time (max)111.06sResponse Time (total)111.06s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.39sResponse Time (max)6.51sResponse Time (total)21.56s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)55.26sResponse Time (max)85.23sResponse Time (total)165.77s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)113.57sResponse Time (max)163.26sResponse Time (total)227.14s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)16.07sResponse Time (max)26.73sResponse Time (total)32.15s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.No answer: 2Response Time (avg)401.38sResponse Time (max)488.39sResponse Time (total)1204.15s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.17sResponse Time (max)7.19sResponse Time (total)18.52s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)41.40sResponse Time (max)41.40sResponse Time (total)41.40s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)47.01sResponse Time (max)47.01sResponse Time (total)47.01s
A test is fully passed only if every run passed for that test.Wrong answer: 4Invalid tool call: 1Response Time (avg)27.34sResponse Time (max)126.60sResponse Time (total)628.75s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)115.27sResponse Time (max)115.27sResponse Time (total)115.27s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.17sResponse Time (max)6.30sResponse Time (total)16.69s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)41.35sResponse Time (max)74.36sResponse Time (total)124.04s
Combined
: 8.7 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)91.25sResponse Time (max)126.60sResponse Time (total)182.50s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.72sResponse Time (max)9.59sResponse Time (total)17.44s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)41.77sResponse Time (max)49.58sResponse Time (total)125.30s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.41sResponse Time (max)6.41sResponse Time (total)6.41s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.49sResponse Time (max)4.45sResponse Time (total)6.98s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.93sResponse Time (max)6.68sResponse Time (total)14.79s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.83sResponse Time (max)7.83sResponse Time (total)7.83s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)11.49sResponse Time (max)11.49sResponse Time (total)11.49s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)46.67sResponse Time (max)46.67sResponse Time (total)46.67s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.02sResponse Time (max)3.82sResponse Time (total)8.08s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.01sResponse Time (max)49.86sResponse Time (total)81.03s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)18.73sResponse Time (max)30.18sResponse Time (total)37.45s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.71sResponse Time (max)1.78sResponse Time (total)3.43s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)174.63sResponse Time (max)443.63sResponse Time (total)523.89s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.25sResponse Time (max)2.25sResponse Time (total)2.25s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.25sResponse Time (max)1.30sResponse Time (total)2.51s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.92sResponse Time (max)1.92sResponse Time (total)1.92s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)33.79sResponse Time (max)33.79sResponse Time (total)33.79s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)197.08sResponse Time (max)197.08sResponse Time (total)197.08s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.86sResponse Time (max)43.91sResponse Time (total)63.42s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)253.22sResponse Time (max)465.35sResponse Time (total)759.66s
Combined
: 8.7 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)110.39sResponse Time (max)193.76sResponse Time (total)220.77s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)16.37sResponse Time (max)21.48sResponse Time (total)32.74s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)658.46sResponse Time (max)912.78sResponse Time (total)1975.38s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.55sResponse Time (max)8.10sResponse Time (total)15.11s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)134.14sResponse Time (max)355.52sResponse Time (total)402.43s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.21sResponse Time (max)5.21sResponse Time (total)5.21s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)532.59sResponse Time (max)532.59sResponse Time (total)532.59s
A test is fully passed only if every run passed for that test.Wrong answer: 4Did not follow instructions: 2Response Time (avg)18.87sResponse Time (max)100.93sResponse Time (total)433.94s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)61.91sResponse Time (max)61.91sResponse Time (total)61.91s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.16sResponse Time (max)6.68sResponse Time (total)16.63s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)19.50sResponse Time (max)27.96sResponse Time (total)58.49s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)26.04sResponse Time (max)32.53sResponse Time (total)52.08s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.07sResponse Time (max)3.59sResponse Time (total)6.15s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)63.93sResponse Time (max)100.93sResponse Time (total)191.78s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.04sResponse Time (max)3.44sResponse Time (total)6.07s
Puzzle Solving
: 9.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)5.05sResponse Time (max)8.73sResponse Time (total)15.15s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.37sResponse Time (max)6.37sResponse Time (total)6.37s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)14.43sResponse Time (max)14.43sResponse Time (total)14.43s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)62.72sResponse Time (max)62.72sResponse Time (total)62.72s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.88sResponse Time (max)3.40sResponse Time (total)11.53s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.13sResponse Time (max)19.82sResponse Time (total)39.38s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)38.95sResponse Time (max)55.34sResponse Time (total)77.89s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.65sResponse Time (max)3.86sResponse Time (total)7.30s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)47.83sResponse Time (max)92.74sResponse Time (total)143.50s
General Intelligence
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)9.80sResponse Time (max)9.80sResponse Time (total)9.80s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.34sResponse Time (max)3.64sResponse Time (total)6.68s
Puzzle Solving
: 7.6 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)3.80sResponse Time (max)5.83sResponse Time (total)11.40s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.42sResponse Time (max)6.42sResponse Time (total)6.42s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)4.79sResponse Time (max)4.79sResponse Time (total)4.79s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)61.28sResponse Time (max)61.28sResponse Time (total)61.28s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.71sResponse Time (max)7.10sResponse Time (total)22.85s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)51.66sResponse Time (max)60.27sResponse Time (total)154.98s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)55.55sResponse Time (max)80.16sResponse Time (total)111.10s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.01sResponse Time (max)7.41sResponse Time (total)14.02s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)174.56sResponse Time (max)251.53sResponse Time (total)523.68s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.49sResponse Time (max)9.49sResponse Time (total)9.49s
Puzzle Solving
: 8.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)38.42sResponse Time (max)100.24sResponse Time (total)115.25s
Tool Calling
: 9.6 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)33.95sResponse Time (max)33.95sResponse Time (total)33.95s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)140.05sResponse Time (max)140.05sResponse Time (total)140.05s
A test is fully passed only if every run passed for that test.Wrong answer: 4API error: 2Response Time (avg)16.00sResponse Time (max)83.98sResponse Time (total)367.91s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)44.57sResponse Time (max)44.57sResponse Time (total)44.57s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.37sResponse Time (max)5.88sResponse Time (total)17.49s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.81sResponse Time (max)30.18sResponse Time (total)53.44s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.68sResponse Time (max)25.24sResponse Time (total)49.37s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.27sResponse Time (max)4.55sResponse Time (total)8.54s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)51.40sResponse Time (max)83.98sResponse Time (total)154.20s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.94sResponse Time (max)3.94sResponse Time (total)3.94s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)2.08sResponse Time (max)3.67sResponse Time (total)4.15s
Puzzle Solving
: 5.9 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)5.08sResponse Time (max)8.45sResponse Time (total)15.24s
Tool Calling
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.75sResponse Time (max)8.75sResponse Time (total)8.75s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)8.23sResponse Time (max)8.23sResponse Time (total)8.23s
A test is fully passed only if every run passed for that test.Wrong answer: 3Invalid tool call: 1Response Time (avg)33.47sResponse Time (max)143.33sResponse Time (total)769.84s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)76.54sResponse Time (max)76.54sResponse Time (total)76.54s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.39sResponse Time (max)6.78sResponse Time (total)25.58s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)50.12sResponse Time (max)71.69sResponse Time (total)150.35s
Combined
: 7.2 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)53.54sResponse Time (max)97.74sResponse Time (total)107.07s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.57sResponse Time (max)2.78sResponse Time (total)5.15s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)98.85sResponse Time (max)143.33sResponse Time (total)296.55s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.63sResponse Time (max)8.63sResponse Time (total)8.63s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.95sResponse Time (max)7.27sResponse Time (total)9.91s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)18.24sResponse Time (max)23.48sResponse Time (total)54.71s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.29sResponse Time (max)3.29sResponse Time (total)3.29s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)32.07sResponse Time (max)32.07sResponse Time (total)32.07s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)94.84sResponse Time (max)94.84sResponse Time (total)94.84s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)47.01sResponse Time (max)84.42sResponse Time (total)188.05s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)336.02sResponse Time (max)436.54sResponse Time (total)1008.06s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)408.85sResponse Time (max)441.41sResponse Time (total)817.69s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)33.70sResponse Time (max)50.78sResponse Time (total)67.39s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)506.22sResponse Time (max)584.71sResponse Time (total)1518.67s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.66sResponse Time (max)9.33sResponse Time (total)15.32s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.26sResponse Time (max)49.35sResponse Time (total)81.77s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)25.97sResponse Time (max)25.97sResponse Time (total)25.97s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)78.58sResponse Time (max)78.58sResponse Time (total)78.58s
A test is fully passed only if every run passed for that test.API error: 3Wrong answer: 3Response Time (avg)7.72sResponse Time (max)42.89sResponse Time (total)177.57s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)42.89sResponse Time (max)42.89sResponse Time (total)42.89s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.94sResponse Time (max)4.27sResponse Time (total)11.75s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.86sResponse Time (max)8.22sResponse Time (total)20.59s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)16.14sResponse Time (max)19.34sResponse Time (total)32.28s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.31sResponse Time (max)3.56sResponse Time (total)6.63s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)15.00sResponse Time (max)17.97sResponse Time (total)44.99s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.57sResponse Time (max)2.57sResponse Time (total)2.57s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)1.39sResponse Time (max)2.22sResponse Time (total)2.78s
Puzzle Solving
: 5.3 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)1.36sResponse Time (max)2.47sResponse Time (total)4.07s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.86sResponse Time (max)4.86sResponse Time (total)4.86s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.17sResponse Time (max)4.17sResponse Time (total)4.17s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)84.28sResponse Time (max)84.28sResponse Time (total)84.28s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)20.08sResponse Time (max)33.08sResponse Time (total)80.34s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)51.43sResponse Time (max)112.35sResponse Time (total)154.28s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)133.96sResponse Time (max)223.43sResponse Time (total)267.93s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)16.36sResponse Time (max)31.22sResponse Time (total)32.72s
General Intelligence
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.26sResponse Time (max)7.26sResponse Time (total)7.26s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.45sResponse Time (max)23.65sResponse Time (total)46.90s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)112.47sResponse Time (max)313.11sResponse Time (total)337.41s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.06sResponse Time (max)5.06sResponse Time (total)5.06s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)83.89sResponse Time (max)83.89sResponse Time (total)83.89s
A test is fully passed only if every run passed for that test.Wrong answer: 3Invalid tool call: 1Response Time (avg)7.85sResponse Time (max)53.74sResponse Time (total)180.45s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)53.74sResponse Time (max)53.74sResponse Time (total)53.74s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.52sResponse Time (max)5.40sResponse Time (total)10.08s
Coding
: 7.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.71sResponse Time (max)9.05sResponse Time (total)20.13s
Combined
: 8.2 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)29.99sResponse Time (max)53.55sResponse Time (total)59.98s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.81sResponse Time (max)2.32sResponse Time (total)3.63s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)4.89sResponse Time (max)6.40sResponse Time (total)14.68s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.27sResponse Time (max)2.27sResponse Time (total)2.27s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.86sResponse Time (max)2.10sResponse Time (total)3.73s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.35sResponse Time (max)3.25sResponse Time (total)7.06s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.27sResponse Time (max)3.27sResponse Time (total)3.27s
Trivia
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.88sResponse Time (max)1.88sResponse Time (total)1.88s
A test is fully passed only if every run passed for that test.Wrong answer: 5Response Time (avg)30.42sResponse Time (max)168.09sResponse Time (total)699.68s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)127.50sResponse Time (max)127.50sResponse Time (total)127.50s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.03sResponse Time (max)8.44sResponse Time (total)20.13s
Coding
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)45.74sResponse Time (max)71.38sResponse Time (total)137.23s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)94.38sResponse Time (max)168.09sResponse Time (total)188.77s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.54sResponse Time (max)11.98sResponse Time (total)21.08s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)49.45sResponse Time (max)72.93sResponse Time (total)148.35s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.56sResponse Time (max)7.56sResponse Time (total)7.56s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.24sResponse Time (max)4.90sResponse Time (total)8.48s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.89sResponse Time (max)7.13sResponse Time (total)17.66s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.93sResponse Time (max)5.93sResponse Time (total)5.93s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)17.01sResponse Time (max)17.01sResponse Time (total)17.01s
A test is fully passed only if every run passed for that test.Wrong answer: 4Invalid tool call: 1Response Time (avg)39.83sResponse Time (max)219.77sResponse Time (total)916.20s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)67.61sResponse Time (max)67.61sResponse Time (total)67.61s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.83sResponse Time (max)8.75sResponse Time (total)23.33s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)41.14sResponse Time (max)51.03sResponse Time (total)123.42s
Combined
: 7.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)34.71sResponse Time (max)50.45sResponse Time (total)69.41s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.75sResponse Time (max)12.36sResponse Time (total)17.50s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)132.33sResponse Time (max)219.77sResponse Time (total)397.00s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.95sResponse Time (max)7.95sResponse Time (total)7.95s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.49sResponse Time (max)11.42sResponse Time (total)20.99s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)25.03sResponse Time (max)61.30sResponse Time (total)75.09s
Tool Calling
: 9.6 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)28.30sResponse Time (max)28.30sResponse Time (total)28.30s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)85.61sResponse Time (max)85.61sResponse Time (total)85.61s
A test is fully passed only if every run passed for that test.Wrong answer: 5Response Time (avg)11.92sResponse Time (max)53.09sResponse Time (total)274.14s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)53.09sResponse Time (max)53.09sResponse Time (total)53.09s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.96sResponse Time (max)5.00sResponse Time (total)11.83s
Coding
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)16.58sResponse Time (max)28.69sResponse Time (total)49.74s
Combined
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.90sResponse Time (max)34.63sResponse Time (total)55.80s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.17sResponse Time (max)3.27sResponse Time (total)6.35s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)23.14sResponse Time (max)36.22sResponse Time (total)69.43s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.10sResponse Time (max)3.10sResponse Time (total)3.10s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.16sResponse Time (max)2.17sResponse Time (total)4.31s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.09sResponse Time (max)2.91sResponse Time (total)6.26s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.55sResponse Time (max)4.55sResponse Time (total)4.55s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)9.68sResponse Time (max)9.68sResponse Time (total)9.68s
A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)6.63sResponse Time (max)62.49sResponse Time (total)152.50s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)62.49sResponse Time (max)62.49sResponse Time (total)62.49s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.29sResponse Time (max)2.70sResponse Time (total)9.17s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.86sResponse Time (max)8.35sResponse Time (total)14.59s
Combined
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)15.06sResponse Time (max)22.25sResponse Time (total)30.12s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.39sResponse Time (max)2.57sResponse Time (total)4.77s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)2.44sResponse Time (max)3.71sResponse Time (total)7.33s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.40sResponse Time (max)2.40sResponse Time (total)2.40s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.71sResponse Time (max)2.99sResponse Time (total)5.42s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.10sResponse Time (max)2.19sResponse Time (total)6.29s
Tool Calling
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.01sResponse Time (max)8.01sResponse Time (total)8.01s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.91sResponse Time (max)1.91sResponse Time (total)1.91s
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.