Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)90.14sResponse Time (max)90.14sResponse Time (total)90.14s
Coding
: 7.2 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)18.23sResponse Time (max)35.23sResponse Time (total)54.68s
Combined
: 7.1 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)20.70sResponse Time (max)33.19sResponse Time (total)41.40s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.75sResponse Time (max)2.25sResponse Time (total)3.51s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)235.06sResponse Time (max)316.42sResponse Time (total)705.19s
General Intelligence
: 4.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.34sResponse Time (max)2.34sResponse Time (total)2.34s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.13sResponse Time (max)1.15sResponse Time (total)2.25s
Puzzle Solving
: 7.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)52.85sResponse Time (max)155.38sResponse Time (total)158.56s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.63sResponse Time (max)2.63sResponse Time (total)2.63s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)357.28sResponse Time (max)357.28sResponse Time (total)357.28s
Agentic
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)381msResponse Time (max)381msResponse Time (total)381ms
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.00sResponse Time (max)11.34sResponse Time (total)27.99s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)58.38sResponse Time (max)68.45sResponse Time (total)175.15s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)62.60sResponse Time (max)78.52sResponse Time (total)125.21s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.40sResponse Time (max)9.53sResponse Time (total)14.80s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.API error: 2Wrong answer: 1Response Time (avg)189.55sResponse Time (max)287.79sResponse Time (total)568.65s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.06sResponse Time (max)6.06sResponse Time (total)6.06s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)8.97sResponse Time (max)14.45sResponse Time (total)26.92s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.08sResponse Time (max)8.08sResponse Time (total)8.08s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)41.30sResponse Time (max)41.30sResponse Time (total)41.30s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)87.42sResponse Time (max)87.42sResponse Time (total)87.42s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.44sResponse Time (max)7.00sResponse Time (total)17.76s
Coding
: 8.2 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)83.41sResponse Time (max)149.10sResponse Time (total)250.23s
Combined
: 6.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)351.19sResponse Time (max)665.85sResponse Time (total)702.38s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.38sResponse Time (max)25.54sResponse Time (total)34.77s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.No answer: 3Response Time (avg)222.88sResponse Time (max)293.88sResponse Time (total)668.65s
General Intelligence
: 3.9 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.82sResponse Time (max)7.82sResponse Time (total)7.82s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.31sResponse Time (max)5.40sResponse Time (total)8.61s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)37.46sResponse Time (max)103.89sResponse Time (total)112.37s
Tool Calling
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)38.25sResponse Time (max)38.25sResponse Time (total)38.25s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)81.83sResponse Time (max)81.83sResponse Time (total)81.83s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)43.53sResponse Time (max)43.53sResponse Time (total)43.53s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.10sResponse Time (max)3.35sResponse Time (total)8.39s
Coding
: 4.5 A test is fully passed only if every run passed for that test.No answer: 2Did not follow instructions: 1Response Time (avg)196.67sResponse Time (max)241.99sResponse Time (total)590.01s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)37.28sResponse Time (max)71.21sResponse Time (total)74.56s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.20sResponse Time (max)2.32sResponse Time (total)4.40s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)186.02sResponse Time (max)440.77sResponse Time (total)558.07s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.02sResponse Time (max)2.02sResponse Time (total)2.02s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.12sResponse Time (max)1.14sResponse Time (total)2.25s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.28sResponse Time (max)2.28sResponse Time (total)2.28s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)44.26sResponse Time (max)44.26sResponse Time (total)44.26s
A test is fully passed only if every run passed for that test.Wrong answer: 6Response Time (avg)68.44sResponse Time (max)436.38sResponse Time (total)1574.14s…
Agentic
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)65.24sResponse Time (max)65.24sResponse Time (total)65.24s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.50sResponse Time (max)47.78sResponse Time (total)93.99s
Coding
: 7.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)155.69sResponse Time (max)305.49sResponse Time (total)467.06s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)29.01sResponse Time (max)42.36sResponse Time (total)58.01s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.29sResponse Time (max)6.68sResponse Time (total)12.58s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)249.34sResponse Time (max)436.38sResponse Time (total)748.02s
General Intelligence
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)12.84sResponse Time (max)12.84sResponse Time (total)12.84s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.06sResponse Time (max)7.94sResponse Time (total)12.12s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.75sResponse Time (max)12.42sResponse Time (total)23.26s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.57sResponse Time (max)6.57sResponse Time (total)6.57s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)74.44sResponse Time (max)74.44sResponse Time (total)74.44s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)40.72sResponse Time (max)40.72sResponse Time (total)40.72s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.72sResponse Time (max)4.84sResponse Time (total)14.88s
Coding
: 6.6 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)18.89sResponse Time (max)26.76sResponse Time (total)56.66s
Combined
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)63.96sResponse Time (max)97.74sResponse Time (total)127.92s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.55sResponse Time (max)4.03sResponse Time (total)7.10s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Extra formatting: 2Wrong answer: 1Response Time (avg)112.33sResponse Time (max)159.91sResponse Time (total)337.00s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.62sResponse Time (max)3.66sResponse Time (total)7.24s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.74sResponse Time (max)5.81sResponse Time (total)14.23s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.05sResponse Time (max)17.05sResponse Time (total)17.05s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)21.98sResponse Time (max)21.98sResponse Time (total)21.98s
Agentic
: 7.4 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)93.88sResponse Time (max)93.88sResponse Time (total)93.88s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)9.65sResponse Time (max)35.08sResponse Time (total)38.62s
Coding
: 8.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)27.42sResponse Time (max)60.98sResponse Time (total)82.26s
Combined
: 7.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)80.94sResponse Time (max)152.83sResponse Time (total)161.89s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.75sResponse Time (max)3.35sResponse Time (total)5.49s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)27.26sResponse Time (max)34.06sResponse Time (total)81.77s
General Intelligence
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.85sResponse Time (max)6.85sResponse Time (total)6.85s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.83sResponse Time (max)2.21sResponse Time (total)3.65s
Puzzle Solving
: 5.7 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)6.19sResponse Time (max)12.51sResponse Time (total)18.56s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.16sResponse Time (max)4.16sResponse Time (total)4.16s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)113.98sResponse Time (max)113.98sResponse Time (total)113.98s
A test is fully passed only if every run passed for that test.Wrong answer: 6Did not follow instructions: 1Response Time (avg)74.77sResponse Time (max)514.35sResponse Time (total)1719.73s…
Agentic
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)103.61sResponse Time (max)103.61sResponse Time (total)103.61s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.84sResponse Time (max)16.03sResponse Time (total)43.37s
Coding
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)120.05sResponse Time (max)183.47sResponse Time (total)360.14s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)62.66sResponse Time (max)80.72sResponse Time (total)125.33s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.46sResponse Time (max)12.31sResponse Time (total)22.92s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)304.33sResponse Time (max)514.35sResponse Time (total)912.98s
General Intelligence
: 4.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)17.27sResponse Time (max)17.27sResponse Time (total)17.27s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.75sResponse Time (max)17.51sResponse Time (total)25.51s
Puzzle Solving
: 8.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)16.30sResponse Time (max)22.22sResponse Time (total)48.89s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.83sResponse Time (max)12.83sResponse Time (total)12.83s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)46.88sResponse Time (max)46.88sResponse Time (total)46.88s
A test is fully passed only if every run passed for that test.Wrong answer: 9Did not follow instructions: 1Response Time (avg)17.80sResponse Time (max)206.03sResponse Time (total)409.51s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)143.11sResponse Time (max)143.11sResponse Time (total)143.11s
Anti-AI Tricks
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.38sResponse Time (max)2.69sResponse Time (total)5.51s
Coding
: 5.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)2.15sResponse Time (max)4.39sResponse Time (total)6.44s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)117.70sResponse Time (max)206.03sResponse Time (total)235.40s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.43sResponse Time (max)1.57sResponse Time (total)2.86s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.04sResponse Time (max)1.33sResponse Time (total)3.12s
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)929msResponse Time (max)1.05sResponse Time (total)1.86s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.71sResponse Time (max)2.65sResponse Time (total)5.13s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.54sResponse Time (max)3.54sResponse Time (total)3.54s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.21sResponse Time (max)1.21sResponse Time (total)1.21s
A test is fully passed only if every run passed for that test.Wrong answer: 7Response Time (avg)18.14sResponse Time (max)205.28sResponse Time (total)417.21s…
Agentic
: 5.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)61.53sResponse Time (max)61.53sResponse Time (total)61.53s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.75sResponse Time (max)3.42sResponse Time (total)10.99s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.72sResponse Time (max)17.72sResponse Time (total)41.16s
Combined
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)12.75sResponse Time (max)17.34sResponse Time (total)25.50s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.44sResponse Time (max)3.78sResponse Time (total)6.88s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)77.09sResponse Time (max)205.28sResponse Time (total)231.27s
General Intelligence
: 6.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.88sResponse Time (max)4.88sResponse Time (total)4.88s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.80sResponse Time (max)2.84sResponse Time (total)5.59s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.20sResponse Time (max)5.51sResponse Time (total)9.59s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.83sResponse Time (max)5.83sResponse Time (total)5.83s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)13.98sResponse Time (max)13.98sResponse Time (total)13.98s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)303.26sResponse Time (max)303.26sResponse Time (total)303.26s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)17.95sResponse Time (max)46.36sResponse Time (total)71.81s
Coding
: 6.4 A test is fully passed only if every run passed for that test.No answer: 2Response Time (avg)198.78sResponse Time (max)288.78sResponse Time (total)596.34s
Combined
: 7.3 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)150.58sResponse Time (max)270.49sResponse Time (total)301.16s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.21sResponse Time (max)5.51sResponse Time (total)10.43s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)203.11sResponse Time (max)208.43sResponse Time (total)609.33s
General Intelligence
: 6.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)12.16sResponse Time (max)12.16sResponse Time (total)12.16s
Instructions following
: 8.5 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)2.42sResponse Time (max)2.86sResponse Time (total)4.84s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)65.12sResponse Time (max)182.97sResponse Time (total)195.36s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.41sResponse Time (max)4.41sResponse Time (total)4.41s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)56.64sResponse Time (max)56.64sResponse Time (total)56.64s
A test is fully passed only if every run passed for that test.API error: 6Wrong answer: 2Response Time (avg)22.96sResponse Time (max)143.21sResponse Time (total)528.08s…
Agentic
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)461msResponse Time (max)461msResponse Time (total)461ms
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)5.93sResponse Time (max)11.89sResponse Time (total)23.71s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)36.94sResponse Time (max)49.30sResponse Time (total)110.81s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)34.90sResponse Time (max)45.19sResponse Time (total)69.81s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.09sResponse Time (max)8.39sResponse Time (total)14.18s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)78.62sResponse Time (max)143.21sResponse Time (total)235.86s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.52sResponse Time (max)5.52sResponse Time (total)5.52s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)1.97sResponse Time (max)3.43sResponse Time (total)3.93s
Puzzle Solving
: 5.3 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)3.78sResponse Time (max)10.03sResponse Time (total)11.34s
Tool Calling
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.70sResponse Time (max)23.70sResponse Time (total)23.70s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)28.77sResponse Time (max)28.77sResponse Time (total)28.77s
Agentic
: 5.2 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)82.78sResponse Time (max)82.78sResponse Time (total)82.78s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.64sResponse Time (max)3.26sResponse Time (total)10.56s
Coding
: 7.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)24.69sResponse Time (max)33.57sResponse Time (total)74.07s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)21.53sResponse Time (max)28.77sResponse Time (total)43.07s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.50sResponse Time (max)27.15sResponse Time (total)48.99s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)51.14sResponse Time (max)106.93sResponse Time (total)153.41s
General Intelligence
: 5.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)17.40sResponse Time (max)17.40sResponse Time (total)17.40s
Puzzle Solving
: 7.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.51sResponse Time (max)13.60sResponse Time (total)22.53s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.96sResponse Time (max)6.96sResponse Time (total)6.96s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.90sResponse Time (max)4.90sResponse Time (total)4.90s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)139.73sResponse Time (max)139.73sResponse Time (total)139.73s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)13.18sResponse Time (max)27.66sResponse Time (total)52.71s
Coding
: 8.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)95.97sResponse Time (max)127.91sResponse Time (total)287.92s
Combined
: 6.4 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)115.38sResponse Time (max)161.28sResponse Time (total)230.76s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)14.89sResponse Time (max)16.84sResponse Time (total)29.77s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)182.58sResponse Time (max)451.90sResponse Time (total)547.75s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.41sResponse Time (max)6.41sResponse Time (total)6.41s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)94.20sResponse Time (max)94.20sResponse Time (total)94.20s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)113.57sResponse Time (max)113.57sResponse Time (total)113.57s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.94sResponse Time (max)13.09sResponse Time (total)23.78s
Coding
: 5.9 A test is fully passed only if every run passed for that test.No answer: 2Response Time (avg)278.59sResponse Time (max)527.47sResponse Time (total)835.78s
Combined
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)112.20sResponse Time (max)162.41sResponse Time (total)224.40s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.69sResponse Time (max)7.91sResponse Time (total)13.38s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 2API error: 1Response Time (avg)196.68sResponse Time (max)270.29sResponse Time (total)590.03s
General Intelligence
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)12.72sResponse Time (max)12.72sResponse Time (total)12.72s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.34sResponse Time (max)4.66sResponse Time (total)8.68s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)11.82sResponse Time (max)28.85sResponse Time (total)35.47s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)36.33sResponse Time (max)36.33sResponse Time (total)36.33s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)59.55sResponse Time (max)59.55sResponse Time (total)59.55s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)47.70sResponse Time (max)47.70sResponse Time (total)47.70s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.36sResponse Time (max)3.39sResponse Time (total)9.44s
Coding
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)7.16sResponse Time (max)8.94sResponse Time (total)21.47s
Combined
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)20.29sResponse Time (max)26.07sResponse Time (total)40.58s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.43sResponse Time (max)3.56sResponse Time (total)6.87s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.01sResponse Time (max)3.29sResponse Time (total)6.02s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)2.67sResponse Time (max)3.28sResponse Time (total)8.01s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.02sResponse Time (max)5.02sResponse Time (total)5.02s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)3.12sResponse Time (max)3.12sResponse Time (total)3.12s
A test is fully passed only if every run passed for that test.Wrong answer: 8Timed out: 1Response Time (avg)54.06sResponse Time (max)203.01sResponse Time (total)1189.36s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)203.01sResponse Time (max)203.01sResponse Time (total)203.01s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.84sResponse Time (max)15.11sResponse Time (total)43.36s
Coding
: 6.2 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)125.25sResponse Time (max)189.38sResponse Time (total)375.76s
Combined
: 6.5 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)92.41sResponse Time (max)92.41sResponse Time (total)92.41s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)38.32sResponse Time (max)41.70sResponse Time (total)76.63s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)57.36sResponse Time (max)90.70sResponse Time (total)172.08s
General Intelligence
: 4.9 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)25.30sResponse Time (max)25.30sResponse Time (total)25.30s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.25sResponse Time (max)21.65sResponse Time (total)40.50s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)17.67sResponse Time (max)24.83sResponse Time (total)53.02s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.72sResponse Time (max)14.72sResponse Time (total)14.72s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)92.57sResponse Time (max)92.57sResponse Time (total)92.57s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)106.71sResponse Time (max)106.71sResponse Time (total)106.71s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.29sResponse Time (max)17.58sResponse Time (total)41.18s
Coding
: 6.7 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)42.36sResponse Time (max)61.83sResponse Time (total)127.09s
Combined
: 6.4 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)217.77sResponse Time (max)394.54sResponse Time (total)435.53s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.44sResponse Time (max)17.97sResponse Time (total)30.88s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)37.60sResponse Time (max)49.39sResponse Time (total)112.81s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.66sResponse Time (max)7.66sResponse Time (total)7.66s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)18.42sResponse Time (max)18.42sResponse Time (total)18.42s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)107.36sResponse Time (max)107.36sResponse Time (total)107.36s
Anti-AI Tricks
: 9.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.36sResponse Time (max)12.64sResponse Time (total)29.44s
Coding
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)33.67sResponse Time (max)43.94sResponse Time (total)101.00s
Combined
: 6.5 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)76.48sResponse Time (max)106.02sResponse Time (total)152.97s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.20sResponse Time (max)9.97sResponse Time (total)14.40s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)44.62sResponse Time (max)102.94sResponse Time (total)133.85s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.34sResponse Time (max)6.25sResponse Time (total)10.69s
Puzzle Solving
: 6.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)64.73sResponse Time (max)181.08sResponse Time (total)194.18s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.64sResponse Time (max)5.64sResponse Time (total)5.64s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)26.69sResponse Time (max)26.69sResponse Time (total)26.69s
A test is fully passed only if every run passed for that test.API error: 6Wrong answer: 3Response Time (avg)34.40sResponse Time (max)236.64sResponse Time (total)791.16s…
Agentic
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)525msResponse Time (max)525msResponse Time (total)525ms
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)6.04sResponse Time (max)13.58sResponse Time (total)24.14s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)40.90sResponse Time (max)52.61sResponse Time (total)122.71s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)51.45sResponse Time (max)55.44sResponse Time (total)102.90s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.90sResponse Time (max)9.31sResponse Time (total)13.80s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 2API error: 1Response Time (avg)150.71sResponse Time (max)236.64sResponse Time (total)452.14s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.77sResponse Time (max)5.77sResponse Time (total)5.77s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)2.64sResponse Time (max)4.79sResponse Time (total)5.27s
Puzzle Solving
: 5.3 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)3.53sResponse Time (max)9.25sResponse Time (total)10.58s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.97sResponse Time (max)27.97sResponse Time (total)27.97s
Trivia
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)25.37sResponse Time (max)25.37sResponse Time (total)25.37s
Agentic
: 4.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)159.62sResponse Time (max)159.62sResponse Time (total)159.62s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.81sResponse Time (max)2.74sResponse Time (total)7.24s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)45.53sResponse Time (max)98.91sResponse Time (total)136.59s
Combined
: 6.4 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)76.72sResponse Time (max)116.08sResponse Time (total)153.43s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.65sResponse Time (max)7.50sResponse Time (total)13.31s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)17.29sResponse Time (max)18.55sResponse Time (total)51.86s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.04sResponse Time (max)2.85sResponse Time (total)4.09s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.23sResponse Time (max)2.98sResponse Time (total)6.69s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.75sResponse Time (max)5.75sResponse Time (total)5.75s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)24.39sResponse Time (max)24.39sResponse Time (total)24.39s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)51.03sResponse Time (max)51.03sResponse Time (total)51.03s
Anti-AI Tricks
: 6.9 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)11.00sResponse Time (max)21.96sResponse Time (total)44.00s
Coding
: 6.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)15.39sResponse Time (max)23.64sResponse Time (total)46.16s
Combined
: 7.3 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)49.77sResponse Time (max)89.37sResponse Time (total)99.54s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.94sResponse Time (max)17.89sResponse Time (total)19.89s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)18.09sResponse Time (max)27.87sResponse Time (total)54.28s
General Intelligence
: 4.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.46sResponse Time (max)1.46sResponse Time (total)1.46s
Instructions following
: 7.1 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)17.38sResponse Time (max)17.50sResponse Time (total)34.76s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)27.45sResponse Time (max)30.30sResponse Time (total)82.36s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)71.65sResponse Time (max)71.65sResponse Time (total)71.65s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)29.10sResponse Time (max)29.10sResponse Time (total)29.10s
Agentic
: 6.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)211.32sResponse Time (max)211.32sResponse Time (total)211.32s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.02sResponse Time (max)5.68sResponse Time (total)12.07s
Coding
: 7.7 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)140.92sResponse Time (max)376.04sResponse Time (total)422.75s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)90.63sResponse Time (max)143.71sResponse Time (total)181.27s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.03sResponse Time (max)9.09sResponse Time (total)16.06s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)60.78sResponse Time (max)120.94sResponse Time (total)182.34s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.43sResponse Time (max)2.87sResponse Time (total)4.86s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.91sResponse Time (max)8.81sResponse Time (total)14.74s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)8.42sResponse Time (max)8.42sResponse Time (total)8.42s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)12.64sResponse Time (max)12.64sResponse Time (total)12.64s
A test is fully passed only if every run passed for that test.Wrong answer: 10Response Time (avg)29.38sResponse Time (max)234.56sResponse Time (total)675.79s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)73.43sResponse Time (max)73.43sResponse Time (total)73.43s
Anti-AI Tricks
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.48sResponse Time (max)7.38sResponse Time (total)13.91s
Coding
: 6.2 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)8.29sResponse Time (max)10.90sResponse Time (total)24.86s
Combined
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)19.30sResponse Time (max)33.65sResponse Time (total)38.60s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.91sResponse Time (max)2.40sResponse Time (total)3.82s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)85.05sResponse Time (max)133.95sResponse Time (total)255.16s
General Intelligence
: 4.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.75sResponse Time (max)4.75sResponse Time (total)4.75s
Instructions following
: 6.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.04sResponse Time (max)2.33sResponse Time (total)4.08s
Puzzle Solving
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.43sResponse Time (max)14.39sResponse Time (total)19.28s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.34sResponse Time (max)3.34sResponse Time (total)3.34s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)234.56sResponse Time (max)234.56sResponse Time (total)234.56s
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)225.59sResponse Time (max)225.59sResponse Time (total)225.59s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.31sResponse Time (max)14.20sResponse Time (total)33.24s
Combined
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)175.93sResponse Time (max)308.75sResponse Time (total)351.86s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.33sResponse Time (max)9.40sResponse Time (total)18.66s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.95sResponse Time (max)20.95sResponse Time (total)20.95s
Instructions following
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.47sResponse Time (max)10.16sResponse Time (total)14.94s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)31.64sResponse Time (max)46.04sResponse Time (total)94.91s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)29.40sResponse Time (max)29.40sResponse Time (total)29.40s
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.