A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.58sResponse Time (max)13.58sResponse Time (total)13.58s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Coding
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Domain specific
: 3.3 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.58sResponse Time (max)13.58sResponse Time (total)13.58s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Puzzle Solving
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
~$0.001Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.0021 h × 0.377 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.000263.
363ms…
A test is fully passed only if every run passed for that test.Wrong answer: 5Did not follow instructions: 1Response Time (avg)363msResponse Time (max)1.24sResponse Time (total)2.54s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 2.5 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)73msResponse Time (max)73msResponse Time (total)73ms
Coding
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)880msResponse Time (max)1.24sResponse Time (total)1.76s
Domain specific
: 2.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)80msResponse Time (max)91msResponse Time (total)160ms
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)469msResponse Time (max)469msResponse Time (total)469ms
Puzzle Solving
: 1.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)79msResponse Time (max)79msResponse Time (total)79ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)498msResponse Time (max)602msResponse Time (total)3.49s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 2.5 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)602msResponse Time (max)602msResponse Time (total)602ms
Coding
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)509msResponse Time (max)563msResponse Time (total)1.02s
Domain specific
: 6.7 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)440msResponse Time (max)491msResponse Time (total)879ms
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)555msResponse Time (max)555msResponse Time (total)555ms
Puzzle Solving
: 1.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)432msResponse Time (max)432msResponse Time (total)432ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 5Response Time (avg)6.01sResponse Time (max)13.10sResponse Time (total)42.05s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 0.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.41sResponse Time (max)2.41sResponse Time (total)2.41s
Coding
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 3.7 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)5.00sResponse Time (max)6.86sResponse Time (total)10.00s
Domain specific
: 4.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.26sResponse Time (max)13.10sResponse Time (total)14.52s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 5.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.66sResponse Time (max)11.66sResponse Time (total)11.66s
Puzzle Solving
: 1.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.47sResponse Time (max)3.47sResponse Time (total)3.47s
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 11Response Time (avg)982msResponse Time (max)1.41sResponse Time (total)11.78s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 4.4 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)992msResponse Time (max)1.41sResponse Time (total)2.98s
Coding
: 2.2 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)857msResponse Time (max)898msResponse Time (total)1.71s
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.16sResponse Time (max)1.21sResponse Time (total)2.33s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.03sResponse Time (max)1.10sResponse Time (total)3.10s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)997msResponse Time (max)997msResponse Time (total)997ms
Puzzle Solving
: 1.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)669msResponse Time (max)669msResponse Time (total)669ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)1.33sResponse Time (max)1.66sResponse Time (total)9.32s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 0.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.13sResponse Time (max)1.13sResponse Time (total)1.13s
Coding
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.33sResponse Time (max)1.57sResponse Time (total)2.66s
Domain specific
: 4.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.11sResponse Time (max)1.31sResponse Time (total)2.21s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.66sResponse Time (max)1.66sResponse Time (total)1.66s
Puzzle Solving
: 1.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.66sResponse Time (max)1.66sResponse Time (total)1.66s
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 2.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)471msResponse Time (max)872msResponse Time (total)1.41s
Coding
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 1.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)714msResponse Time (max)987msResponse Time (total)1.43s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)287msResponse Time (max)334msResponse Time (total)860ms
Instructions following
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)752msResponse Time (max)1.22sResponse Time (total)1.50s
Puzzle Solving
: 3.8 A test is fully passed only if every run passed for that test.Wrong answer: 2API error: 1Response Time (avg)1.78sResponse Time (max)3.15sResponse Time (total)5.34s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)52.45sResponse Time (max)52.45sResponse Time (total)52.45s…
Agentic
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)52.45sResponse Time (max)52.45sResponse Time (total)52.45s
Anti-AI Tricks
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Coding
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Domain specific
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Puzzle Solving
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 10Response Time (avg)508msResponse Time (max)820msResponse Time (total)6.10s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)431msResponse Time (max)505msResponse Time (total)1.29s
Coding
: 2.2 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)456msResponse Time (max)577msResponse Time (total)911ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)418msResponse Time (max)518msResponse Time (total)836ms
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)555msResponse Time (max)589msResponse Time (total)1.66s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)820msResponse Time (max)820msResponse Time (total)820ms
Puzzle Solving
: 1.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)570msResponse Time (max)570msResponse Time (total)570ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 9Response Time (avg)462msResponse Time (max)661msResponse Time (total)5.55s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)466msResponse Time (max)486msResponse Time (total)1.40s
Coding
: 2.2 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)438msResponse Time (max)458msResponse Time (total)876ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)422msResponse Time (max)642msResponse Time (total)844ms
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)527msResponse Time (max)661msResponse Time (total)1.58s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)424msResponse Time (max)424msResponse Time (total)424ms
Puzzle Solving
: 1.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)424msResponse Time (max)424msResponse Time (total)424ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)34.99sResponse Time (max)109.60sResponse Time (total)139.95s
Coding
: 1.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 1.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 1.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Domain specific
: 3.3 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)34.54sResponse Time (max)34.54sResponse Time (total)34.54s
Instructions following
: 5.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.30sResponse Time (max)9.30sResponse Time (total)9.30s
Puzzle Solving
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)114.12sResponse Time (max)114.12sResponse Time (total)114.12s
A test is fully passed only if every run passed for that test.Wrong answer: 9Did not follow instructions: 1Response Time (avg)880msResponse Time (max)1.31sResponse Time (total)10.56s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)861msResponse Time (max)1.12sResponse Time (total)2.58s
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.06sResponse Time (max)1.18sResponse Time (total)2.11s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.05sResponse Time (max)1.31sResponse Time (total)3.16s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)904msResponse Time (max)904msResponse Time (total)904ms
Puzzle Solving
: 1.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)572msResponse Time (max)572msResponse Time (total)572ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 8API error: 1Response Time (avg)4.58sResponse Time (max)13.35sResponse Time (total)55.01s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.69sResponse Time (max)4.83sResponse Time (total)11.08s
Coding
: 2.7 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)12.73sResponse Time (max)13.35sResponse Time (total)25.46s
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.10sResponse Time (max)6.24sResponse Time (total)8.21s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.54sResponse Time (max)1.84sResponse Time (total)4.63s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.26sResponse Time (max)4.26sResponse Time (total)4.26s
Puzzle Solving
: 1.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.37sResponse Time (max)1.37sResponse Time (total)1.37s
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 7Did not follow instructions: 1Response Time (avg)377msResponse Time (max)546msResponse Time (total)4.52s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)300msResponse Time (max)347msResponse Time (total)900ms
Coding
: 2.7 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)403msResponse Time (max)478msResponse Time (total)805ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)335msResponse Time (max)350msResponse Time (total)669ms
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)444msResponse Time (max)546msResponse Time (total)1.33s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)543msResponse Time (max)543msResponse Time (total)543ms
Puzzle Solving
: 1.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)270msResponse Time (max)270msResponse Time (total)270ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 9Response Time (avg)5.63sResponse Time (max)17.79sResponse Time (total)67.61s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 2.3 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)3.65sResponse Time (max)9.32sResponse Time (total)10.95s
Coding
: 4.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)771msResponse Time (max)954msResponse Time (total)1.54s
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)9.09sResponse Time (max)17.37sResponse Time (total)18.18s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)6.34sResponse Time (max)17.79sResponse Time (total)19.02s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)17.27sResponse Time (max)17.27sResponse Time (total)17.27s
Puzzle Solving
: 2.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)646msResponse Time (max)646msResponse Time (total)646ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 8Did not follow instructions: 1Response Time (avg)495msResponse Time (max)842msResponse Time (total)5.94s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 2.3 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)436msResponse Time (max)476msResponse Time (total)1.31s
Coding
: 2.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)447msResponse Time (max)454msResponse Time (total)894ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)411msResponse Time (max)431msResponse Time (total)822ms
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)554msResponse Time (max)683msResponse Time (total)1.66s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)842msResponse Time (max)842msResponse Time (total)842ms
Puzzle Solving
: 1.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)414msResponse Time (max)414msResponse Time (total)414ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 8Response Time (avg)986msResponse Time (max)1.38sResponse Time (total)11.84s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)871msResponse Time (max)1.23sResponse Time (total)2.61s
Coding
: 4.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)794msResponse Time (max)930msResponse Time (total)1.59s
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.10sResponse Time (max)1.19sResponse Time (total)2.20s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.09sResponse Time (max)1.38sResponse Time (total)3.26s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.33sResponse Time (max)1.33sResponse Time (total)1.33s
Puzzle Solving
: 1.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)850msResponse Time (max)850msResponse Time (total)850ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 8Response Time (avg)320msResponse Time (max)491msResponse Time (total)3.84s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)321msResponse Time (max)491msResponse Time (total)964ms
Coding
: 4.9 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)305msResponse Time (max)356msResponse Time (total)610ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)286msResponse Time (max)316msResponse Time (total)572ms
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)313msResponse Time (max)352msResponse Time (total)939ms
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)333msResponse Time (max)333msResponse Time (total)333ms
Puzzle Solving
: 1.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)422msResponse Time (max)422msResponse Time (total)422ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 5.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)491msResponse Time (max)496msResponse Time (total)1.47s
Coding
: 4.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)572msResponse Time (max)575msResponse Time (total)1.14s
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)482msResponse Time (max)521msResponse Time (total)964ms
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)541msResponse Time (max)776msResponse Time (total)1.62s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)508msResponse Time (max)508msResponse Time (total)508ms
Puzzle Solving
: 1.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)490msResponse Time (max)490msResponse Time (total)490ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 6Response Time (avg)698msResponse Time (max)1.08sResponse Time (total)8.38s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)853msResponse Time (max)1.08sResponse Time (total)2.56s
Coding
: 2.2 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)598msResponse Time (max)658msResponse Time (total)1.20s
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)799msResponse Time (max)844msResponse Time (total)1.60s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)632msResponse Time (max)681msResponse Time (total)1.90s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)557msResponse Time (max)557msResponse Time (total)557ms
Puzzle Solving
: 3.3 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)573msResponse Time (max)573msResponse Time (total)573ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 2API error: 1Response Time (avg)584msResponse Time (max)772msResponse Time (total)1.75s
Coding
: 3.3 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.27sResponse Time (max)1.27sResponse Time (total)1.27s
Combined
: 1.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 3.8 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.42sResponse Time (max)2.21sResponse Time (total)2.84s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)489msResponse Time (max)513msResponse Time (total)1.47s
General Intelligence
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 7Did not follow instructions: 1Response Time (avg)531msResponse Time (max)697msResponse Time (total)6.38s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)432msResponse Time (max)618msResponse Time (total)1.30s
Coding
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)561msResponse Time (max)586msResponse Time (total)1.12s
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)587msResponse Time (max)697msResponse Time (total)1.17s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)576msResponse Time (max)672msResponse Time (total)1.73s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)571msResponse Time (max)571msResponse Time (total)571ms
Puzzle Solving
: 1.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)485msResponse Time (max)485msResponse Time (total)485ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 6.4 A test is fully passed only if every run passed for that test.API error: 1Wrong answer: 1Response Time (avg)1.20sResponse Time (max)1.48sResponse Time (total)3.59s
Coding
: 1.1 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)38.09sResponse Time (max)38.09sResponse Time (total)38.09s
Combined
: 1.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.72sResponse Time (max)3.88sResponse Time (total)5.43s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2No answer: 1Response Time (avg)56.67sResponse Time (max)147.45sResponse Time (total)170.02s
General Intelligence
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Puzzle Solving
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2API error: 1Response Time (avg)1.40sResponse Time (max)1.57sResponse Time (total)2.79s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 6Response Time (avg)1.36sResponse Time (max)5.71sResponse Time (total)16.37s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 5.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.38sResponse Time (max)5.71sResponse Time (total)7.13s
Coding
: 4.9 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)544msResponse Time (max)565msResponse Time (total)1.09s
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)710msResponse Time (max)731msResponse Time (total)1.42s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.24sResponse Time (max)2.53sResponse Time (total)3.73s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 5.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.30sResponse Time (max)2.30sResponse Time (total)2.30s
Puzzle Solving
: 1.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)708msResponse Time (max)708msResponse Time (total)708ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.API error: 22Wrong answer: 1Response Time (avg)92.50sResponse Time (max)128.54sResponse Time (total)2127.40s…
Agentic
: 2.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)128.54sResponse Time (max)128.54sResponse Time (total)128.54s
Anti-AI Tricks
: 3.0 A test is fully passed only if every run passed for that test.API error: 4Response Time (avg)87.46sResponse Time (max)103.34sResponse Time (total)349.85s
Coding
: 3.0 A test is fully passed only if every run passed for that test.API error: 3Response Time (avg)86.43sResponse Time (max)92.24sResponse Time (total)259.28s
Combined
: 3.0 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)83.53sResponse Time (max)90.11sResponse Time (total)167.05s
Data parsing and extraction
: 3.0 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)85.39sResponse Time (max)99.05sResponse Time (total)170.77s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.API error: 3Response Time (avg)82.74sResponse Time (max)103.01sResponse Time (total)248.23s
General Intelligence
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)101.81sResponse Time (max)101.81sResponse Time (total)101.81s
Instructions following
: 3.0 A test is fully passed only if every run passed for that test.API error: 2Response Time (avg)105.69sResponse Time (max)116.28sResponse Time (total)211.38s
Puzzle Solving
: 3.0 A test is fully passed only if every run passed for that test.API error: 3Response Time (avg)95.76sResponse Time (max)102.09sResponse Time (total)287.28s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)99.68sResponse Time (max)99.68sResponse Time (total)99.68s
Trivia
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)103.52sResponse Time (max)103.52sResponse Time (total)103.52s
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.