A test is fully passed only if every run passed for that test.Wrong answer: 11Response Time (avg)982msResponse Time (max)1.41sResponse Time (total)11.78s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 4.4 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)992msResponse Time (max)1.41sResponse Time (total)2.98s
Coding
: 2.2 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)857msResponse Time (max)898msResponse Time (total)1.71s
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.16sResponse Time (max)1.21sResponse Time (total)2.33s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.03sResponse Time (max)1.10sResponse Time (total)3.10s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)997msResponse Time (max)997msResponse Time (total)997ms
Puzzle Solving
: 1.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)669msResponse Time (max)669msResponse Time (total)669ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 5Response Time (avg)6.01sResponse Time (max)13.10sResponse Time (total)42.05s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 0.8 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.41sResponse Time (max)2.41sResponse Time (total)2.41s
Coding
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 3.7 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)5.00sResponse Time (max)6.86sResponse Time (total)10.00s
Domain specific
: 4.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.26sResponse Time (max)13.10sResponse Time (total)14.52s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 5.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.66sResponse Time (max)11.66sResponse Time (total)11.66s
Puzzle Solving
: 1.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.47sResponse Time (max)3.47sResponse Time (total)3.47s
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 4Response Time (avg)498msResponse Time (max)602msResponse Time (total)3.49s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 2.5 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)602msResponse Time (max)602msResponse Time (total)602ms
Coding
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)509msResponse Time (max)563msResponse Time (total)1.02s
Domain specific
: 6.7 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)440msResponse Time (max)491msResponse Time (total)879ms
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)555msResponse Time (max)555msResponse Time (total)555ms
Puzzle Solving
: 1.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)432msResponse Time (max)432msResponse Time (total)432ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
~$0.001Estimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.0021 h × 0.377 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.000263.
363ms…
A test is fully passed only if every run passed for that test.Wrong answer: 5Did not follow instructions: 1Response Time (avg)363msResponse Time (max)1.24sResponse Time (total)2.54s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 2.5 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)73msResponse Time (max)73msResponse Time (total)73ms
Coding
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)880msResponse Time (max)1.24sResponse Time (total)1.76s
Domain specific
: 2.0 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)80msResponse Time (max)91msResponse Time (total)160ms
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 1.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)469msResponse Time (max)469msResponse Time (total)469ms
Puzzle Solving
: 1.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)79msResponse Time (max)79msResponse Time (total)79ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.58sResponse Time (max)13.58sResponse Time (total)13.58s…
Agentic
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Anti-AI Tricks
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Coding
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Domain specific
: 3.3 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.58sResponse Time (max)13.58sResponse Time (total)13.58s
General Intelligence
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Puzzle Solving
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Tool Calling
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Trivia
: 0.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Global benchmark trends
See how current models trade score for cost, speed, output length, and category strength.