A test is fully passed only if every run passed for that test.Did not follow instructions: 3Wrong answer: 3Response Time (avg)9.81sResponse Time (max)31.36sResponse Time (total)176.62s…
Total Tests: 18Wrong Tests: 6Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 74.1%Flaky tests: 2…Output Tokens: 1,568Reasoning Tokens: 91,909Response time: avg 9.81s · total 176.62s · max 31.36s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.16sResponse Time (max)3.44sResponse Time (total)12.65s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)31.36sResponse Time (max)31.36sResponse Time (total)31.36s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.93sResponse Time (max)20.93sResponse Time (total)20.93s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.01sResponse Time (max)4.27sResponse Time (total)8.02s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)21.33sResponse Time (max)24.21sResponse Time (total)64.00s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.78sResponse Time (max)5.78sResponse Time (total)5.78s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)3.85sResponse Time (max)4.53sResponse Time (total)11.55s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)12.39sResponse Time (max)12.39sResponse Time (total)12.39s
A test is fully passed only if every run passed for that test.Extra formatting: 2Wrong answer: 2Timed out: 1Response Time (avg)12.66sResponse Time (max)46.35sResponse Time (total)126.62s…
Total Tests: 18Wrong Tests: 5Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 74.1%Flaky tests: 1…Output Tokens: 42,068Reasoning Tokens: 26,784Response time: avg 12.66s · total 126.62s · max 46.35s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)35.76sResponse Time (max)35.76sResponse Time (total)35.76s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)46.35sResponse Time (max)46.35sResponse Time (total)46.35s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.90sResponse Time (max)13.90sResponse Time (total)13.90s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.94sResponse Time (max)4.94sResponse Time (total)4.94s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.61sResponse Time (max)2.61sResponse Time (total)2.61s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.80sResponse Time (max)5.22sResponse Time (total)9.60s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.48sResponse Time (max)7.48sResponse Time (total)7.48s
Total Tests: 18Wrong Tests: 6Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 79.6%Flaky tests: 4…Output Tokens: 7,554Reasoning Tokens: 45,588Response time: avg 43.49s · total 782.73s · max 180.92s
Anti-AI Tricks
: 8.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)30.72sResponse Time (max)44.23sResponse Time (total)122.88s
Coding
: 4.7 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)180.92sResponse Time (max)180.92sResponse Time (total)180.92s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)93.11sResponse Time (max)93.11sResponse Time (total)93.11s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)36.09sResponse Time (max)39.12sResponse Time (total)72.18s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)21.78sResponse Time (max)30.66sResponse Time (total)65.35s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)35.78sResponse Time (max)47.30sResponse Time (total)71.56s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)36.87sResponse Time (max)59.22sResponse Time (total)110.62s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)34.81sResponse Time (max)34.81sResponse Time (total)34.81s
A test is fully passed only if every run passed for that test.Wrong answer: 5Did not follow instructions: 1Response Time (avg)6.84sResponse Time (max)38.52sResponse Time (total)123.17s…
Total Tests: 18Wrong Tests: 6Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 75.9%Flaky tests: 3…Output Tokens: 17,346Reasoning Tokens: 0Response time: avg 6.84s · total 123.17s · max 38.52s
Anti-AI Tricks
: 8.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.40sResponse Time (max)4.78sResponse Time (total)13.59s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.97sResponse Time (max)8.97sResponse Time (total)8.97s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.12sResponse Time (max)9.12sResponse Time (total)9.12s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.05sResponse Time (max)3.33sResponse Time (total)6.10s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)17.78sResponse Time (max)38.52sResponse Time (total)53.33s
Instructions following
: 7.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)5.46sResponse Time (max)6.45sResponse Time (total)10.92s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.42sResponse Time (max)5.04sResponse Time (total)13.27s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.68sResponse Time (max)4.68sResponse Time (total)4.68s
A test is fully passed only if every run passed for that test.Wrong answer: 4Did not follow instructions: 2Response Time (avg)1.30sResponse Time (max)3.39sResponse Time (total)23.42s…
Total Tests: 18Wrong Tests: 6Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 70.4%Flaky tests: 1…Output Tokens: 5,361Reasoning Tokens: 0Response time: avg 1.30s · total 23.42s · max 3.39s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.47sResponse Time (max)1.47sResponse Time (total)1.47s
Combined
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.20sResponse Time (max)3.20sResponse Time (total)3.20s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.22sResponse Time (max)1.33sResponse Time (total)2.44s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)942msResponse Time (max)1.12sResponse Time (total)2.83s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.13sResponse Time (max)1.14sResponse Time (total)2.27s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)972msResponse Time (max)1.13sResponse Time (total)2.92s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.39sResponse Time (max)3.39sResponse Time (total)3.39s
A test is fully passed only if every run passed for that test.Did not follow instructions: 3Wrong answer: 3Response Time (avg)26.78sResponse Time (max)170.45sResponse Time (total)294.58s…
Total Tests: 17Wrong Tests: 6Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 70.6%Flaky tests: 2…Output Tokens: 71,904Reasoning Tokens: 155,607Response time: avg 26.78s · total 294.58s · max 170.45s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.56sResponse Time (max)32.30sResponse Time (total)40.68s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)29.57sResponse Time (max)29.57sResponse Time (total)29.57s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.01sResponse Time (max)15.01sResponse Time (total)15.01s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)170.45sResponse Time (max)170.45sResponse Time (total)170.45s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.91sResponse Time (max)11.91sResponse Time (total)11.91s
A test is fully passed only if every run passed for that test.Wrong answer: 4Did not follow instructions: 3Response Time (avg)47.47sResponse Time (max)255.28sResponse Time (total)854.45s…
Total Tests: 18Wrong Tests: 7Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 79.6%Flaky tests: 5…Output Tokens: 1,757Reasoning Tokens: 55,907Response time: avg 47.47s · total 854.45s · max 255.28s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)28.51sResponse Time (max)39.73sResponse Time (total)114.05s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)62.48sResponse Time (max)62.48sResponse Time (total)62.48s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)76.57sResponse Time (max)76.57sResponse Time (total)76.57s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)28.03sResponse Time (max)30.49sResponse Time (total)56.07s
Domain specific
: 4.1 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)112.69sResponse Time (max)255.28sResponse Time (total)338.07s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.36sResponse Time (max)19.53sResponse Time (total)30.73s
Puzzle Solving
: 6.4 A test is fully passed only if every run passed for that test.Did not follow instructions: 2Response Time (avg)25.53sResponse Time (max)32.37sResponse Time (total)76.60s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)74.73sResponse Time (max)74.73sResponse Time (total)74.73s
Total Tests: 18Wrong Tests: 7Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 77.8%Flaky tests: 6…Output Tokens: 2,351Reasoning Tokens: 58,941Response time: avg 14.96s · total 269.32s · max 67.08s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.78sResponse Time (max)13.78sResponse Time (total)13.78s
Combined
: 6.9 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)15.06sResponse Time (max)15.06sResponse Time (total)15.06s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.60sResponse Time (max)9.92sResponse Time (total)19.19s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)38.15sResponse Time (max)67.08sResponse Time (total)114.45s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.09sResponse Time (max)11.09sResponse Time (total)11.09s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.74sResponse Time (max)5.23sResponse Time (total)7.47s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)10.91sResponse Time (max)18.97sResponse Time (total)32.74s
Tool Calling
: 7.0 A test is fully passed only if every run passed for that test.Invalid tool call: 1Response Time (avg)12.53sResponse Time (max)12.53sResponse Time (total)12.53s
Total Tests: 18Wrong Tests: 7Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 81.5%Flaky tests: 6…Output Tokens: 2,073Reasoning Tokens: 191,899Response time: avg 66.72s · total 1201.03s · max 234.29s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)59.11sResponse Time (max)168.31sResponse Time (total)236.44s
Coding
: 4.7 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)45.75sResponse Time (max)45.75sResponse Time (total)45.75s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.78sResponse Time (max)17.78sResponse Time (total)17.78s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)56.99sResponse Time (max)80.14sResponse Time (total)113.98s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)146.50sResponse Time (max)234.29sResponse Time (total)439.49s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)63.49sResponse Time (max)111.61sResponse Time (total)126.98s
Puzzle Solving
: 6.4 A test is fully passed only if every run passed for that test.Timed out: 2Response Time (avg)56.74sResponse Time (max)115.01sResponse Time (total)170.23s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.33sResponse Time (max)10.33sResponse Time (total)10.33s
A test is fully passed only if every run passed for that test.Wrong answer: 3Timed out: 2API error: 1Response Time (avg)24.13sResponse Time (max)118.52sResponse Time (total)410.25s…
Total Tests: 18Wrong Tests: 6Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 75.9%Flaky tests: 3…Output Tokens: 8,005Reasoning Tokens: 49,090Response time: avg 24.13s · total 410.25s · max 118.52s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.31sResponse Time (max)14.20sResponse Time (total)33.24s
Coding
: 4.7 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)118.52sResponse Time (max)118.52sResponse Time (total)118.52s
Combined
: 9.5 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)43.11sResponse Time (max)43.11sResponse Time (total)43.11s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.33sResponse Time (max)9.40sResponse Time (total)18.66s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)29.77sResponse Time (max)32.22sResponse Time (total)89.30s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.95sResponse Time (max)20.95sResponse Time (total)20.95s
Instructions following
: 6.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)7.47sResponse Time (max)10.16sResponse Time (total)14.94s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)23.85sResponse Time (max)33.09sResponse Time (total)71.54s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Total Tests: 18Wrong Tests: 6Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 74.1%Flaky tests: 3…Output Tokens: 2,840Reasoning Tokens: 116,242Response time: avg 13.71s · total 246.73s · max 86.93s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.98sResponse Time (max)3.76sResponse Time (total)7.92s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)31.48sResponse Time (max)31.48sResponse Time (total)31.48s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)16.86sResponse Time (max)16.86sResponse Time (total)16.86s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Extra formatting: 1Wrong answer: 1Response Time (avg)34.53sResponse Time (max)86.93sResponse Time (total)103.59s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.80sResponse Time (max)1.81sResponse Time (total)3.60s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)20.60sResponse Time (max)57.93sResponse Time (total)61.79s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.29sResponse Time (max)7.29sResponse Time (total)7.29s
Total Tests: 18Wrong Tests: 7Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 74.1%Flaky tests: 4…Output Tokens: 80,759Reasoning Tokens: 179,814Response time: avg 45.20s · total 768.37s · max 215.85s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)106.96sResponse Time (max)106.96sResponse Time (total)106.96s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)40.96sResponse Time (max)40.96sResponse Time (total)40.96s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)20.38sResponse Time (max)22.88sResponse Time (total)40.76s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Timed out: 2Response Time (avg)202.38sResponse Time (max)215.85sResponse Time (total)404.76s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.83sResponse Time (max)17.83sResponse Time (total)17.83s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.53sResponse Time (max)19.15sResponse Time (total)25.06s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.92sResponse Time (max)8.92sResponse Time (total)8.92s
Total Tests: 18Wrong Tests: 7Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 61.1%Flaky tests: 0…Output Tokens: 928Reasoning Tokens: 72,661Response time: avg 16.76s · total 301.61s · max 158.78s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.11sResponse Time (max)3.43sResponse Time (total)8.43s
Coding
: 4.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)68.55sResponse Time (max)68.55sResponse Time (total)68.55s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)19.29sResponse Time (max)19.29sResponse Time (total)19.29s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.29sResponse Time (max)2.62sResponse Time (total)4.58s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.86sResponse Time (max)2.86sResponse Time (total)2.86s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.07sResponse Time (max)11.07sResponse Time (total)11.07s
A test is fully passed only if every run passed for that test.Wrong answer: 5Did not follow instructions: 2Response Time (avg)5.88sResponse Time (max)18.33sResponse Time (total)105.90s…
Total Tests: 18Wrong Tests: 7Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 68.5%Flaky tests: 3…Output Tokens: 20,784Reasoning Tokens: 0Response time: avg 5.88s · total 105.90s · max 18.33s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.32sResponse Time (max)9.32sResponse Time (total)9.32s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)11.96sResponse Time (max)11.96sResponse Time (total)11.96s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.21sResponse Time (max)2.52sResponse Time (total)4.42s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)13.01sResponse Time (max)18.33sResponse Time (total)39.04s
Instructions following
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.29sResponse Time (max)4.18sResponse Time (total)6.59s
Puzzle Solving
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.93sResponse Time (max)3.05sResponse Time (total)8.78s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.36sResponse Time (max)8.36sResponse Time (total)8.36s
A test is fully passed only if every run passed for that test.Extra formatting: 4Wrong answer: 2Response Time (avg)21.08sResponse Time (max)83.40sResponse Time (total)231.84s…
Total Tests: 18Wrong Tests: 6Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 70.4%Flaky tests: 2…Output Tokens: 29,829Reasoning Tokens: 18,938Response time: avg 21.08s · total 231.84s · max 83.40s
Anti-AI Tricks
: 6.4 A test is fully passed only if every run passed for that test.Extra formatting: 2Response Time (avg)7.45sResponse Time (max)11.88sResponse Time (total)14.90s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.11sResponse Time (max)23.11sResponse Time (total)23.11s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)76.66sResponse Time (max)76.66sResponse Time (total)76.66s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.37sResponse Time (max)7.37sResponse Time (total)7.37s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.04sResponse Time (max)5.04sResponse Time (total)5.04s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.43sResponse Time (max)2.43sResponse Time (total)2.43s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.60sResponse Time (max)4.66sResponse Time (total)9.20s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)9.73sResponse Time (max)9.73sResponse Time (total)9.73s
A test is fully passed only if every run passed for that test.Wrong answer: 4Did not follow instructions: 3Response Time (avg)11.21sResponse Time (max)94.06sResponse Time (total)201.80s…
Total Tests: 18Wrong Tests: 7Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 68.5%Flaky tests: 2…Output Tokens: 2,946Reasoning Tokens: 58,132Response time: avg 11.21s · total 201.80s · max 94.06s
Anti-AI Tricks
: 8.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.52sResponse Time (max)7.74sResponse Time (total)18.10s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)13.41sResponse Time (max)13.41sResponse Time (total)13.41s
Combined
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.13sResponse Time (max)24.13sResponse Time (total)24.13s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.54sResponse Time (max)3.33sResponse Time (total)5.08s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)38.18sResponse Time (max)94.06sResponse Time (total)114.53s
Instructions following
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.88sResponse Time (max)2.61sResponse Time (total)3.75s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.71sResponse Time (max)7.71sResponse Time (total)7.71s
Total Tests: 18Wrong Tests: 7Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 66.7%Flaky tests: 2…Output Tokens: 2,419Reasoning Tokens: 79,238Response time: avg 69.70s · total 1045.47s · max 262.83s
Anti-AI Tricks
: 6.6 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)74.75sResponse Time (max)182.10sResponse Time (total)298.98s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)197.31sResponse Time (max)197.31sResponse Time (total)197.31s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)262.83sResponse Time (max)262.83sResponse Time (total)262.83s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.27sResponse Time (max)27.52sResponse Time (total)48.54s
Domain specific
: 3.0 A test is fully passed only if every run passed for that test.Timed out: 3Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.47sResponse Time (max)19.46sResponse Time (total)34.93s
Puzzle Solving
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)25.85sResponse Time (max)32.95sResponse Time (total)77.55s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)88.68sResponse Time (max)88.68sResponse Time (total)88.68s
Total Tests: 18Wrong Tests: 7Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 72.2%Flaky tests: 4…Output Tokens: 2,705Reasoning Tokens: 18,977Response time: avg 14.04s · total 154.41s · max 77.80s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)15.12sResponse Time (max)15.12sResponse Time (total)15.12s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)14.06sResponse Time (max)14.06sResponse Time (total)14.06s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.15sResponse Time (max)3.15sResponse Time (total)3.15s
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)77.80sResponse Time (max)77.80sResponse Time (total)77.80s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.12sResponse Time (max)3.12sResponse Time (total)3.12s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)5.47sResponse Time (max)6.45sResponse Time (total)10.94s
Tool Calling
: 4.7 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)10.30sResponse Time (max)10.30sResponse Time (total)10.30s
Total Tests: 18Wrong Tests: 7Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 70.4%Flaky tests: 3…Output Tokens: 12,387Reasoning Tokens: 115,182Response time: avg 23.36s · total 280.34s · max 96.01s
Anti-AI Tricks
: 8.1 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)15.85sResponse Time (max)20.83sResponse Time (total)47.55s
Coding
: 4.7 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)13.03sResponse Time (max)13.03sResponse Time (total)13.03s
Combined
: 9.8 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)75.68sResponse Time (max)75.68sResponse Time (total)75.68s
Data parsing and extraction
: 6.5 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Domain specific
: 5.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)96.01sResponse Time (max)96.01sResponse Time (total)96.01s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.28sResponse Time (max)7.37sResponse Time (total)8.55s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.77sResponse Time (max)5.26sResponse Time (total)7.55s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)27.78sResponse Time (max)27.78sResponse Time (total)27.78s
Total Tests: 18Wrong Tests: 7Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 64.8%Flaky tests: 1…Output Tokens: 7,433Reasoning Tokens: 0Response time: avg 4.98s · total 54.83s · max 23.84s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.67sResponse Time (max)3.67sResponse Time (total)3.67s
Combined
: 9.5 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.84sResponse Time (max)23.84sResponse Time (total)23.84s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.43sResponse Time (max)3.43sResponse Time (total)3.43s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.54sResponse Time (max)3.54sResponse Time (total)3.54s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.96sResponse Time (max)1.96sResponse Time (total)1.96s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Extra formatting: 1Response Time (avg)2.92sResponse Time (max)3.33sResponse Time (total)5.84s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.11sResponse Time (max)4.11sResponse Time (total)4.11s
Total Tests: 18Wrong Tests: 8Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 79.6%Flaky tests: 7…Output Tokens: 10,137Reasoning Tokens: 208,761Response time: avg 44.51s · total 801.21s · max 106.00s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)21.13sResponse Time (max)34.96sResponse Time (total)84.53s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)79.09sResponse Time (max)79.09sResponse Time (total)79.09s
Combined
: 4.7 A test is fully passed only if every run passed for that test.No answer: 1Response Time (avg)75.34sResponse Time (max)75.34sResponse Time (total)75.34s
Data parsing and extraction
: 7.3 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)59.33sResponse Time (max)97.12sResponse Time (total)118.65s
Domain specific
: 4.1 A test is fully passed only if every run passed for that test.Timed out: 2Wrong answer: 1Response Time (avg)88.34sResponse Time (max)106.00sResponse Time (total)265.01s
General Intelligence
: 2.8 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)30.30sResponse Time (max)30.30sResponse Time (total)30.30s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)24.45sResponse Time (max)43.36sResponse Time (total)48.89s
Puzzle Solving
: 6.4 A test is fully passed only if every run passed for that test.Timed out: 1Wrong answer: 1Response Time (avg)31.58sResponse Time (max)60.18sResponse Time (total)94.75s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.65sResponse Time (max)4.65sResponse Time (total)4.65s
A test is fully passed only if every run passed for that test.Did not follow instructions: 5Wrong answer: 4Response Time (avg)15.22sResponse Time (max)102.91sResponse Time (total)273.90s…
Total Tests: 18Wrong Tests: 9Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 70.4%Flaky tests: 6…Output Tokens: 2,131Reasoning Tokens: 59,567Response time: avg 15.22s · total 273.90s · max 102.91s
Anti-AI Tricks
: 8.6 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)4.05sResponse Time (max)6.69sResponse Time (total)16.20s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.76sResponse Time (max)7.76sResponse Time (total)7.76s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.81sResponse Time (max)17.81sResponse Time (total)17.81s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.43sResponse Time (max)3.39sResponse Time (total)4.87s
Domain specific
: 4.1 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)65.31sResponse Time (max)102.91sResponse Time (total)195.92s
Puzzle Solving
: 6.8 A test is fully passed only if every run passed for that test.Did not follow instructions: 2Response Time (avg)4.33sResponse Time (max)7.27sResponse Time (total)13.00s
Tool Calling
: 4.7 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)9.62sResponse Time (max)9.62sResponse Time (total)9.62s
Total Tests: 18Wrong Tests: 9Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 61.1%Flaky tests: 3…Output Tokens: 6,379Reasoning Tokens: 53,482Response time: avg 23.98s · total 431.56s · max 88.15s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.18sResponse Time (max)23.18sResponse Time (total)23.18s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)88.15sResponse Time (max)88.15sResponse Time (total)88.15s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)12.58sResponse Time (max)13.87sResponse Time (total)25.16s
Domain specific
: 3.6 A test is fully passed only if every run passed for that test.Wrong answer: 2Timed out: 1Response Time (avg)44.63sResponse Time (max)82.55sResponse Time (total)133.89s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)18.64sResponse Time (max)18.64sResponse Time (total)18.64s
Total Tests: 18Wrong Tests: 9Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 72.2%Flaky tests: 7…Output Tokens: 42,176Reasoning Tokens: 84,870Response time: avg 72.43s · total 796.70s · max 150.77s
Anti-AI Tricks
: 7.3 A test is fully passed only if every run passed for that test.No answer: 1Wrong answer: 1Response Time (avg)51.38sResponse Time (max)85.28sResponse Time (total)102.75s
Coding
: 4.7 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)150.77sResponse Time (max)150.77sResponse Time (total)150.77s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)71.37sResponse Time (max)71.37sResponse Time (total)71.37s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)49.78sResponse Time (max)49.78sResponse Time (total)49.78s
Domain specific
: 3.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Timed out: 1Response Time (avg)137.29sResponse Time (max)137.29sResponse Time (total)137.29s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)92.47sResponse Time (max)92.47sResponse Time (total)92.47s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)31.74sResponse Time (max)31.74sResponse Time (total)31.74s
Total Tests: 18Wrong Tests: 9Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 66.7%Flaky tests: 5…Output Tokens: 1,744Reasoning Tokens: 109,882Response time: avg 10.33s · total 185.87s · max 29.87s
Anti-AI Tricks
: 8.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.36sResponse Time (max)4.08sResponse Time (total)13.42s
Coding
: 4.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)24.33sResponse Time (max)24.33sResponse Time (total)24.33s
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.40sResponse Time (max)17.40sResponse Time (total)17.40s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.17sResponse Time (max)5.02sResponse Time (total)8.34s
Instructions following
: 7.3 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)4.42sResponse Time (max)4.46sResponse Time (total)8.84s
Puzzle Solving
: 6.4 A test is fully passed only if every run passed for that test.Did not follow instructions: 2Response Time (avg)3.89sResponse Time (max)4.90sResponse Time (total)11.67s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)13.68sResponse Time (max)13.68sResponse Time (total)13.68s
Total Tests: 18Wrong Tests: 8Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 55.6%Flaky tests: 0…Output Tokens: 1,359Reasoning Tokens: 0Response time: avg 4.02s · total 64.33s · max 26.13s
Anti-AI Tricks
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.85sResponse Time (max)4.45sResponse Time (total)7.40s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)26.13sResponse Time (max)26.13sResponse Time (total)26.13s
Combined
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.25sResponse Time (max)3.02sResponse Time (total)4.51s
Domain specific
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.22sResponse Time (max)4.68sResponse Time (total)9.67s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.09sResponse Time (max)2.09sResponse Time (total)2.09s
Instructions following
: 6.5 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.84sResponse Time (max)4.45sResponse Time (total)5.68s
Tool Calling
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
A test is fully passed only if every run passed for that test.Wrong answer: 9Response Time (avg)2.60sResponse Time (max)6.65sResponse Time (total)31.23s…
Total Tests: 18Wrong Tests: 9Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 53.7%Flaky tests: 2…Output Tokens: 2,461Reasoning Tokens: 0Response time: avg 2.60s · total 31.23s · max 6.65s
Anti-AI Tricks
: 4.8 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.91sResponse Time (max)2.74sResponse Time (total)3.82s
Coding
: 6.3 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)3.63sResponse Time (max)3.63sResponse Time (total)3.63s
Combined
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.65sResponse Time (max)6.65sResponse Time (total)6.65s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.89sResponse Time (max)1.89sResponse Time (total)1.89s
Domain specific
: 5.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.17sResponse Time (max)1.44sResponse Time (total)2.33s
General Intelligence
: 4.4 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.26sResponse Time (max)2.26sResponse Time (total)2.26s
Instructions following
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.67sResponse Time (max)1.67sResponse Time (total)1.67s
Puzzle Solving
: 7.7 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.82sResponse Time (max)3.52sResponse Time (total)5.65s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.33sResponse Time (max)3.33sResponse Time (total)3.33s
A test is fully passed only if every run passed for that test.Wrong answer: 8Did not follow instructions: 1Response Time (avg)1.83sResponse Time (max)5.56sResponse Time (total)32.86s…
Total Tests: 18Wrong Tests: 9Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 61.1%Flaky tests: 4…Output Tokens: 1,910Reasoning Tokens: 0Response time: avg 1.83s · total 32.86s · max 5.56s
Anti-AI Tricks
: 6.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)1.31sResponse Time (max)2.08sResponse Time (total)5.25s
Coding
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)2.05sResponse Time (max)2.05sResponse Time (total)2.05s
Combined
: 3.0 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)5.56sResponse Time (max)5.56sResponse Time (total)5.56s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)1.18sResponse Time (max)1.24sResponse Time (total)2.37s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)1.31sResponse Time (max)1.39sResponse Time (total)3.92s
General Intelligence
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.41sResponse Time (max)3.41sResponse Time (total)3.41s
Instructions following
: 6.2 A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.15sResponse Time (max)1.19sResponse Time (total)2.31s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.90sResponse Time (max)3.90sResponse Time (total)3.90s
Total Tests: 18Wrong Tests: 10Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 64.8%Flaky tests: 6…Output Tokens: 4,724Reasoning Tokens: 17,921Response time: avg 10.33s · total 175.60s · max 30.53s
Anti-AI Tricks
: 7.3 A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)4.75sResponse Time (max)7.62sResponse Time (total)19.00s
Coding
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 4.7 A test is fully passed only if every run passed for that test.Timed out: 1Response Time (avg)30.53sResponse Time (max)30.53sResponse Time (total)30.53s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)23.16sResponse Time (max)26.55sResponse Time (total)46.33s
Instructions following
: 9.9 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.18sResponse Time (max)4.46sResponse Time (total)8.36s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)17.33sResponse Time (max)17.33sResponse Time (total)17.33s
Total Tests: 18Wrong Tests: 9Reliability: N/AReliability telemetry is unavailable or incomplete for this model.Attempt pass rate: 55.6%Flaky tests: 3…Output Tokens: 11,947Reasoning Tokens: 29,768Response time: avg 19.06s · total 305.04s · max 87.80s
Anti-AI Tricks
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)10.08sResponse Time (max)22.30sResponse Time (total)40.30s
Coding
: 3.0 A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)0msResponse Time (max)0msResponse Time (total)0ms
Combined
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)87.80sResponse Time (max)87.80sResponse Time (total)87.80s
Data parsing and extraction
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)18.16sResponse Time (max)20.65sResponse Time (total)36.33s
Domain specific
: 2.9 A test is fully passed only if every run passed for that test.Wrong answer: 2Timed out: 1Response Time (avg)16.19sResponse Time (max)21.56sResponse Time (total)32.39s
Tool Calling
: 10.0 A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)39.75sResponse Time (max)39.75sResponse Time (total)39.75s