Nemotron 3 Ultra 550b A55b vs GLM 5V Turbo benchmark comparison: Nemotron 3 Ultra 550b A55b leads on average score with 8.1 vs 5.9. GLM 5V Turbo has the lower benchmark cost at $0.052 vs $0.158. GLM 5V Turbo is faster at 2.99s vs 15.05s, with pass rates of 69.8% vs 38.1%.
Recommended model: GLM 5V Turbo - It offers the best overall trade-off: a competitive score (5.9), lower cost than Nemotron 3 Ultra 550b A55b, and balanced response time.
GLM 5V TurboGLM 5V TurbononeArchived model: this model is no longer updated or tested on new tests.Release: 2026-04-01
Score
8.1Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
5.9Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
Rank
#26
#105
Reliability
9.7First-attempt success score: 10.0 means no retryable target API or rate-limit failures before successful calls; tracked failures lower the score.…
10.0First-attempt success score: 10.0 means no retryable target API or rate-limit failures before successful calls; tracked failures lower the score.…
Consistency
8.8Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
Tests Correct
A test is fully passed only if every run passed for that test.Wrong answer: 7API error: 1Response Time (avg)15.05sResponse Time (max)43.93sResponse Time (total)316.09sA test is fully passed only if every run passed for that test.…
A test is fully passed only if every run passed for that test.Wrong answer: 11Did not follow instructions: 2Response Time (avg)2.99sResponse Time (max)6.51sResponse Time (total)62.74sA test is fully passed only if every run passed for that test.…
Attempt pass rate
69.8%Attempt pass rate = passed attempts / total attempts across runs.…
38.1%Attempt pass rate = passed attempts / total attempts across runs.…
Flaky tests
3Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
Total Runs
63Total Runs…
63Total Runs…
Cost per result
0.000Shows the average cost per correct benchmark answer in cents (lower is better).…
0.645Shows the average cost per correct benchmark answer in cents (lower is better).…
Total Cost
$0.158Total Cost (Current Price)…
$0.052Total Cost (Current Price)…
Input Price
$0.500 / 1MInput Price…
$1.200 / 1MInput Price…
Output Price
$2.200 / 1MOutput Price…
$4.000 / 1MOutput Price…
Total Input Tokens
46,813Total Input Tokens…
37,100Total Input Tokens…
Output Tokens
18,002Output Tokens…
1,766Output Tokens…
Reasoning Tokens
53,091Reasoning Tokens…
0Reasoning Tokens…
Response Time (avg)
15.05sResponse Time (avg)…
2.99sResponse Time (avg)…
Response Time (max)
43.93sResponse Time (max)…
6.51sResponse Time (max)…
Response Time (total)
316.09sResponse Time (total)…
62.74sResponse Time (total)…
Generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
10.0Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
100.0%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)8.62sResponse Time (max)16.86sResponse Time (total)34.49sA test is fully passed only if every run passed for that test.…
8.62sResponse Time (avg)…
780Total Input Tokens…
835Output Tokens…
1,485Reasoning Tokens…
GLM 5V TurboArchived model: this model is no longer updated or tested on new tests.
4.8Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
25.0%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)3.13sResponse Time (max)5.90sResponse Time (total)12.50sA test is fully passed only if every run passed for that test.…
8.4Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
7.4Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
88.9%Attempt pass rate = passed attempts / total attempts across runs.…
1Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)26.53sResponse Time (max)31.91sResponse Time (total)79.58sA test is fully passed only if every run passed for that test.…
26.53sResponse Time (avg)…
7,686Total Input Tokens…
2,854Output Tokens…
17,725Reasoning Tokens…
GLM 5V TurboArchived model: this model is no longer updated or tested on new tests.
5.5Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
33.3%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.13sResponse Time (max)5.30sResponse Time (total)9.40sA test is fully passed only if every run passed for that test.…
9.8Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
100.0%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)43.93sResponse Time (max)43.93sResponse Time (total)43.93sA test is fully passed only if every run passed for that test.…
43.93sResponse Time (avg)…
17,574Total Input Tokens…
1,040Output Tokens…
3,590Reasoning Tokens…
GLM 5V TurboArchived model: this model is no longer updated or tested on new tests.
3.0Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
0.0%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)6.51sResponse Time (max)6.51sResponse Time (total)6.51sA test is fully passed only if every run passed for that test.…
10.0Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
100.0%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)5.68sResponse Time (max)7.94sResponse Time (total)11.36sA test is fully passed only if every run passed for that test.…
5.68sResponse Time (avg)…
7,989Total Input Tokens…
473Output Tokens…
1,285Reasoning Tokens…
GLM 5V TurboArchived model: this model is no longer updated or tested on new tests.
10.0Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
100.0%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)3.81sResponse Time (max)5.69sResponse Time (total)7.62sA test is fully passed only if every run passed for that test.…
3.5Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
4.4Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
33.3%Attempt pass rate = passed attempts / total attempts across runs.…
2Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.Wrong answer: 3Response Time (avg)24.90sResponse Time (max)34.96sResponse Time (total)74.71sA test is fully passed only if every run passed for that test.…
24.90sResponse Time (avg)…
858Total Input Tokens…
11,169Output Tokens…
16,249Reasoning Tokens…
GLM 5V TurboArchived model: this model is no longer updated or tested on new tests.
5.3Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
33.3%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)2.09sResponse Time (max)2.39sResponse Time (total)6.26sA test is fully passed only if every run passed for that test.…
3.7Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
9.5Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
0.0%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.API error: 1Response Time (avg)2.52sResponse Time (max)2.52sResponse Time (total)2.52sA test is fully passed only if every run passed for that test.…
2.52sResponse Time (avg)…
360Total Input Tokens…
70Output Tokens…
235Reasoning Tokens…
GLM 5V TurboArchived model: this model is no longer updated or tested on new tests.
4.6Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
0.0%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.Did not follow instructions: 1Response Time (avg)2.22sResponse Time (max)2.22sResponse Time (total)2.22sA test is fully passed only if every run passed for that test.…
9.8Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
100.0%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)6.35sResponse Time (max)9.38sResponse Time (total)12.69sA test is fully passed only if every run passed for that test.…
6.35sResponse Time (avg)…
765Total Input Tokens…
182Output Tokens…
1,243Reasoning Tokens…
GLM 5V TurboArchived model: this model is no longer updated or tested on new tests.
6.5Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
50.0%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)1.97sResponse Time (max)2.43sResponse Time (total)3.93sA test is fully passed only if every run passed for that test.…
5.5Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
9.9Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
33.3%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.Wrong answer: 2Response Time (avg)3.54sResponse Time (max)6.03sResponse Time (total)10.62sA test is fully passed only if every run passed for that test.…
3.54sResponse Time (avg)…
792Total Input Tokens…
771Output Tokens…
2,055Reasoning Tokens…
GLM 5V TurboArchived model: this model is no longer updated or tested on new tests.
5.3Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
33.3%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.Did not follow instructions: 1Wrong answer: 1Response Time (avg)2.40sResponse Time (max)3.81sResponse Time (total)7.21sA test is fully passed only if every run passed for that test.…
10.0Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
100.0%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)7.72sResponse Time (max)7.72sResponse Time (total)7.72sA test is fully passed only if every run passed for that test.…
7.72sResponse Time (avg)…
9,781Total Input Tokens…
304Output Tokens…
984Reasoning Tokens…
GLM 5V TurboArchived model: this model is no longer updated or tested on new tests.
10.0Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
100.0%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.No failed answers.Response Time (avg)4.86sResponse Time (max)4.86sResponse Time (total)4.86sA test is fully passed only if every run passed for that test.…
3.0Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
0.0%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)38.47sResponse Time (max)38.47sResponse Time (total)38.47sA test is fully passed only if every run passed for that test.…
38.47sResponse Time (avg)…
228Total Input Tokens…
304Output Tokens…
8,240Reasoning Tokens…
GLM 5V TurboArchived model: this model is no longer updated or tested on new tests.
3.0Summarizes broad quality across our full private benchmark suite, so ranking reflects consistent performance.…
10.0Consistency score reflects run-to-run stability (10 = very consistent, even if consistently wrong).…
0.0%Attempt pass rate = passed attempts / total attempts across runs.…
0Flaky tests had mixed outcomes across runs (at least one pass and one fail).…
A test is fully passed only if every run passed for that test.Wrong answer: 1Response Time (avg)2.23sResponse Time (max)2.23sResponse Time (total)2.23sA test is fully passed only if every run passed for that test.…