Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Nemotron 3 Ultra 550b A55b vs Z.ai: GLM 5.2

Summary

Nemotron 3 Ultra 550b A55b (medium) vs GLM 5.2 (high) benchmark comparison: Nemotron 3 Ultra 550b A55b (medium) leads on average score with 8.1 vs 8.0. Nemotron 3 Ultra 550b A55b (medium) has the lower benchmark cost at $0.158 vs $0.554. Nemotron 3 Ultra 550b A55b (medium) is faster at 15.05s vs 37.09s, with pass rates of 69.8% vs 77.8%.

Recommended model: Nemotron 3 Ultra 550b A55b (medium) - It has the best score here (8.1), while costing about 3.5x less than GLM 5.2 (high).

Last updated at: 2026-07-10

Metric Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b medium Release: 2026-06-04 Free Available GLM 5.2 GLM 5.2 high Release: 2026-06-17
Score 8.1 8.0
Rank #31 #32
Reliability 9.7 9.3
Consistency 8.8 7.6
Tests Correct
Attempt pass rate 69.8% 77.8%
Flaky tests 3 6
Total Runs 63 63
Cost per result 0.000 4.255
Total Cost $0.158 $0.554
Input Price $0.500 / 1M $0.770 / 1M
Output Price $2.200 / 1M $2.420 / 1M
Total Input Tokens 46,813 34,993
Output Tokens 18,002 51,575
Reasoning Tokens 53,091 166,065
Response Time (avg) 15.05s 37.09s
Response Time (max) 43.93s 180.69s
Response Time (total) 316.09s 778.91s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#31 Nemotron 3 Ultra 550b A55b

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#32 GLM 5.2

high
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 8.62s 780 835 1,485
GLM 5.2 10.0 10.0 100.0% 0 5.80s 639 406 2,660
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 8.4 7.4 88.9% 1 26.53s 7,686 2,854 17,725
GLM 5.2 6.4 4.4 77.8% 2 73.03s 5,124 2,302 22,546
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 43.93s 17,574 1,040 3,590
GLM 5.2 10.0 10.0 100.0% 0 43.51s 12,696 711 4,267
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 5.68s 7,989 473 1,285
GLM 5.2 10.0 10.0 100.0% 0 5.81s 7,143 435 1,414
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.5 4.4 33.3% 2 24.90s 858 11,169 16,249
GLM 5.2 3.5 4.4 33.3% 2 73.97s 551 46,693 90,566
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.7 9.5 0.0% 0 2.52s 360 70 235
GLM 5.2 10.0 10.0 100.0% 0 12.90s 498 63 1,743
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 6.35s 765 182 1,243
GLM 5.2 10.0 10.0 100.0% 0 4.26s 678 151 1,210
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 5.5 9.9 33.3% 0 3.54s 792 771 2,055
GLM 5.2 6.0 4.6 66.7% 2 33.71s 665 568 22,392
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 7.72s 9,781 304 984
GLM 5.2 10.0 10.0 100.0% 0 9.25s 6,861 246 503
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 38.47s 228 304 8,240
GLM 5.2 3.0 10.0 0.0% 0 127.82s 138 0 18,764

Quick Compare

Switch Comparison Pair

GPT-5.4 MinimediumvsGLM 5.2highQwen3.5 Plus 2026-02-15mediumvsGLM 5.2highNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.6 TerrahighDeepSeek V4 FlashhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableQwen3.7 PlusmediumvsGLM 5.2highQwen3.5-27BmediumvsGLM 5.2highClaude Sonnet 5mediumvsGLM 5.2highQwen3.6 PlusmediumvsGLM 5.2highGemini 2.5 FlashmediumvsGLM 5.2highGPT-5.6 TerramediumvsGLM 5.2highClaude Sonnet 4.6mediumvsGLM 5.2highGrok 4.5lowvsGLM 5.2high