Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Nemotron 3 Ultra 550b A55b vs Z.ai: GLM 5.2

Summary

Nemotron 3 Ultra 550b A55b vs GLM 5.2 benchmark comparison: Nemotron 3 Ultra 550b A55b leads on average score with 8.1 vs 7.1. GLM 5.2 has the lower benchmark cost at $0.076 vs $0.158. GLM 5.2 is faster at 6.34s vs 15.05s, with pass rates of 69.8% vs 60.3%.

Recommended model: GLM 5.2 - It offers the best overall trade-off: a competitive score (7.1), lower cost than Nemotron 3 Ultra 550b A55b, and balanced response time.

Last updated at: 2026-06-17

Metric Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b medium Release: 2026-06-04 Free Available GLM 5.2 GLM 5.2 none Release: 2026-06-17
Score 8.1 7.1
Rank #26 #61
Reliability 9.7 9.9
Consistency 8.8 9.6
Tests Correct
Attempt pass rate 69.8% 60.3%
Flaky tests 3 1
Total Runs 63 63
Cost per result 0.000 0.628
Total Cost $0.158 $0.076
Input Price $0.500 / 1M $1.400 / 1M
Output Price $2.200 / 1M $4.400 / 1M
Total Input Tokens 46,813 38,671
Output Tokens 18,002 4,817
Reasoning Tokens 53,091 0
Response Time (avg) 15.05s 6.34s
Response Time (max) 43.93s 20.69s
Response Time (total) 316.09s 133.19s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#26 Nemotron 3 Ultra 550b A55b

medium
No showcase result has been generated for this model yet.
Cost
$0.000
Time
-
Tokens
0 tok

#61 GLM 5.2

none
Invalid SVG
Cost
$0.033
Time
87.7s
Tokens
7,455 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 8.62s 780 835 1,485
GLM 5.2 8.3 10.0 75.0% 0 3.70s 567 313 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 8.4 7.4 88.9% 1 26.53s 7,686 2,854 17,725
GLM 5.2 3.7 9.5 0.0% 0 7.55s 7,263 1,958 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 43.93s 17,574 1,040 3,590
GLM 5.2 10.0 10.0 100.0% 0 20.69s 14,296 1,489 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 5.68s 7,989 473 1,285
GLM 5.2 10.0 10.0 100.0% 0 7.17s 7,113 204 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.5 4.4 33.3% 2 24.90s 858 11,169 16,249
GLM 5.2 5.3 10.0 33.3% 0 6.50s 696 27 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.7 9.5 0.0% 0 2.52s 360 70 235
GLM 5.2 6.1 3.1 66.7% 1 4.42s 480 82 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 6.35s 765 182 1,243
GLM 5.2 9.8 10.0 100.0% 0 3.84s 642 66 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 5.5 9.9 33.3% 0 3.54s 792 771 2,055
GLM 5.2 7.7 10.0 66.7% 0 3.31s 618 265 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 7.72s 9,781 304 984
GLM 5.2 10.0 10.0 100.0% 0 15.76s 6,807 400 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 38.47s 228 304 8,240
GLM 5.2 3.0 10.0 0.0% 0 3.41s 189 13 0

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BmediumFree AvailablevsGLM 5.2noneMiMo-V2-FlashmediumvsGLM 5.2noneStep 3.7 FlashhighvsGLM 5.2noneKimi K2.7 CodemediumvsGLM 5.2noneDeepSeek V4 FlashhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableGrok 4.20mediumvsGLM 5.2noneGemini 3 Flash PreviewlowvsGLM 5.2noneMiMo-V2.5-PromediumvsGLM 5.2noneSeed-2.0-MinimediumvsGLM 5.2noneQwen3.5-FlashmediumvsGLM 5.2noneGemini 3.5 FlashminimalvsGLM 5.2noneDeepSeek V3.2mediumvsGLM 5.2none