Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Nemotron 3 Ultra 550b A55b vs Z.ai: GLM 4.7 Flash

Summary

Nemotron 3 Ultra 550b A55b vs GLM 4.7 Flash benchmark comparison: Nemotron 3 Ultra 550b A55b leads on average score with 8.1 vs 4.3. GLM 4.7 Flash has the lower benchmark cost at $0.054 vs $0.158. Nemotron 3 Ultra 550b A55b is faster at 15.05s vs 35.10s, with pass rates of 69.8% vs 33.3%.

Recommended model: Nemotron 3 Ultra 550b A55b - It has the best score here (8.1), while responding about 2.3x faster than GLM 4.7 Flash.

Last updated at: 2026-07-02

Metric Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b medium Release: 2026-06-04 Free Available GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score 8.1 4.3
Rank #26 #162
Reliability 9.7 6.7
Consistency 8.8 6.8
Tests Correct
Attempt pass rate 69.8% 33.3%
Flaky tests 3 8
Total Runs 63 63
Cost per result 0.000 1.337
Total Cost $0.158 $0.054
Input Price $0.500 / 1M $0.060 / 1M
Output Price $2.200 / 1M $0.400 / 1M
Total Input Tokens 46,813 37,206
Output Tokens 18,002 43,754
Reasoning Tokens 53,091 89,079
Response Time (avg) 15.05s 35.10s
Response Time (max) 43.93s 174.55s
Response Time (total) 316.09s 456.24s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#26 Nemotron 3 Ultra 550b A55b

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#162 GLM 4.7 Flash

medium
Invalid SVG
Cost
$0.000
Time
186.2s
Tokens
12,112 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 8.62s 780 835 1,485
GLM 4.7 Flash 4.7 5.9 41.7% 2 14.95s 555 1,122 6,110
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 8.4 7.4 88.9% 1 26.53s 7,686 2,854 17,725
GLM 4.7 Flash 3.2 7.4 11.1% 1 55.33s 3,106 4,981 22,387
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 43.93s 17,574 1,040 3,590
GLM 4.7 Flash 2.8 2.1 33.3% 1 65.57s 17,185 2,585 20,648
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 5.68s 7,989 473 1,285
GLM 4.7 Flash 6.3 10.0 50.0% 0 1.51s 7,107 584 2,755
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.5 4.4 33.3% 2 24.90s 858 11,169 16,249
GLM 4.7 Flash 3.5 4.4 33.3% 2 174.55s 643 33,000 25,394
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.7 9.5 0.0% 0 2.52s 360 70 235
GLM 4.7 Flash 3.6 9.7 0.0% 0 18.14s 318 18 2,138
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 6.35s 765 182 1,243
GLM 4.7 Flash 6.2 5.8 66.7% 1 2.97s 636 388 2,181
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 5.5 9.9 33.3% 0 3.54s 792 771 2,055
GLM 4.7 Flash 2.9 7.2 11.1% 1 12.93s 521 781 5,255
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 7.72s 9,781 304 984
GLM 4.7 Flash 10.0 10.0 100.0% 0 15.95s 6,949 224 1,014
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 38.47s 228 304 8,240
GLM 4.7 Flash 3.0 10.0 0.0% 0 11.13s 186 71 1,197

Quick Compare

Switch Comparison Pair

Grok 4.20nonevsGLM 4.7 FlashmediumDeepSeek V4 FlashhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableGranite 4.1 8BnonevsGLM 4.7 Flashmediumgpt-oss-120bnoneFree AvailablevsGLM 4.7 FlashmediumMercury 2nonevsGLM 4.7 FlashmediumNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.2 ChatnoneClaude Opus 4.8lowvsNemotron 3 Ultra 550b A55bmediumFree AvailableLing-2.6-1TnonevsGLM 4.7 FlashmediumNemotron 3 Ultra 550b A55bmediumFree AvailablevsStep 3.7 FlashlowGPT-5.4 NanononevsGLM 4.7 FlashmediumDeepSeek V4 ProhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableRing-2.6-1TnonevsGLM 4.7 Flashmedium