Navigate
Advertise here

Ember-1 vs Granite 4.2 8B (low)

The average score is effectively tied at 5.4 vs 5.3. Granite 4.2 8B (low) has the lower benchmark cost at $0.036 vs $0.786. Ember-1 is faster at 22.65s vs 58.20s, with pass rates of 43.5% vs 33.3%.

Last updated at: 2026-11-13

Compared models

Rank
#375
Total Output Tokens
11,832
Response Time (avg)
22.65s
Total Cost
$0.786
Rank
#378
Total Output Tokens
61,249
Response Time (avg)
58.20s
Total Cost
$0.036
Recommended model Granite 4.2 8B (low)

It has the best score here (5.3), while costing about 22.1x less than Ember-1.

Detailed comparison

Metric Ember-1 Ember-1 none Release: 2026-09-28 Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02
Score 5.4 5.3
Rank #375 #378
Reliability 8.8 9.2
Consistency 8.6 9.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 43.5% 33.3%
Flaky tests 4 1
Total Runs 69 69
Cost per result 9.817 0.508
Total Cost $0.786 $0.036
Input Price $3.000 / 1M $0.060 / 1M
Output Price $15.000 / 1M $0.250 / 1M
Cache Read Price $0.300 / 1M $0.015 / 1M
Cache Write Price N/A N/A
Total Input Tokens 202,617 332,917
Output Tokens 11,832 18,989
Reasoning Tokens 0 42,362
Response Time (avg) 22.65s 58.20s
Response Time (max) 93.12s 566.80s
Response Time (total) 520.91s 1338.65s
Parameters ~2.8T total (~104B active) 8B
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#375 Ember-1

none
Cost
$0.156
Time
224.6s
Tokens
10,555 tok

#378 IBM: Granite 4.2 8B

low
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Ember-1 5.5 10.0 33.3% 0 1.94s 7,485 393 0
Granite 4.2 8B 5.5 10.0 33.3% 0 13.01s 8,439 2,469 2,984

Quick Compare

Switch Comparison Pair

Ember-1nonevsStep 3.5 FlashmediumGranite 4.2 8BlowvsGPT-5.6 LunanoneGranite 4.2 8BlowvsKimi K2.5noneEmber-1nonevsHy4 previewlowNorth Mini CodemediumFree AvailablevsEmber-1noneGranite 4.2 8BlowvsStep 3.5 FlashmediumGranite 4.2 8BlowvsMiMo-V2.6-FlashnoneGranite 4.2 8BlowvsLaguna XS 2.1noneFree AvailableGranite 4.2 8BlowvsQwen3.6 35B A3BnoneNorth Mini CodemediumFree AvailablevsGranite 4.2 8BlowGranite 4.2 8BlowvsQwen3.8 27BnoneFree AvailableGranite 4.2 8BlowvsLing 3.0 Flashnone