Navigate
Advertise here

Ember-1 vs Laguna XS 2.1

Ember-1 leads on average score with 5.4 vs 5.3. Laguna XS 2.1 has the lower benchmark cost at $0.019 vs $0.786. Laguna XS 2.1 is faster at 4.56s vs 22.65s, with pass rates of 43.5% vs 29.0%.

Last updated at: 2026-10-01

Compared models

Rank
#277
Total Output Tokens
11,832
Response Time (avg)
22.65s
Total Cost
$0.786
Rank
#283
Total Output Tokens
23,173
Response Time (avg)
4.56s
Total Cost
$0.019
Recommended model Laguna XS 2.1

Its score stays close to the best score here (5.3 vs 5.4), while costing about 41.4x less than Ember-1.

Detailed comparison

Metric Ember-1 Ember-1 none Release: 2026-09-28 Laguna XS 2.1 Laguna XS 2.1 none Release: 2026-07-02 Free Available
Score 5.4 5.3
Rank #277 #283
Reliability 8.8 10.0
Consistency 8.6 9.1
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 43.5% 29.0%
Flaky tests 4 3
Total Runs 69 69
Cost per result 9.817 0.380
Total Cost $0.786 $0.019
Input Price $3.000 / 1M $0.060 / 1M
Output Price $15.000 / 1M $0.120 / 1M
Total Input Tokens 202,617 270,072
Output Tokens 11,832 23,173
Reasoning Tokens 0 0
Response Time (avg) 22.65s 4.56s
Response Time (max) 93.12s 70.79s
Response Time (total) 520.91s 104.80s
Parameters ~2.8T total (~104B active) 33B total (3B active)
Availability Closed Weights available

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#277 Ember-1

none
Cost
$0.156
Time
224.6s
Tokens
10,555 tok

#283 Laguna XS 2.1

none
Cost
$0.001
Time
27.6s
Tokens
4,344 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Ember-1 5.5 10.0 33.3% 0 1.94s 7,485 393 0
Laguna XS 2.1 4.3 7.8 22.2% 1 623ms 7,995 562 0

Quick Compare

Switch Comparison Pair

Ember-1nonevsStep 3.5 FlashmediumEmber-1nonevsHy4 previewlowNorth Mini CodemediumFree AvailablevsEmber-1noneEmber-1nonevsGranite 4.2 8BlowGranite 4.2 8BlowvsLaguna XS 2.1noneFree AvailableLaguna XS 2.1noneFree AvailablevsInkling SmalllowFree AvailableNemotron 3.5 LightninghighFree AvailablevsLaguna XS 2.1noneFree AvailableLaguna XS 2.1noneFree AvailablevsStep 3.5 FlashmediumKAT Coder AIR V2.5highvsLaguna XS 2.1noneFree AvailableLaguna XS 2.1noneFree AvailablevsHy4 previewlowNorth Mini CodemediumFree AvailablevsLaguna XS 2.1noneFree AvailableMistral Small 4mediumvsLaguna XS 2.1noneFree Available