Navigate
Advertise here

GPT-4o-mini (default) vs Laguna S 2.1 (medium)

Laguna S 2.1 (medium) leads on average score with 5.0 vs 5.0. GPT-4o-mini (default) has the lower benchmark cost at $0.024 vs $0.092. GPT-4o-mini (default) is faster at 4.16s vs 63.06s, with pass rates of 21.7% vs 24.6%.

Last updated at: 2026-11-13

Compared models

Rank
#399
Total Output Tokens
3,627
Response Time (avg)
4.16s
Total Cost
$0.024
Rank
#395
Total Output Tokens
294,040
Response Time (avg)
63.06s
Total Cost
$0.092
Recommended model GPT-4o-mini (default)

Its score stays close to the best score here (5.0 vs 5.0), while costing about 3.8x less than Laguna S 2.1 (medium).

Detailed comparison

Metric GPT-4o-mini GPT-4o-mini default Release: 2024-07-18 Laguna S 2.1 Laguna S 2.1 medium Release: 2026-07-21 Free Available
Score 5.0 5.0
Rank #399 #395
Reliability 10.0 10.0
Consistency 9.9 8.5
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 21.7% 24.6%
Flaky tests 0 4
Total Runs 69 69
Cost per result 0.480 1.987
Total Cost $0.024 $0.092
Input Price $0.150 / 1M $0.090 / 1M
Output Price $0.600 / 1M $0.180 / 1M
Cache Read Price $0.075 / 1M $0.009 / 1M
Cache Write Price N/A N/A
Total Input Tokens 145,180 230,291
Output Tokens 3,627 99,030
Reasoning Tokens 0 287,794
Response Time (avg) 4.16s 63.06s
Response Time (max) 39.99s 560.31s
Response Time (total) 70.70s 1450.31s
Parameters ~8B 118B total (8B active)
Availability Closed Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#399 GPT-4o-mini

default
Cost
$0.001
Time
6.6s
Tokens
742 tok

#395 Laguna S 2.1

medium
Cost
$0.001
Time
4.0s
Tokens
867 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-4o-mini 3.2 9.6 0.0% 0 1.63s 7,314 367 0
Laguna S 2.1 5.3 7.2 44.4% 1 158.98s 7,917 93,354 106,718

Switch Comparison Pair