Navigate
Advertise here

GPT-4o-mini (default) vs Laguna S 2.1 (low)

GPT-4o-mini (default) leads on average score with 5.0 vs 4.6. GPT-4o-mini (default) has the lower benchmark cost at $0.024 vs $0.108. GPT-4o-mini (default) is faster at 4.16s vs 88.24s, with pass rates of 21.7% vs 23.2%.

Last updated at: 2026-10-24

Compared models

Rank
#356
Total Output Tokens
3,627
Response Time (avg)
4.16s
Total Cost
$0.024
Rank
#380
Total Output Tokens
437,706
Response Time (avg)
88.24s
Total Cost
$0.108
Recommended model GPT-4o-mini (default)

It has the best score here (5.0), while costing about 4.5x less than Laguna S 2.1 (low).

Detailed comparison

Metric GPT-4o-mini GPT-4o-mini default Release: 2024-07-18 Laguna S 2.1 Laguna S 2.1 low Release: 2026-07-21 Free Available
Score 5.0 4.6
Rank #356 #380
Reliability 10.0 10.0
Consistency 9.9 7.8
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 21.7% 23.2%
Flaky tests 0 6
Total Runs 69 69
Cost per result 0.480 3.627
Total Cost $0.024 $0.108
Input Price $0.150 / 1M $0.090 / 1M
Output Price $0.600 / 1M $0.180 / 1M
Cache Read Price $0.075 / 1M $0.009 / 1M
Cache Write Price N/A N/A
Total Input Tokens 145,180 232,641
Output Tokens 3,627 69,335
Reasoning Tokens 0 426,182
Response Time (avg) 4.16s 88.24s
Response Time (max) 39.99s 814.73s
Response Time (total) 70.70s 2029.57s
Parameters ~8B 118B total (8B active)
Availability Closed Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#356 GPT-4o-mini

default
Cost
$0.001
Time
6.6s
Tokens
742 tok

#380 Laguna S 2.1

low
Cost
$0.001
Time
6.6s
Tokens
1,314 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-4o-mini 3.2 9.6 0.0% 0 1.63s 7,314 367 0
Laguna S 2.1 3.8 7.1 22.2% 1 167.51s 7,917 58,111 119,138

Switch Comparison Pair