Navigate
Advertise here

Trinity Large Thinking (medium) vs Mistral Large 4 (medium)

Mistral Large 4 (medium) leads on average score with 6.2 vs 6.1. Trinity Large Thinking (medium) has the lower benchmark cost at $0.862 vs $1.456. Trinity Large Thinking (medium) is faster at 84.01s vs 265.03s, with pass rates of 49.3% vs 55.1%.

Last updated at: 2026-10-06

Compared models

Rank
#242
Total Output Tokens
925,046
Response Time (avg)
84.01s
Total Cost
$0.862
Rank
#240
Total Output Tokens
627,233
Response Time (avg)
265.03s
Total Cost
$1.456
Recommended model Trinity Large Thinking (medium)

Its score stays close to the best score here (6.1 vs 6.2), while costing about 1.7x less than Mistral Large 4 (medium).

Detailed comparison

Metric Trinity Large Thinking Trinity Large Thinking medium Release: 2026-07-28 Mistral Large 4 Mistral Large 4 medium Release: 2026-10-06
Score 6.1 6.2
Rank #242 #240
Reliability 10.0 9.2
Consistency 7.7 7.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 49.3% 55.1%
Flaky tests 7 7
Total Runs 69 69
Cost per result 10.772 16.168
Total Cost $0.862 $1.456
Input Price $0.250 / 1M $0.680 / 1M
Output Price $0.800 / 1M $2.090 / 1M
Cache Read Price $0.060 / 1M $0.070 / 1M
Cache Write Price N/A N/A
Total Input Tokens 319,352 212,024
Output Tokens 158,447 166,422
Reasoning Tokens 875,524 562,095
Response Time (avg) 84.01s 265.03s
Response Time (max) 525.14s 1760.20s
Response Time (total) 1932.24s 6095.69s
Parameters 398B total (13B active) 1.05T total (49B active)
Availability Weights available Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#242 Trinity Large Thinking

medium
Cost
$0.016
Time
75.9s
Tokens
19,401 tok

#240 Mistral Large 4

medium
Cost
$0.011
Time
63.4s
Tokens
5,291 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Trinity Large Thinking 7.5 10.0 66.7% 0 179.02s 7,248 7,413 351,155
Mistral Large 4 3.4 7.2 22.2% 1 1201.87s 7,189 33,530 303,140

Quick Compare

Switch Comparison Pair