Navigate
Advertise here

Tev1 4B Experimental (default) vs Solar Decide (default)

The average score is effectively tied at 1.0 vs 1.0. Tev1 4B Experimental (default) has the lower benchmark cost at $0.002 vs $0.009. Tev1 4B Experimental (default) is faster at 498ms vs 6.01s, with pass rates of 13.0% vs 14.5%.

Last updated at: 2026-11-13

Compared models

Rank
#502
Total Output Tokens
96
Response Time (avg)
498ms
Total Cost
$0.002
Rank
#501
Total Output Tokens
51
Response Time (avg)
6.01s
Total Cost
$0.009
Recommended model Tev1 4B Experimental (default)

It has the best score here (1.0), while costing about 6.0x less than Solar Decide (default).

Detailed comparison

Metric Tev1 4B Experimental Tev1 4B Experimental default Release: 2026-09-30 Solar Decide Solar Decide default Release: 2026-09-28
Score 1.0 1.0
Rank #502 #501
Reliability 10.0 10.0
Consistency 3.0 2.0
Attempts 21/69 21/69
Tests Correct
Attempt pass rate 13.0% 14.5%
Flaky tests 0 3
Total Runs 21 21
Cost per result 0.048 0.119
Total Cost $0.002 $0.009
Input Price $0.042 / 1M $0.050 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A $0.050 / 1M
Cache Write Price N/A N/A
Total Input Tokens 33,864 47,586
Output Tokens 96 51
Reasoning Tokens 0 0
Response Time (avg) 498ms 6.01s
Response Time (max) 602ms 13.10s
Response Time (total) 3.49s 42.05s
Parameters 4B ~35B total (~3B active)
Availability Weights available Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Tev1 4B Experimental 0.0 0.0 0.0% 0 0ms 0 0 0
Solar Decide 0.0 0.0 0.0% 0 0ms 0 0 0

Switch Comparison Pair

Gemini 3 Flash PreviewhighvsSolar DecidedefaultGemini 3 Flash PreviewhighvsTev1 4B ExperimentaldefaultCommand A+lowvsSolar DecidedefaultCommand A+lowvsTev1 4B ExperimentaldefaultCommand A+nonevsSolar DecidedefaultCommand A+nonevsTev1 4B ExperimentaldefaultCommand A+highvsSolar DecidedefaultCommand A+highvsTev1 4B ExperimentaldefaultSolar DecidedefaultvsXing4.0 29b A4bnoneFree AvailableTev1 4B ExperimentaldefaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsSolar DecidedefaultSolar DecidedefaultvsGrok 4.20none