- Nafasi
- #288
- Jumla ya tokeni za matokeo
- 23,433
- Muda wa majibu (wastani)
- 14.67s
- Jumla ya gharama
- $0.151
Seed-2.0-Code vs Nemotron 3.5 Lightning (medium)
Seed-2.0-Code inaongoza kwa average score: 5.3 vs 5.1. Seed-2.0-Code ina gharama ya chini ya benchmark: $0.151 vs $0.156. Seed-2.0-Code ni ya haraka zaidi: 14.67s vs 70.11s, na pass rates 36.4% vs 48.5%.
Modeli zilizolinganishwa
- Nafasi
- #295
- Jumla ya tokeni za matokeo
- 760,441
- Muda wa majibu (wastani)
- 70.11s
- Jumla ya gharama
- $0.156
Muundo unaopendekezwa
Seed-2.0-Code
It has the best score here (5.3), while responding about 4.8x faster than Nemotron 3.5 Lightning (medium).
Ulinganisho wa kina
| Kipimo | Seed-2.0-Code Seed-2.0-Code none | Nemotron 3.5 Lightning Nemotron 3.5 Lightning medium Inapatikana bure |
|---|---|---|
| Alama | 5.3 | 5.1 |
| Nafasi | #288 | #295 |
| Uaminifu | 8.6 | 9.9 |
| Uthabiti | 8.1 | 6.0 |
| Majaribio | 66/66 | 66/66 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 36.4% | 48.5% |
| Majaribio yasiyo thabiti | 5 | 11 |
| Jumla ya uendeshaji | 66 | 66 |
| Gharama kwa matokeo | 2.503 | 0.000 |
| Jumla ya gharama | $0.151 | $0.156 |
| Bei ya ingizo | $0.500 / 1M | $0.080 / 1M |
| Bei ya toleo | $3.000 / 1M | $0.200 / 1M |
| Jumla ya tokeni za ingizo | 159,749 | 126,330 |
| Tokeni za matokeo | 23,433 | 165,702 |
| Tokeni za hoja | 0 | 594,739 |
| Muda wa majibu (wastani) | 14.67s | 70.11s |
| Muda wa majibu (upeo) | 132.84s | 437.11s |
| Muda wa majibu (jumla) | 322.71s | 1542.52s |
| Vigezo | ~200B jumla (~20B vinavyotumika) | 30B jumla (3B vinavyotumika) |
| Upatikanaji | Imefungwa | Uzani unapatikana |
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#288 Seed-2.0-Code
none- Gharama
- $0.030
- Muda
- 140.6s
- Tokeni
- 9,924 tok
#295 Nemotron 3.5 Lightning
medium- Gharama
- $0.000
- Muda
- 130.5s
- Tokeni
- 6,750 tok
Modeli bora kwa alama
Alama dhidi ya gharama ya jumla
Muda wa majibu (wastani)
Alama vs Muda wa majibu (wastani)
Jumla ya tokeni za matokeo
Alama vs Jumla ya tokeni za matokeo
Mgawanyo wa kategoria
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Code | 3.0 | 5.9 | 16.7% | 2 | 5.06s | 894 | 1,435 | 0 | |
| Nemotron 3.5 Lightning | 6.9 | 7.9 | 66.7% | 1 | 12.34s | 696 | 6,904 | 20,862 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Code | 3.6 | 9.8 | 0.0% | 0 | 13.42s | 7,230 | 505 | 0 | |
| Nemotron 3.5 Lightning | 4.4 | 5.1 | 33.3% | 2 | 285.47s | 7,623 | 78,065 | 297,359 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Code | 3.0 | 10.0 | 0.0% | 0 | 78.38s | 130,859 | 19,874 | 0 | |
| Nemotron 3.5 Lightning | 6.2 | 5.8 | 66.7% | 1 | 136.91s | 98,571 | 15,769 | 112,376 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Code | 10.0 | 10.0 | 100.0% | 0 | 4.53s | 8,028 | 246 | 0 | |
| Nemotron 3.5 Lightning | 3.7 | 1.7 | 50.0% | 2 | 23.24s | 7,944 | 4,195 | 30,097 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Code | 3.5 | 4.4 | 33.3% | 2 | 1.91s | 948 | 18 | 0 | |
| Nemotron 3.5 Lightning | 2.9 | 4.4 | 22.2% | 2 | 74.73s | 798 | 54,657 | 91,174 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Code | 5.0 | 10.0 | 0.0% | 0 | 2.82s | 570 | 247 | 0 | |
| Nemotron 3.5 Lightning | 5.5 | 10.0 | 0.0% | 0 | 4.36s | 516 | 3,127 | 3,157 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Code | 6.2 | 5.8 | 66.7% | 1 | 1.80s | 810 | 254 | 0 | |
| Nemotron 3.5 Lightning | 8.5 | 6.8 | 83.3% | 1 | 3.75s | 723 | 531 | 4,404 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Code | 7.7 | 10.0 | 66.7% | 0 | 10.04s | 858 | 592 | 0 | |
| Nemotron 3.5 Lightning | 4.2 | 4.4 | 44.5% | 2 | 10.49s | 726 | 1,170 | 18,195 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Code | 10.0 | 10.0 | 100.0% | 0 | 48.81s | 9,288 | 247 | 0 | |
| Nemotron 3.5 Lightning | 10.0 | 10.0 | 100.0% | 0 | 4.92s | 8,526 | 154 | 2,518 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Code | 3.0 | 10.0 | 0.0% | 0 | 5.36s | 264 | 15 | 0 | |
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 44.02s | 207 | 1,130 | 14,597 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
Mistral Small 4nonevsNemotron 3.5 LightningmediumInapatikana bureGranite 4.2 8BlowvsNemotron 3.5 LightningmediumInapatikana bureNemotron 3.5 LightningmediumInapatikana burevsQwen3 Coder NextnoneMercury 2.5lowvsNemotron 3.5 LightningmediumInapatikana bureNemotron 3.5 LightningmediumInapatikana burevsMiMo-V2.5noneNemotron 3.5 LightningmediumInapatikana burevsQwen3.5-9BnoneSeed-2.0-CodenonevsLaguna S 2.1highInapatikana bureNemotron 3.5 LightningmediumInapatikana burevsInklingnoneDots 3 Note PreviewnoneInapatikana burevsNemotron 3.5 LightningmediumInapatikana bureNorth Mini CodenoneInapatikana burevsNemotron 3.5 LightningmediumInapatikana bureSeed-2.0-CodenonevsKAT-Coder-Air V2.5lowSeed-2.0-CodenonevsGranite 4.2 8Bmedium