#38 Gemini 2.5 Flash
medium
SVG batili
- Gharama
- $0.000
- Muda
- 274.0s
- Tokeni
- 0 tok
Google
Toleo: 2025-06-17
Imepimwa tarehe: 2026-05-22 00:32
google/gemini-2.5-flash::medium
~350B jumla (~20B vinavyotumika)MoEImefungwaMakadirio
(medium)
(none)
Muhtasari
Gemini 2.5 Flash hupata alama 7.7 kwenye AI BENCHY na iko nafasi ya #38. Ina reliability 10.0, pass rate 68.3%, gharama jumla $0.358, na wastani wa response time 15.69s.
Kinachofanya Gemini 2.5 Flash iwe ya kipekee: Inaonekana zaidi kwenye Mahususi kwa domeni, ambako iko #2; huku Uandishi wa msimbo ikiwa eneo lake dhaifu zaidi kwenye #18. Gharama yake ya benchmark ni ya chini isivyo kawaida kwa kiwango hiki cha score.
Taarifa za modeli
Ilifanyiwa utafiti tarehe 2026-08-12
- Vigezo
- ~350B jumla (~20B vinavyotumika)
- Muundo
- MoE
- Upatikanaji
- Imefungwa
- Leseni
- -
Makadirio bora kulingana na ushahidi wa umma; mtoa huduma hakufichua thamani zote.
7.7
Uthabiti
9.6
10.0
Jumla ya tokeni za matokeo
139,179
Jumla ya tokeni za ingizo
0
Bei ya ingizo
$0.300 / 1M
Bei ya toleo
$2.500 / 1M
Majaribio yasiyo thabiti
1
Majaribio yasiyo thabiti yalikuwa na matokeo mchanganyiko kati ya run (angalau kupita moja na kufeli moja).
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
Historia ya uendeshaji
| Imepimwa tarehe | Alama | Uaminifu | Majaribio sahihi | Jumla ya gharama | Linganisha |
|---|---|---|---|---|---|
| 2026-08-14 02:45 Jaribio tena | 8.2 | 10.0 | $0.644 | Linganisha | |
| 2026-07-16 23:00 Jaribio jipya limeongezwa | 8.2 | 10.0 | $0.643 | Linganisha | |
| 2026-06-04 14:01 Jaribio jipya limeongezwa | 7.8 | 10.0 | $0.379 | Linganisha | |
| 2026-05-22 00:32 Suite imebadilika | 7.7 | 10.0 | $0.358 | Uendeshaji wa sasa | |
| 2026-04-11 01:44 Jaribio la kwanza lililorekodiwa | 8.2 | Haipo | $0.319 | Linganisha |
Uendeshaji huu ulitumia suite tofauti ya benchmark. Zingatia mabadiliko ya suite unapochambua mwenendo wa kihistoria.
Ulinganisho wa uendeshaji
| Uendeshaji | Ufunikaji wa benchmark | Alama | Uthabiti | Uaminifu | Majaribio sahihi | Majaribio yasiyo thabiti | Jumla ya tokeni za matokeo | Jumla ya tokeni za ingizo | Jumla ya gharama | Muda wa majibu (wastani) |
|---|---|---|---|---|---|---|---|---|---|---|
| 2026-05-22 00:32 · Suite imebadilika | marudio 60/60 | 7.7 | 9.6 | 10.0 | 13/20 | 1 | 139,179 | 0 | $0.358 | 15.69s |
| 2026-08-14 02:45 · Jaribio tena | marudio 66/66 | 8.2 | 9.6 | 10.0 | 15/22 | 1 | 241,365 | 132,507 | $0.644 | 21.14s |
| Tofauti | — | -0.5 | 0.0 | 0.0 | -2 | 0 | -102186 | -132507 | -$0.286 | -5453ms |
Ufunikaji wa benchmark unatofautiana: marudio 60/60 (Lengo: marudio 3 kwa kila jaribio) dhidi ya marudio 66/66 (Lengo: marudio 3 kwa kila jaribio). Jumla na vipimo vinavyoathiriwa na marudio haviwezi kulinganishwa moja kwa moja.
Uendeshaji huu miwili ulitumia suite tofauti za benchmark, hivyo tofauti zinaonyesha mabadiliko ya modeli na ya suite pia.
Chati
Chagua modeli ya kwanza, kisha bofya modeli ya pili kufungua ukurasa wa kulinganisha bega kwa bega.
Modeli bora kwa alama
Alama vs Jumla ya gharama
Muda wa majibu (wastani)
Alama vs Muda wa majibu (wastani)
Jumla ya tokeni za matokeo
Alama vs Jumla ya tokeni za matokeo
Ulinganisho wa haraka
Gemini 2.5 FlashmediumvsMuse Spark 1.1lowGemini 2.5 FlashmediumvsClaude Sonnet 5mediumGemini 2.5 FlashmediumvsInkling SmallhighGemini 2.5 FlashmediumvsQwen3.8 2.4T A95BlowGemini 2.5 FlashmediumvsSeed 2.1 TurbomediumGemini 2.5 FlashmediumvsGPT-5 MinimediumGemini 2.5 FlashmediumvsQwen3.8 27BhighGemini 2.5 FlashmediumvsMuse Glimmer 30BxhighGemini 2.5 FlashmediumvsGPT-5.2mediumGemini 2.5 FlashmediumvsInklinghigh
Mgawanyo wa kategoria
| Kategoria | Alama | Uthabiti | Majaribio sahihi |
|---|---|---|---|
| Mbinu za kupinga AI | 8.4 | 10.0 | |
| Uandishi wa msimbo | 6.6 | 10.0 | |
| Mchanganyiko | 10.0 | 10.0 | |
| Uchanganuzi na uchimbaji wa data | 10.0 | 10.0 | |
| Mahususi kwa domeni | 5.9 | 7.2 | |
| Akili ya jumla | 4.8 | 10.0 | |
| Ufuataji wa maagizo | 9.8 | 10.0 | |
| Utatuzi wa mafumbo | 7.7 | 10.0 | |
| Mwito wa zana | 10.0 | 10.0 | |
| Maarifa ya jumla | 3.0 | 10.0 |