Urambazaji
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Gemini 3.1 Flash Lite (medium) vs KAT-Coder-Pro V2.5 (high)

Gemini 3.1 Flash Lite (medium) inaongoza kwa average score: 7.3 vs 7.2. Gemini 3.1 Flash Lite (medium) ina gharama ya chini ya benchmark: $0.120 vs $0.506. Gemini 3.1 Flash Lite (medium) ni ya haraka zaidi: 4.38s vs 22.11s, na pass rates 62.1% vs 63.6%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-08-26

Nafasi
#103
Jumla ya tokeni za matokeo
62,356
Muda wa majibu (wastani)
4.38s
Jumla ya gharama
$0.120
Nafasi
#108
Jumla ya tokeni za matokeo
144,359
Muda wa majibu (wastani)
22.11s
Jumla ya gharama
$0.506
Muundo unaopendekezwa Gemini 3.1 Flash Lite (medium)

It has the best score here (7.3), while costing about 4.2x less than KAT-Coder-Pro V2.5 (high).

Ulinganisho wa kina

Kipimo Gemini 3.1 Flash Lite Gemini 3.1 Flash Lite medium Toleo: 2026-05-08 KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 high Toleo: 2026-07-14
Alama 7.3 7.2
Nafasi #103 #108
Uaminifu 10.0 10.0
Uthabiti 9.2 7.8
Majaribio 66/66 66/66
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 62.1% 63.6%
Majaribio yasiyo thabiti 2 6
Jumla ya uendeshaji 66 66
Gharama kwa matokeo 0.922 4.599
Jumla ya gharama $0.120 $0.506
Bei ya ingizo $0.250 / 1M $0.740 / 1M
Bei ya toleo $1.500 / 1M $2.960 / 1M
Jumla ya tokeni za ingizo 104,925 106,085
Tokeni za matokeo 9,168 9,071
Tokeni za hoja 53,188 135,288
Muda wa majibu (wastani) 4.38s 22.11s
Muda wa majibu (upeo) 26.22s 199.97s
Muda wa majibu (jumla) 96.32s 486.31s
Vigezo ~150B jumla (~10B vinavyotumika) ~700B jumla (~72B vinavyotumika)
Upatikanaji Imefungwa Imefungwa

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#103 Gemini 3.1 Flash Lite

medium
Gharama
$0.003
Muda
5.3s
Tokeni
1,754 tok

#108 KAT-Coder-Pro V2.5

high
Gharama
$0.009
Muda
26.4s
Tokeni
3,117 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Gemini 3.1 Flash Lite 5.5 10.0 33.3% 0 3.81s 8,134 459 8,978
KAT-Coder-Pro V2.5 6.4 7.9 44.4% 1 22.00s 7,893 422 20,461

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho