AI BENCHY

Ubao wa Viwango wa Benchmark ya AI

Fuatilia modeli bora za AI za kiwango cha SOTA kwa leaderboard ya AI BENCHY—njia rahisi ya kuona ni modeli zipi zinaongoza sasa kwa alama, ubora wa hoja, uaminifu na thamani. Panga kwa: Muda wa majibu (wastani) ↑.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-03-06 Modeli zilizotathminiwa: 55

Tafuta 0/0

Nafasi	Modeli	Kampuni	Alama	Gharama kwa matokeo	Jumla ya gharama	Muda wa majibu (wastani)
🥇 #1	Mercury 2none	Inception	3.4	0.153	$0.007	596ms
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 12 Kiwango cha kupita kwa kila jaribio: 31.3% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 1,303 Tokeni za hoja: 0 Muda wa majibu: wastani 596ms · jumla 9.54s · upeo 1.27s Jibu lisilo sahihi: 11 Hakufuata maelekezo: 1 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 5.5 Domain specific: 4.0 General Intelligence: 4.0 Instructions following: 5.5 Puzzle Solving: 10.0 Tool Calling: 10.0
🥈 #2	LFM2-24B-A2Bnone	Liquid	2.6	0.047	$0.001	811ms
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 15 Kiwango cha kupita kwa kila jaribio: 14.6% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 1,185 Tokeni za hoja: 0 Muda wa majibu: wastani 811ms · jumla 11.35s · upeo 2.88s Jibu lisilo sahihi: 9 Hitilafu ya API: 4 Hakufuata maelekezo: 2 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 10.0 Domain specific: 4.0 General Intelligence: 3.0 Instructions following: 4.5 Puzzle Solving: 3.3 Tool Calling: 10.0
🥉 #3	Gemini 2.5 Flashnone	Google	5.2	0.191	$0.012	923ms
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 10 Kiwango cha kupita kwa kila jaribio: 43.8% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 1,270 Tokeni za hoja: 0 Muda wa majibu: wastani 923ms · jumla 14.78s · upeo 4.39s Jibu lisilo sahihi: 9 Hakufuata maelekezo: 1 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 5.0 Instructions following: 9.0 Puzzle Solving: 4.7 Tool Calling: 10.0
#4	Gemini 3.1 Flash Lite Previewnone	Google	7.1	0.144	$0.015	1.33s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 6 Kiwango cha kupita kwa kila jaribio: 66.7% Majaribio yasiyo thabiti: 1 Tokeni za matokeo: 4,715 Tokeni za hoja: 0 Muda wa majibu: wastani 1.33s · jumla 21.27s · upeo 3.39s Jibu lisilo sahihi: 4 Hakufuata maelekezo: 2 Anti-AI Tricks: 6.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 3.0 Instructions following: 10.0 Puzzle Solving: 10.0 Tool Calling: 10.0
#5	GPT-5.4none	OpenAI	4.5	1.562	$0.094	1.48s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 10 Kiwango cha kupita kwa kila jaribio: 41.7% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 1,819 Tokeni za hoja: 0 Muda wa majibu: wastani 1.48s · jumla 23.64s · upeo 2.89s Jibu lisilo sahihi: 9 Hakufuata maelekezo: 1 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 3.0 Instructions following: 5.5 Puzzle Solving: 4.0 Tool Calling: 10.0
#6	Gemini 3 Flash Previewnone	Google	7.2	0.169	$0.019	1.75s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 5 Kiwango cha kupita kwa kila jaribio: 75.0% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 1,411 Tokeni za hoja: 0 Muda wa majibu: wastani 1.75s · jumla 15.71s · upeo 3.56s Jibu lisilo sahihi: 5 Anti-AI Tricks: 7.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 7.0 General Intelligence: 10.0 Instructions following: 5.5 Puzzle Solving: 7.0 Tool Calling: 10.0
#7	Qwen3.5-27Bnone	Qwen	4.9	0.302	$0.016	1.75s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 11 Kiwango cha kupita kwa kila jaribio: 37.5% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 3,161 Tokeni za hoja: 0 Muda wa majibu: wastani 1.75s · jumla 28.05s · upeo 9.39s Jibu lisilo sahihi: 9 Hakufuata maelekezo: 2 Anti-AI Tricks: 4.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 10.0 General Intelligence: 5.0 Instructions following: 4.5 Puzzle Solving: 6.3 Tool Calling: 10.0
#8	Grok 4.1 Fastnone	X AI	2.9	0.247	$0.008	1.90s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 13 Kiwango cha kupita kwa kila jaribio: 25.0% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 1,148 Tokeni za hoja: 0 Muda wa majibu: wastani 1.90s · jumla 17.14s · upeo 5.51s Jibu lisilo sahihi: 11 Hakufuata maelekezo: 2 Anti-AI Tricks: 1.3 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 3.0 Instructions following: 10.0 Puzzle Solving: 1.3 Tool Calling: 10.0
#9	GPT-4o-mininone	OpenAI	4.0	0.114	$0.005	2.07s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 12 Kiwango cha kupita kwa kila jaribio: 25.0% Majaribio yasiyo thabiti: 0 Tokeni za matokeo: 1,594 Tokeni za hoja: 0 Muda wa majibu: wastani 2.07s · jumla 18.60s · upeo 7.58s Jibu lisilo sahihi: 11 Hakufuata maelekezo: 1 Anti-AI Tricks: 4.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 10.0 General Intelligence: 3.0 Instructions following: 4.5 Puzzle Solving: 2.3 Tool Calling: 10.0
#10	Mercury 2medium	Inception	5.3	0.631	$0.045	2.36s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 9 Kiwango cha kupita kwa kila jaribio: 54.2% Majaribio yasiyo thabiti: 3 Tokeni za matokeo: 3,708 Tokeni za hoja: 45,921 Muda wa majibu: wastani 2.36s · jumla 35.39s · upeo 14.63s Jibu lisilo sahihi: 5 Hakufuata maelekezo: 4 Anti-AI Tricks: 7.3 Combined: 10.0 Data parsing and extraction: 5.5 Domain specific: 10.0 General Intelligence: 4.0 Instructions following: 10.0 Puzzle Solving: 1.7 Tool Calling: 10.0
#11	Qwen3.5 Plus 2026-02-15none	Qwen	6.2	0.172	$0.016	2.65s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 7 Kiwango cha kupita kwa kila jaribio: 58.3% Majaribio yasiyo thabiti: 1 Tokeni za matokeo: 2,015 Tokeni za hoja: 0 Muda wa majibu: wastani 2.65s · jumla 26.52s · upeo 6.65s Jibu lisilo sahihi: 7 Anti-AI Tricks: 4.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 4.0 Instructions following: 10.0 Puzzle Solving: 7.0 Tool Calling: 10.0
#12	MiMo-V2-Flashnone	Xiaomi	2.9	0.743	$0.023	2.97s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 13 Kiwango cha kupita kwa kila jaribio: 29.2% Majaribio yasiyo thabiti: 4 Tokeni za matokeo: 67,790 Tokeni za hoja: 0 Muda wa majibu: wastani 2.97s · jumla 35.60s · upeo 19.68s Jibu lisilo sahihi: 10 Hitilafu ya API: 1 Muundo wa ziada: 1 Hakufuata maelekezo: 1 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 10.0 Domain specific: 4.0 General Intelligence: 4.0 Instructions following: 5.5 Puzzle Solving: 10.0 Tool Calling: 10.0
#13	GLM 4.7 Flashnone	Z.ai	3.9	0.066	$0.003	2.99s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 12 Kiwango cha kupita kwa kila jaribio: 35.4% Majaribio yasiyo thabiti: 3 Tokeni za matokeo: 1,855 Tokeni za hoja: 0 Muda wa majibu: wastani 2.99s · jumla 26.90s · upeo 7.05s Jibu lisilo sahihi: 9 Hakufuata maelekezo: 2 common.failureReasons.invalid_tool_call: 1 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 5.4 Domain specific: 7.0 General Intelligence: 3.0 Instructions following: 5.5 Puzzle Solving: 3.7 Tool Calling: 10.0
#14	Trinity Large Previewnone	Arcee AI	4.2	0.000	$0.000	3.15s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 11 Kiwango cha kupita kwa kila jaribio: 33.3% Majaribio yasiyo thabiti: 1 Tokeni za matokeo: 1,837 Tokeni za hoja: 0 Muda wa majibu: wastani 3.15s · jumla 50.46s · upeo 8.91s Jibu lisilo sahihi: 9 Hakufuata maelekezo: 2 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 3.0 Instructions following: 3.5 Puzzle Solving: 4.0 Tool Calling: 10.0
#15	Gemini 3.1 Flash Lite Previewlow	Google	7.3	0.177	$0.020	3.36s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 5 Kiwango cha kupita kwa kila jaribio: 68.8% Majaribio yasiyo thabiti: 0 Tokeni za matokeo: 1,611 Tokeni za hoja: 7,272 Muda wa majibu: wastani 3.36s · jumla 53.84s · upeo 11.91s Jibu lisilo sahihi: 4 Hakufuata maelekezo: 1 Anti-AI Tricks: 7.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 3.0 Instructions following: 10.0 Puzzle Solving: 10.0 Tool Calling: 10.0
#16	Qwen3.5-Flashnone	Qwen	5.2	0.077	$0.006	3.54s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 9 Kiwango cha kupita kwa kila jaribio: 45.8% Majaribio yasiyo thabiti: 1 Tokeni za matokeo: 3,774 Tokeni za hoja: 0 Muda wa majibu: wastani 3.54s · jumla 56.70s · upeo 13.73s Jibu lisilo sahihi: 8 Hakufuata maelekezo: 1 Anti-AI Tricks: 2.3 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 7.0 General Intelligence: 10.0 Instructions following: 5.0 Puzzle Solving: 1.3 Tool Calling: 10.0
#17	Qwen3.5-122B-A10Bnone	Qwen	5.0	0.333	$0.020	3.72s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 10 Kiwango cha kupita kwa kila jaribio: 39.6% Majaribio yasiyo thabiti: 1 Tokeni za matokeo: 2,679 Tokeni za hoja: 0 Muda wa majibu: wastani 3.72s · jumla 59.46s · upeo 46.00s Jibu lisilo sahihi: 9 Hakufuata maelekezo: 1 Anti-AI Tricks: 4.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 5.0 Instructions following: 4.5 Puzzle Solving: 4.0 Tool Calling: 10.0
#18	Gemini 3.1 Flash Lite Previewmedium	Google	7.5	0.443	$0.049	3.83s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 5 Kiwango cha kupita kwa kila jaribio: 68.8% Majaribio yasiyo thabiti: 0 Tokeni za matokeo: 1,731 Tokeni za hoja: 25,821 Muda wa majibu: wastani 3.83s · jumla 61.25s · upeo 14.93s Jibu lisilo sahihi: 4 Hakufuata maelekezo: 1 Anti-AI Tricks: 9.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 10.0 General Intelligence: 10.0 Instructions following: 10.0 Puzzle Solving: 7.0 Tool Calling: 10.0
#19	GLM 5none	Z.ai	6.0	0.200	$0.018	4.03s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 7 Kiwango cha kupita kwa kila jaribio: 56.3% Majaribio yasiyo thabiti: 0 Tokeni za matokeo: 1,548 Tokeni za hoja: 0 Muda wa majibu: wastani 4.03s · jumla 36.30s · upeo 11.07s Jibu lisilo sahihi: 7 Anti-AI Tricks: 4.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 10.0 General Intelligence: 10.0 Instructions following: 10.0 Puzzle Solving: 7.0 Tool Calling: 10.0
#20	Qwen3.5-35B-A3Bnone	Qwen	4.7	0.237	$0.015	4.10s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 10 Kiwango cha kupita kwa kila jaribio: 50.0% Majaribio yasiyo thabiti: 3 Tokeni za matokeo: 3,756 Tokeni za hoja: 0 Muda wa majibu: wastani 4.10s · jumla 65.62s · upeo 47.43s Jibu lisilo sahihi: 8 Hakufuata maelekezo: 2 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 7.0 General Intelligence: 6.0 Instructions following: 5.0 Puzzle Solving: 1.7 Tool Calling: 10.0
#21	Claude Sonnet 4.6none	Anthropic	6.8	2.504	$0.251	5.57s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 6 Kiwango cha kupita kwa kila jaribio: 66.7% Majaribio yasiyo thabiti: 1 Tokeni za matokeo: 6,895 Tokeni za hoja: 0 Muda wa majibu: wastani 5.57s · jumla 50.12s · upeo 23.84s Muundo wa ziada: 3 Jibu lisilo sahihi: 2 Hakufuata maelekezo: 1 Anti-AI Tricks: 4.0 Combined: 9.0 Data parsing and extraction: 9.9 Domain specific: 7.0 General Intelligence: 5.0 Instructions following: 5.5 Puzzle Solving: 7.0 Tool Calling: 10.0
#22	GPT-5.3 Chatnone	OpenAI	7.3	3.163	$0.317	5.96s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 6 Kiwango cha kupita kwa kila jaribio: 70.8% Majaribio yasiyo thabiti: 3 Tokeni za matokeo: 19,272 Tokeni za hoja: 0 Muda wa majibu: wastani 5.96s · jumla 95.30s · upeo 18.33s Jibu lisilo sahihi: 4 Hakufuata maelekezo: 2 Anti-AI Tricks: 7.3 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 10.0 General Intelligence: 4.0 Instructions following: 9.0 Puzzle Solving: 10.0 Tool Calling: 10.0
#23	Gemini 3 Flash Previewlow	Google	8.2	0.607	$0.079	6.11s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 3 Kiwango cha kupita kwa kila jaribio: 83.3% Majaribio yasiyo thabiti: 1 Tokeni za matokeo: 1,586 Tokeni za hoja: 19,950 Muda wa majibu: wastani 6.11s · jumla 97.74s · upeo 14.72s Jibu lisilo sahihi: 3 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 10.0 Instructions following: 9.5 Puzzle Solving: 10.0 Tool Calling: 10.0
#24	GPT-5.2 Chatnone	OpenAI	7.4	2.440	$0.269	7.03s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 5 Kiwango cha kupita kwa kila jaribio: 75.0% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 15,845 Tokeni za hoja: 0 Muda wa majibu: wastani 7.03s · jumla 112.51s · upeo 38.52s Jibu lisilo sahihi: 4 Hakufuata maelekezo: 1 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 4.0 Instructions following: 6.0 Puzzle Solving: 7.0 Tool Calling: 10.0
#25	Gemini 3 Pro Previewmedium	Google	8.2	1.477	$0.192	7.15s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 3 Kiwango cha kupita kwa kila jaribio: 81.3% Majaribio yasiyo thabiti: 0 Tokeni za matokeo: 1,502 Tokeni za hoja: 9,706 Muda wa majibu: wastani 7.15s · jumla 64.34s · upeo 11.96s Jibu lisilo sahihi: 3 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 10.0 Instructions following: 9.5 Puzzle Solving: 10.0 Tool Calling: 10.0
#26	Claude Sonnet 4.6medium	Anthropic	7.7	8.525	$1.023	11.23s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 4 Kiwango cha kupita kwa kila jaribio: 77.1% Majaribio yasiyo thabiti: 1 Tokeni za matokeo: 35,159 Tokeni za hoja: 24,687 Muda wa majibu: wastani 11.23s · jumla 89.84s · upeo 46.35s Muundo wa ziada: 2 Muda umeisha: 1 Jibu lisilo sahihi: 1 Anti-AI Tricks: 7.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 10.0 General Intelligence: 10.0 Instructions following: 10.0 Puzzle Solving: 10.0 Tool Calling: 10.0
#27	Qwen3 Coder Nextnone	Qwen	4.0	0.174	$0.007	11.68s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 12 Kiwango cha kupita kwa kila jaribio: 25.0% Majaribio yasiyo thabiti: 0 Tokeni za matokeo: 3,026 Tokeni za hoja: 0 Muda wa majibu: wastani 11.68s · jumla 116.76s · upeo 45.14s Jibu lisilo sahihi: 10 Muundo wa ziada: 1 Hakufuata maelekezo: 1 Anti-AI Tricks: 2.3 Combined: 10.0 Data parsing and extraction: 5.4 Domain specific: 4.0 General Intelligence: 10.0 Instructions following: 4.5 Puzzle Solving: 1.3 Tool Calling: 10.0
#28	Kimi K2.5none	Moonshot AI	4.1	0.295	$0.015	11.91s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 11 Kiwango cha kupita kwa kila jaribio: 39.6% Majaribio yasiyo thabiti: 3 Tokeni za matokeo: 2,000 Tokeni za hoja: 0 Muda wa majibu: wastani 11.91s · jumla 107.16s · upeo 42.13s Jibu lisilo sahihi: 11 Anti-AI Tricks: 2.7 Combined: 10.0 Data parsing and extraction: 5.4 Domain specific: 4.0 General Intelligence: 10.0 Instructions following: 5.5 Puzzle Solving: 10.0 Tool Calling: 10.0
#29	Gemini 2.5 Flashmedium	Google	7.4	2.619	$0.288	12.35s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 5 Kiwango cha kupita kwa kila jaribio: 72.9% Majaribio yasiyo thabiti: 1 Tokeni za matokeo: 1,370 Tokeni za hoja: 110,522 Muda wa majibu: wastani 12.35s · jumla 197.62s · upeo 95.48s Jibu lisilo sahihi: 4 Hakufuata maelekezo: 1 Anti-AI Tricks: 7.3 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 4.0 Instructions following: 9.5 Puzzle Solving: 7.0 Tool Calling: 10.0
#30	Gemini 3 Flash Previewmedium	Google	10.0	1.025	$0.164	12.36s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 0 Kiwango cha kupita kwa kila jaribio: 100.0% Majaribio yasiyo thabiti: 0 Tokeni za matokeo: 1,634 Tokeni za hoja: 47,907 Muda wa majibu: wastani 12.36s · jumla 111.21s · upeo 50.16s Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 10.0 General Intelligence: 10.0 Instructions following: 10.0 Puzzle Solving: 10.0 Tool Calling: 10.0
#31	Qwen3 Coder Nextmedium	Qwen	3.5	0.230	$0.007	12.53s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 13 Kiwango cha kupita kwa kila jaribio: 27.1% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 2,935 Tokeni za hoja: 0 Muda wa majibu: wastani 12.53s · jumla 125.32s · upeo 81.80s Jibu lisilo sahihi: 8 Hakufuata maelekezo: 5 Anti-AI Tricks: 1.3 Combined: 10.0 Data parsing and extraction: 5.4 Domain specific: 4.0 General Intelligence: 6.0 Instructions following: 4.5 Puzzle Solving: 10.0 Tool Calling: 10.0
#32	DeepSeek V3.2none	DeepSeek	5.5	0.220	$0.016	12.86s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 9 Kiwango cha kupita kwa kila jaribio: 54.2% Majaribio yasiyo thabiti: 3 Tokeni za matokeo: 7,823 Tokeni za hoja: 0 Muda wa majibu: wastani 12.86s · jumla 205.78s · upeo 115.89s Jibu lisilo sahihi: 6 Muundo wa ziada: 2 common.failureReasons.invalid_tool_call: 1 Anti-AI Tricks: 10.0 Combined: 8.0 Data parsing and extraction: 5.4 Domain specific: 10.0 General Intelligence: 10.0 Instructions following: 10.0 Puzzle Solving: 7.7 Tool Calling: 10.0
#33	GPT-5.2medium	OpenAI	6.5	3.125	$0.313	15.33s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 6 Kiwango cha kupita kwa kila jaribio: 75.0% Majaribio yasiyo thabiti: 4 Tokeni za matokeo: 2,220 Tokeni za hoja: 16,811 Muda wa majibu: wastani 15.33s · jumla 138.01s · upeo 77.80s Hakufuata maelekezo: 3 Hakuna jibu: 1 Muda umeisha: 1 Jibu lisilo sahihi: 1 Anti-AI Tricks: 7.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 10.0 Instructions following: 9.5 Puzzle Solving: 7.0 Tool Calling: 10.0
#34	GLM 5medium	Z.ai	7.4	0.933	$0.103	16.16s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 5 Kiwango cha kupita kwa kila jaribio: 83.3% Majaribio yasiyo thabiti: 4 Tokeni za matokeo: 19,773 Tokeni za hoja: 36,459 Muda wa majibu: wastani 16.16s · jumla 129.26s · upeo 28.96s Jibu lisilo sahihi: 2 Hakufuata maelekezo: 1 Hakuna jibu: 1 Muda umeisha: 1 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 5.0 Domain specific: 10.0 General Intelligence: 5.0 Instructions following: 10.0 Puzzle Solving: 10.0 Tool Calling: 10.0
#35	GPT-5.3-Codexmedium	OpenAI	8.4	4.485	$0.539	16.59s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 4 Kiwango cha kupita kwa kila jaribio: 83.3% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 1,764 Tokeni za hoja: 33,348 Muda wa majibu: wastani 16.59s · jumla 265.39s · upeo 100.93s Hakufuata maelekezo: 2 Jibu lisilo sahihi: 2 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 4.0 Instructions following: 10.0 Puzzle Solving: 9.3 Tool Calling: 10.0
#36	Gemini 3.1 Pro Previewmedium	Google	9.4	3.417	$0.513	16.60s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 1 Kiwango cha kupita kwa kila jaribio: 93.8% Majaribio yasiyo thabiti: 0 Tokeni za matokeo: 1,521 Tokeni za hoja: 35,656 Muda wa majibu: wastani 16.60s · jumla 149.36s · upeo 40.61s Jibu lisilo sahihi: 1 Anti-AI Tricks: 10.0 Combined: 9.0 Data parsing and extraction: 9.9 Domain specific: 7.0 General Intelligence: 10.0 Instructions following: 10.0 Puzzle Solving: 10.0 Tool Calling: 10.0
#37	gpt-oss-120bmedium	OpenAI	5.1	0.135	$0.010	16.65s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 9 Kiwango cha kupita kwa kila jaribio: 54.2% Majaribio yasiyo thabiti: 5 Tokeni za matokeo: 13,210 Tokeni za hoja: 34,230 Muda wa majibu: wastani 16.65s · jumla 149.88s · upeo 50.92s Jibu lisilo sahihi: 5 Hakufuata maelekezo: 4 Anti-AI Tricks: 7.0 Combined: 10.0 Data parsing and extraction: 5.5 Domain specific: 10.0 General Intelligence: 3.0 Instructions following: 9.5 Puzzle Solving: 1.7 Tool Calling: 9.0
#38	GPT-5.4medium	OpenAI	8.0	6.601	$0.793	20.05s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 4 Kiwango cha kupita kwa kila jaribio: 83.3% Majaribio yasiyo thabiti: 3 Tokeni za matokeo: 1,756 Tokeni za hoja: 46,642 Muda wa majibu: wastani 20.05s · jumla 320.87s · upeo 100.41s Hakufuata maelekezo: 2 Jibu lisilo sahihi: 2 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 5.0 Instructions following: 10.0 Puzzle Solving: 7.0 Tool Calling: 10.0
#39	Claude Opus 4.6medium	Anthropic	6.6	13.118	$1.312	22.86s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 6 Kiwango cha kupita kwa kila jaribio: 66.7% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 26,254 Tokeni za hoja: 17,363 Muda wa majibu: wastani 22.86s · jumla 205.71s · upeo 83.40s Muundo wa ziada: 4 Jibu lisilo sahihi: 2 Anti-AI Tricks: 4.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 10.0 General Intelligence: 10.0 Instructions following: 10.0 Puzzle Solving: 7.0 Tool Calling: 10.0
#40	GPT-5 Minimedium	OpenAI	6.0	1.457	$0.117	25.14s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 8 Kiwango cha kupita kwa kila jaribio: 58.3% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 5,826 Tokeni za hoja: 48,768 Muda wa majibu: wastani 25.14s · jumla 402.29s · upeo 88.15s Hakufuata maelekezo: 4 Jibu lisilo sahihi: 3 Muda umeisha: 1 Anti-AI Tricks: 7.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 10.0 General Intelligence: 4.0 Instructions following: 7.5 Puzzle Solving: 4.3 Tool Calling: 10.0
#41	MiMo-V2-Flashmedium	Xiaomi	7.2	0.316	$0.035	25.33s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 5 Kiwango cha kupita kwa kila jaribio: 72.9% Majaribio yasiyo thabiti: 1 Tokeni za matokeo: 11,613 Tokeni za hoja: 106,714 Muda wa majibu: wastani 25.33s · jumla 253.33s · upeo 96.01s Jibu lisilo sahihi: 3 Hitilafu ya API: 1 Hakufuata maelekezo: 1 Anti-AI Tricks: 9.7 Combined: 9.0 Data parsing and extraction: 5.5 Domain specific: 4.0 General Intelligence: 3.0 Instructions following: 10.0 Puzzle Solving: 7.0 Tool Calling: 10.0
#42	Grok 4.1 Fastmedium	X AI	6.2	0.563	$0.051	26.35s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 7 Kiwango cha kupita kwa kila jaribio: 66.7% Majaribio yasiyo thabiti: 4 Tokeni za matokeo: 1,183 Tokeni za hoja: 83,875 Muda wa majibu: wastani 26.35s · jumla 237.11s · upeo 121.79s Hakufuata maelekezo: 3 Jibu lisilo sahihi: 2 Hakuna jibu: 1 Muda umeisha: 1 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 3.0 Instructions following: 5.5 Puzzle Solving: 4.0 Tool Calling: 10.0
#43	Step 3.5 Flashmedium	Stepfun	7.4	0.000	$0.000	29.10s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 6 Kiwango cha kupita kwa kila jaribio: 68.8% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 71,452 Tokeni za hoja: 155,147 Muda wa majibu: wastani 29.10s · jumla 290.96s · upeo 170.45s Hakufuata maelekezo: 3 Jibu lisilo sahihi: 3 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 10.0 Domain specific: 4.0 General Intelligence: 6.0 Instructions following: 9.0 Puzzle Solving: 4.0 Tool Calling: 10.0
#44	Qwen3.5-122B-A10Bmedium	Qwen	7.7	4.095	$0.492	29.74s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 4 Kiwango cha kupita kwa kila jaribio: 79.2% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 17,292 Tokeni za hoja: 145,625 Muda wa majibu: wastani 29.74s · jumla 475.83s · upeo 119.29s Jibu lisilo sahihi: 3 Muda umeisha: 1 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 10.0 General Intelligence: 10.0 Instructions following: 10.0 Puzzle Solving: 10.0 Tool Calling: 10.0
#45	Qwen3.5 Plus 2026-02-15medium	Qwen	8.3	1.264	$0.165	34.45s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 3 Kiwango cha kupita kwa kila jaribio: 85.4% Majaribio yasiyo thabiti: 1 Tokeni za matokeo: 1,735 Tokeni za hoja: 77,212 Muda wa majibu: wastani 34.45s · jumla 310.09s · upeo 79.86s Muda umeisha: 2 Jibu lisilo sahihi: 1 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 10.0 Instructions following: 10.0 Puzzle Solving: 10.0 Tool Calling: 10.0
#46	GLM 4.7 Flashmedium	Z.ai	3.1	1.040	$0.042	36.84s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 12 Kiwango cha kupita kwa kila jaribio: 41.7% Majaribio yasiyo thabiti: 7 Tokeni za matokeo: 38,682 Tokeni za hoja: 64,952 Muda wa majibu: wastani 36.84s · jumla 331.58s · upeo 174.55s Jibu lisilo sahihi: 7 Hakufuata maelekezo: 2 Hakuna jibu: 2 common.failureReasons.invalid_tool_call: 1 Anti-AI Tricks: 4.0 Combined: 10.0 Data parsing and extraction: 5.0 Domain specific: 10.0 General Intelligence: 10.0 Instructions following: 5.0 Puzzle Solving: 10.0 Tool Calling: 10.0
#47	DeepSeek V3.2medium	DeepSeek	7.3	0.225	$0.025	39.48s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 5 Kiwango cha kupita kwa kila jaribio: 79.2% Majaribio yasiyo thabiti: 3 Tokeni za matokeo: 7,392 Tokeni za hoja: 39,089 Muda wa majibu: wastani 39.48s · jumla 631.71s · upeo 93.11s Jibu lisilo sahihi: 3 Hakufuata maelekezo: 1 Muda umeisha: 1 Anti-AI Tricks: 7.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 3.0 Instructions following: 10.0 Puzzle Solving: 7.0 Tool Calling: 10.0
#48	MiniMax M2.5medium	Minimax	4.7	4.981	$0.250	43.03s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 11 Kiwango cha kupita kwa kila jaribio: 60.4% Majaribio yasiyo thabiti: 9 Tokeni za matokeo: 107,044 Tokeni za hoja: 206,190 Muda wa majibu: wastani 43.03s · jumla 387.25s · upeo 237.27s Jibu lisilo sahihi: 5 Hakufuata maelekezo: 3 Muda umeisha: 2 common.failureReasons.invalid_tool_call: 1 Anti-AI Tricks: 9.3 Combined: 10.0 Data parsing and extraction: 10.0 Domain specific: 10.0 General Intelligence: 3.0 Instructions following: 8.0 Puzzle Solving: 4.0 Tool Calling: 10.0
#49	Qwen3.5-35B-A3Bmedium	Qwen	5.5	4.251	$0.341	43.93s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 8 Kiwango cha kupita kwa kila jaribio: 77.1% Majaribio yasiyo thabiti: 7 Tokeni za matokeo: 5,495 Tokeni za hoja: 169,266 Muda wa majibu: wastani 43.93s · jumla 702.85s · upeo 106.00s Muda umeisha: 4 Jibu lisilo sahihi: 2 Hitilafu ya API: 1 Hakuna jibu: 1 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 5.5 Domain specific: 10.0 General Intelligence: 10.0 Instructions following: 10.0 Puzzle Solving: 4.0 Tool Calling: 10.0
#50	GPT-5 Nanomedium	OpenAI	5.5	0.856	$0.060	47.94s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 9 Kiwango cha kupita kwa kila jaribio: 60.4% Majaribio yasiyo thabiti: 6 Tokeni za matokeo: 4,386 Tokeni za hoja: 142,080 Muda wa majibu: wastani 47.94s · jumla 431.47s · upeo 204.02s Jibu lisilo sahihi: 5 Hakufuata maelekezo: 3 Muda umeisha: 1 Anti-AI Tricks: 7.0 Combined: 10.0 Data parsing and extraction: 10.0 Domain specific: 4.0 General Intelligence: 3.0 Instructions following: 9.0 Puzzle Solving: 4.0 Tool Calling: 10.0
#51	Qwen3.5-27Bmedium	Qwen	8.2	3.585	$0.431	52.13s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 4 Kiwango cha kupita kwa kila jaribio: 81.3% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 1,658 Tokeni za hoja: 200,786 Muda wa majibu: wastani 52.13s · jumla 834.16s · upeo 163.96s Hakufuata maelekezo: 2 Muda umeisha: 1 Jibu lisilo sahihi: 1 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 5.0 Instructions following: 10.0 Puzzle Solving: 8.3 Tool Calling: 10.0
#52	Seed-2.0-Minimedium	Bytedance Seed	6.9	0.280	$0.028	65.09s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 6 Kiwango cha kupita kwa kila jaribio: 68.8% Majaribio yasiyo thabiti: 2 Tokeni za matokeo: 1,965 Tokeni za hoja: 58,456 Muda wa majibu: wastani 65.09s · jumla 846.14s · upeo 262.83s Muda umeisha: 4 Hakufuata maelekezo: 1 Jibu lisilo sahihi: 1 Anti-AI Tricks: 7.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 10.0 General Intelligence: 6.0 Instructions following: 10.0 Puzzle Solving: 7.0 Tool Calling: 10.0
#53	Gemini 3.1 Flash Lite Previewhigh	Google	8.2	19.243	$2.310	68.83s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 4 Kiwango cha kupita kwa kila jaribio: 77.1% Majaribio yasiyo thabiti: 1 Tokeni za matokeo: 1,283 Tokeni za hoja: 1,533,310 Muda wa majibu: wastani 68.83s · jumla 1101.32s · upeo 280.52s Jibu lisilo sahihi: 3 Hakufuata maelekezo: 1 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 4.0 General Intelligence: 10.0 Instructions following: 9.0 Puzzle Solving: 7.0 Tool Calling: 10.0
#54	Kimi K2.5medium	Moonshot AI	6.4	2.171	$0.196	69.83s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 7 Kiwango cha kupita kwa kila jaribio: 72.9% Majaribio yasiyo thabiti: 5 Tokeni za matokeo: 38,453 Tokeni za hoja: 72,496 Muda wa majibu: wastani 69.83s · jumla 628.45s · upeo 137.29s Jibu lisilo sahihi: 3 Hakufuata maelekezo: 2 Hakuna jibu: 1 Muda umeisha: 1 Anti-AI Tricks: 7.0 Combined: 10.0 Data parsing and extraction: 9.9 Domain specific: 10.0 General Intelligence: 6.0 Instructions following: 10.0 Puzzle Solving: 4.0 Tool Calling: 10.0
#55	Qwen3.5-Flashmedium	Qwen	6.9	0.720	$0.072	70.81s
Tazama kadi ya modeli Jumla ya majaribio: 16 Majaribio yenye makosa: 6 Kiwango cha kupita kwa kila jaribio: 81.3% Majaribio yasiyo thabiti: 5 Tokeni za matokeo: 1,807 Tokeni za hoja: 169,952 Muda wa majibu: wastani 70.81s · jumla 1132.90s · upeo 234.29s Muda umeisha: 3 Hitilafu ya API: 1 Hakufuata maelekezo: 1 Jibu lisilo sahihi: 1 Anti-AI Tricks: 10.0 Combined: 10.0 Data parsing and extraction: 5.5 Domain specific: 4.0 General Intelligence: 5.0 Instructions following: 10.0 Puzzle Solving: 4.0 Tool Calling: 10.0

Ulinganisho wa haraka