Navigate
Advertise here

Kev 4B vs GLM 4.7 Flash (medium)

GLM 4.7 Flash (medium) leads on average score with 4.2 vs 2.4. Kev 4B has the lower benchmark cost at $0.002 vs $0.193. Kev 4B is faster at 5.63s vs 150.90s, with pass rates of 15.9% vs 30.4%.

Last updated at: 2026-10-01

Compared models

Rank
#376
Total Output Tokens
28,061
Response Time (avg)
5.63s
Total Cost
$0.002
Rank
#341
Total Output Tokens
464,375
Response Time (avg)
150.90s
Total Cost
$0.193
Recommended model GLM 4.7 Flash (medium)

It has the strongest score in this comparison (4.2) and the best overall balance of cost and response time across all 2 models.

Detailed comparison

Metric Kev 4B Kev 4B none Release: 2026-09-28 GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score 2.4 4.2
Rank #376 #341
Reliability 10.0 9.4
Consistency 4.9 7.1
Attempts 36/69 69/69
Tests Correct
Attempt pass rate 15.9% 30.4%
Flaky tests 1 8
Total Runs 36 69
Cost per result 0.060 4.822
Total Cost $0.002 $0.193
Input Price $0.042 / 1M $0.061 / 1M
Output Price $0.000 / 1M $0.400 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 42,804 228,711
Output Tokens 28,061 42,254
Reasoning Tokens 0 422,121
Response Time (avg) 5.63s 150.90s
Response Time (max) 17.79s 1539.97s
Response Time (total) 67.61s 2414.33s
Parameters 4B 30B total (3B active)
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#376 Jared Palmer: Kev 4B

none
No showcase result has been generated for this model yet.
Cost
N/A
Time
-
Tokens
0 tok

#341 GLM 4.7 Flash

medium
No output was saved. The original provider response or failure reason is unavailable.
Cost
$0.000
Time
186.2s
Tokens
12,112 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Kev 4B 4.5 6.7 33.3% 0 771ms 21,603 12,207 0
GLM 4.7 Flash 3.2 7.4 11.1% 1 55.33s 3,106 4,981 22,387

Quick Compare

Switch Comparison Pair