Compare Charts

Language:

❤️ Made by XCS

AI BENCHY Compare

MiniMax: MiniMax M2.5 vs OpenAI: GPT-4o-mini

Model Name:

Last updated at : 2026-02-27 15:16

Summary

Metric	MiniMax: MiniMax M2.5 medium Release: Unknown release date	OpenAI: GPT-4o-mini none Release: Unknown release date
Rank	#26	#28
Score	5.64	4.86
Consistency	6.12	9.98
Cost per result	4.028	0.056
Total Cost	$0.242	$0.003
Tests Correct
Wrong Tests	8	9
Attempt pass rate	64.3%	35.7%
Flaky tests	7	0
Output Tokens	121,297	949
Reasoning Tokens	203,513	0

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MiniMax: MiniMax M2.5	9.33	7.89	88.9%	1		286	45,112
OpenAI: GPT-4o-mini	4.00	10.00	33.3%	0		180	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MiniMax: MiniMax M2.5	5.50	5.81	83.3%	1		369	4,952
OpenAI: GPT-4o-mini	10.00	10.00	100.0%	0		183	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MiniMax: MiniMax M2.5	1.00	4.41	22.2%	2		111,023	139,533
OpenAI: GPT-4o-mini	1.00	10.00	0.0%	0		15	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MiniMax: MiniMax M2.5	7.00	6.41	66.7%	1		1,121	2,521
OpenAI: GPT-4o-mini	5.50	10.00	50.0%	0		71	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MiniMax: MiniMax M2.5	4.33	4.79	55.6%	2		8,229	10,458
OpenAI: GPT-4o-mini	4.00	9.92	0.0%	0		295	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MiniMax: MiniMax M2.5	10.00	10.00	100.0%	0		269	937
OpenAI: GPT-4o-mini	10.00	10.00	100.0%	0		205	0

Switch Comparison Pair

Compare MiniMax: MiniMax M2.5 against...

Compare OpenAI: GPT-4o-mini against...