MiniMax MiniMax M2

MiniMax M2.5 hardware requirements

Fits on one Instinct MI355X OAM at FP8. For 1,000 tokens/s at 32k context you need 8 x H100 SXM5 80GB at $14.64/hr or 16 x RTX PRO 6000 Blackwell Max-Q Workstation Edition at $8.00/hr.

Parameters
229B
Active per token
10.0B
mixture of experts
KV cache per token
248 KB
16-bit cache
Native precision
FP8

Top options for MiniMax M2.5

The strongest part each vendor offers for MiniMax M2.5 at FP8 with 32,768 tokens per user, rentable parts first. Each card is one replica, the fewest accelerators that hold the model, and the line it draws on the graph below. Select a card to plot it.

Tokens per second as users grow

Each line is one replica, the fewest accelerators that hold the model, serving more users at once. It climbs while memory bandwidth is the limit, flattens once compute is, and stops where memory runs out at 32,768 tokens per user. Hover a line to bring it forward.

2 x GB200 NVL72 GPU 186GB 1 x Instinct MI355X OAM 2 x Ascend 950DT 4 x Gaudi 2 96GB 2 x TPU v7 192GB 8 x Inferentia2

2 x GB200 NVL72 GPU 186GB: peaks at 736 tokens per second when memory fills at 15 users.1 x Instinct MI355X OAM: peaks at 357 tokens per second when memory fills at 5 users.2 x Ascend 950DT: peaks at 307 tokens per second when memory fills at 5 users.4 x Gaudi 2 96GB: peaks at 404 tokens per second when memory fills at 16 users.2 x TPU v7 192GB: peaks at 684 tokens per second when memory fills at 16 users.8 x Inferentia2: peaks at 193 tokens per second when memory fills at 1 users.

Memory fills at: 2 x GB200 NVL72 GPU 186GB 15 users, 1 x Instinct MI355X OAM 5 users, 2 x Ascend 950DT 5 users, 4 x Gaudi 2 96GB 16 users, 2 x TPU v7 192GB 16 users, 8 x Inferentia2 1 users. Roofline estimates at FP8.

Bare minimum

Fewest GPUs
1 x Instinct MI355X OAM
FP8, 4,096 tokens, one stream
Tokens/s
537
Per hour
$5.99
Per million tokens
$3.10
Memory used
83%
Rent on Daytona
Cheapest per hour
4 x RTX PRO 6000 Blackwell Max-Q Workstation Edition
FP8, 4,096 tokens, one stream, live price
Tokens/s
431
Per hour
$2.00
Per million tokens
$1.29
Memory used
63%
Rent on RunPod
Cheapest per million tokens
8 x RTX PRO 6000 Blackwell Max-Q Workstation Edition
FP8, 32,768 tokens, 32 streams
Tokens/s
629
Per hour
$4.00
Per million tokens
$1.77
Memory used
67%
Rent on RunPod

Configurations

Every datacenter GPU in the catalog, sized for these settings. Change precision, context and concurrency and the whole page follows. Each point is one replica: the smallest tensor-parallel group of that GPU that holds the model.

Vendor

2 x Instinct MI355X OAM: 805 tokens/s per replica at $11.98/hr.2 x GB300 NVL72 GPU 288GB: 804 tokens/s per replica at $24.84/hr.4 x GB200 NVL72 GPU 186GB: 1.5k tokens/s per replica at $42.00/hr.2 x Instinct MI350X OAM: 798 tokens/s per replica at $12.32/hr.2 x B300 SXM 262GB: 796 tokens/s per replica at $9.98/hr.4 x B200 SXM 180GB: 1.5k tokens/s per replica at $16.36/hr.4 x Instinct MI325X OAM: 1.1k tokens/s per replica at $15.20/hr.4 x Instinct MI300X 192GB: 986 tokens/s per replica at $9.56/hr.4 x H200 SXM 141GB: 874 tokens/s per replica at $9.92/hr.8 x H100 SXM5 80GB: 1.2k tokens/s per replica at $14.64/hr.4 x H200 NVL 141GB: 854 tokens/s per replica at $14.46/hr.8 x H100 NVL 94GB: 1.3k tokens/s per replica at $25.52/hr.8 x H100 PCIe 80GB: 731 tokens/s per replica at $20.00/hr.8 x RTX PRO 6000 Blackwell Workstation Edition: 638 tokens/s per replica at $14.40/hr.8 x RTX PRO 6000 Blackwell Server Edition: 575 tokens/s per replica at $5.52/hr.8 x RTX PRO 6000 Blackwell Max-Q Workstation Edition: 629 tokens/s per replica at $4.00/hr.8 x Gaudi 2 96GB: 825 tokens/s per replica at $8.80/hr.16 x RTX 6000 Ada 48GB: 619 tokens/s per replica at $15.52/hr.16 x L40S 48GB: 562 tokens/s per replica at $12.16/hr.8 x A100 PCIe 80GB: 554 tokens/s per replica at $10.80/hr.8 x A100 SXM4 80GB: 576 tokens/s per replica at $11.20/hr.16 x A100 SXM4 40GB: 831 tokens/s per replica at $24.98/hr.16 x RTX PRO 5000 Blackwell 48GB: 711 tokens/s per replica at $15.36/hr.16 x L40 48GB: 526 tokens/s per replica at $13.12/hr.16 x RTX A6000 48GB: 411 tokens/s per replica at $8.00/hr.16 x A40 48GB: 378 tokens/s per replica at $9.44/hr.

Priced configurations only; 42 more fit without a live price and appear in the table. Marker size grows with the tensor-parallel width. Roofline estimates.

Rent
2 2.4k tok/s Specs →
2 2.3k tok/s Specs →
TPU 8t announced
4 ~1.2k tok/s Specs →
TPU 8i announced
2 ~786 tok/s Specs →
2 805 tok/s Rent →
2 804 tok/s Rent →
4 1.5k tok/s Rent →
2 798 tok/s Rent →
4 1.4k tok/s Specs →
2 ~1.6k tok/s Specs →
2 796 tok/s Rent →
4 1.5k tok/s Rent →
Huawei logo
Ascend 970 announced
2 1.3k tok/s Specs →
4 1.5k tok/s Specs →
OpenAI logo
Jalapeño announced
4 ~2.5k tok/s Specs →
4 1.1k tok/s Rent →
4 986 tok/s Rent →
Biren logo
BR100 2 nodes
16 ~1.0k tok/s Specs →
Huawei logo
Ascend 960 announced
2 819 tok/s Specs →
4 874 tok/s Rent →
8 1.2k tok/s Rent →
8 ~1.0k tok/s Specs →
4 ~854 tok/s Rent →
8 ~1.3k tok/s Rent →
8 ~1.0k tok/s Specs →
8 731 tok/s Rent →
8 731 tok/s Specs →
4 677 tok/s Specs →
8 638 tok/s Rent →
8 576 tok/s Specs →
8 ~576 tok/s Specs →
8 575 tok/s Rent →
8 1.3k tok/s Specs →
8 799 tok/s Specs →
8 629 tok/s Rent →
8 ~201 tok/s Specs →
8 825 tok/s Rent →
8 500 tok/s Specs →
16 ~727 tok/s Specs →
Huawei logo
Ascend 910B 2 nodes
16 ~896 tok/s Specs →
8 ~850 tok/s Specs →
16 ~619 tok/s Rent →
8 ~834 tok/s Specs →
L40S 48GB 2 nodes
16 562 tok/s Rent →
8 ~554 tok/s Specs →
8 ~576 tok/s Specs →
8 ~554 tok/s Rent →
8 ~576 tok/s Rent →
16 ~831 tok/s Specs →
16 ~831 tok/s Rent →
16 ~605 tok/s Specs →
16 ~711 tok/s Rent →
8 ~403 tok/s Specs →
L40 48GB 2 nodes
16 526 tok/s Rent →
16 ~736 tok/s Specs →
16 ~411 tok/s Rent →
A40 48GB 2 nodes
16 ~378 tok/s Rent →
4 458 tok/s Specs →
8 866 tok/s Specs →
16 ~241 tok/s Specs →
8 ~137 tok/s Specs →
Rebellions logo
ATOM-Max 2 nodes
16 ~480 tok/s Specs →
16 ~422 tok/s Specs →
16 ~422 tok/s Specs →
L20 48GB 2 nodes
16 493 tok/s Specs →
Cambricon logo
MLU370-X8 2 nodes
16 ~308 tok/s Specs →
16 ~380 tok/s Specs →
16 ~121 tok/s Specs →

By vendor

At FP8 the NVIDIA pick is 8 x RTX PRO 6000 Blackwell Max-Q Workstation Edition at about 629 tokens/s for $4.00/hr; the AMD pick is 4 x Instinct MI300X 192GB at about 986 tokens/s for $9.56/hr. Per rental dollar NVIDIA delivers 1.53x the tokens of AMD here.

NVIDIA: 157 tokens/s per dollar, 262 tokens/s per kW (8 x RTX PRO 6000 Blackwell Max-Q Workstation Edition).AMD: 103 tokens/s per dollar, 329 tokens/s per kW (4 x Instinct MI300X 192GB).Huawei: no live price, no power figure (4 x Ascend 950DT).Intel: 93.8 tokens/s per dollar, 172 tokens/s per kW (8 x Gaudi 2 96GB).Google: no live price, no power figure (4 x TPU v7 192GB).Other: no live price, no power figure (8 x MTT S5000).

NVIDIA 32 parts fit
Best value: 8 x RTX PRO 6000 Blackwell Max-Q Workstation Edition, 629 tok/s for $4.00/hr
Fewest GPUs: 2 x Rubin SXM, 2.3k tok/s
AMD 11 parts fit
Best value: 4 x Instinct MI300X 192GB, 986 tok/s for $9.56/hr
Fewest GPUs: 2 x Instinct MI455X, 2.4k tok/s
Huawei 8 parts fit
Fewest GPUs: 4 x Ascend 950DT, 677 tok/s
Intel 4 parts fit
Best value: 8 x Gaudi 2 96GB, 825 tok/s for $8.80/hr
Fewest GPUs: 8 x Gaudi 3 128GB, 1.3k tok/s
Google 2 parts fit
Fewest GPUs: 4 x TPU v7 192GB, 1.4k tok/s
Other 5 parts fit
Fewest GPUs: 8 x MTT S5000, 576 tok/s

Fleet what-if

Compare whole fleets at these settings: a thousand of one part against a hundred of another. Each fleet splits into replicas of its tensor-parallel width; GPUs left over sit idle.

A
B
FleetTokens/s
1,000 x H200 SXM 141GB
219k tok/s
100 x GB200 NVL72 GPU 186GB
38k tok/s

1,000 x H200 SXM 141GB: 219k tokens/s, $2,480/hr, 700 kW.100 x GB200 NVL72 GPU 186GB: 38k tokens/s, $1,050/hr, no power figure.

H200 SXM 141GB: 219k tokens/s at 1000 GPUs.GB200 NVL72 GPU 186GB: 381k tokens/s at 1000 GPUs.

Size MiniMax M2.5 for a tokens per second target

The calculator starts from your traffic instead of a fleet: set a target rate and read the replica count for every GPU.

Frequently asked questions

How much GPU memory does MiniMax M2.5 need?

The weights take 229 GB at the native FP8 precision (457 GB at BF16, 229 GB at FP8, 129 GB at INT4). Each concurrent stream adds 248 KB of KV cache per token: 1.0 GB at 4,096 tokens and 8.3 GB at 32,768 tokens.

What is the bare minimum to run MiniMax M2.5?

1 x Instinct MI355X OAM at FP8 with 4,096 tokens of context and one stream. The cheapest live rental for that footprint is 4 x RTX PRO 6000 Blackwell Max-Q Workstation Edition at $2.00 per hour.

How many H100s do you need to run MiniMax M2.5?

4 H100s at FP8 for 4,096 tokens of context and one stream. For 32,768 tokens and 32 concurrent streams the tensor-parallel group is 8 H100s, and 1,000 tokens per second takes 8 H100s across 1 replicas.

How much does MiniMax M2.5 cost per million tokens on an H100?

About $3.39 per million output tokens at FP8, 32,768 tokens of context and 32 streams, using the cheapest live on-demand price of $1.83 per GPU-hour. The cheapest part per token is 8 x RTX PRO 6000 Blackwell Max-Q Workstation Edition at $1.77.

What precision does MiniMax M2.5 ship in?

The published checkpoint is FP8. FP8 halves the BF16 footprint with the accuracy the lab validated; INT4 is a further community quantisation.

All figures are roofline estimates from the model's config.json and each GPU's published memory, bandwidth and tensor-core peak, with fixed efficiency factors. Prices are the cheapest live on-demand listing per GPU when the site has one. They are a planning floor; a tuned serving stack can do better. Same geometry as MiniMax M2, whose card states 10B active of 230B. Ships in FP8.

© 2026 Flopper.io - Compare the GPUs Powering AI