H200 SXM vs MI300X: specs, price and which to rent
GPU Rent Hub rents both cards as dedicated bare metal in three United States datacenters, paid in Bitcoin, Ethereum, USDT, USDC, Monero, Solana or Litecoin with no identity verification. The H200 SXM is 2 290 $US a month and the MI300X is 1 590 $US a month. Everything below is measured, not argued.
What is the difference between the H200 SXM and the MI300X?
Every figure is the one we rent against, taken from the same catalogue the dashboard prices from. Per-GPU-hour is the flat monthly price divided by 720 hours; you are never billed by the hour.
| H200 SXM | MI300X | |
|---|---|---|
| Memory | 141 GB HBM3e | 192 GB HBM3 |
| Memory bandwidth | 4.8 TB/s | 5.3 TB/s |
| Architecture | Hopper (2024) | CDNA 3 (2023) |
| Cores | 16,896 CUDA · 528 Tensor | 304 compute units · 19,456 stream processors |
| FP8 | 3,958 TFLOPS (sparse) | 2,615 TFLOPS |
| FP16 | 1,979 TFLOPS (sparse) | 1,307 TFLOPS |
| Interconnect | NVLink · 900 GB/s | Infinity Fabric · 896 GB/s |
| Board power | 700 W | 750 W |
| Host vCPU | 24 | 24 |
| Host RAM | 251 GB | 283 GB |
| Local NVMe | 2 TB | 2 TB |
| Weekly price | 640 $US | 450 $US |
| Monthly price | 2 290 $US | 1 590 $US |
| Per GPU-hour | 3,18 $US | 2,21 $US |
| Price per GB of VRAM | 16,24 $US | 8,28 $US |
| In stock now | 19 | 8 |
Which should you rent?
The cheaper MI300X carries 51 GB more memory, so on capacity alone it is the better card. Bandwidth is 4.8 TB/s against 5.3 TB/s, and for single-stream token generation it is bandwidth that sets the speed, not the FLOPS figure on the spec sheet. Only the H200 SXM has NVLink, so multi-card training scales on it and struggles on the MI300X. The H200 SXM costs 44% more per month, $2,290 against $1,590, or $3.18 against $2.21 per GPU-hour.
Rent the H200 SXM when
Serving 70B–120B models without sharding. A 70B model in BF16 fits on two cards with room for a batch; in FP8 it fits on one.
2 290 $US/mo · 640 $US/wk · specifications and stock
Rent the MI300X when
Serving very large models on the fewest cards. The most HBM per card we rent: a 70B model in BF16 fits with 50 GB to spare.
1 590 $US/mo · 450 $US/wk · specifications and stock
Where each card is in stock
A dash means the card is on the waitlist in that region. The price is identical in all three, so choose on latency and stock, nothing else.
| Region | H200 SXM | MI300X |
|---|---|---|
| DFW-1Dallas, TX | 11 | 8 |
| IAD-1Ashburn, VA | 8 | — |
| PDX-1Hillsboro, OR | — | — |
H200 SXM against MI300X
Is the H200 SXM better than the MI300X?
What is the price difference between the H200 SXM and the MI300X?
How much VRAM does the H200 SXM have compared to the MI300X?
Can I rent either card without KYC?
Which one is available today?
Can I put several H200 SXM cards in one machine?
Rent either one by the week or the month
No identity check, no email address, no card. Fund a balance in any of seven coins and deploy in about ninety seconds.