H200 SXM vs A100 SXM: specs, price and which to rent
GPU Rent Hub rents both cards as dedicated bare metal in three United States datacenters, paid in Bitcoin, Ethereum, USDT, USDC, Monero, Solana or Litecoin with no identity verification. The H200 SXM is 2 290 $US a month and the A100 SXM is 990 $US a month. Everything below is measured, not argued.
What is the difference between the H200 SXM and the A100 SXM?
Every figure is the one we rent against, taken from the same catalogue the dashboard prices from. Per-GPU-hour is the flat monthly price divided by 720 hours; you are never billed by the hour.
| H200 SXM | A100 SXM | |
|---|---|---|
| Memory | 141 GB HBM3e | 80 GB HBM2e |
| Memory bandwidth | 4.8 TB/s | 2.04 TB/s |
| Architecture | Hopper (2024) | Ampere (2020) |
| Cores | 16,896 CUDA · 528 Tensor | 6,912 CUDA · 432 Tensor |
| FP8 | 3,958 TFLOPS (sparse) | not supported |
| FP16 | 1,979 TFLOPS (sparse) | 624 TFLOPS (sparse) |
| Interconnect | NVLink · 900 GB/s | NVLink · 600 GB/s |
| Board power | 700 W | 400 W |
| Host vCPU | 24 | 16 |
| Host RAM | 251 GB | 125 GB |
| Local NVMe | 2 TB | 1 TB |
| Weekly price | 640 $US | 280 $US |
| Monthly price | 2 290 $US | 990 $US |
| Per GPU-hour | 3,18 $US | 1,38 $US |
| Price per GB of VRAM | 16,24 $US | 12,38 $US |
| In stock now | 19 | 78 |
Which should you rent?
The H200 SXM carries 61 GB more memory, which is the only thing that decides whether a model loads at all. The H200 SXM supports FP8 and the A100 SXM does not, which roughly halves the memory a quantised model needs and is the largest practical difference between the two. Bandwidth is 4.8 TB/s against 2.04 TB/s, and for single-stream token generation it is bandwidth that sets the speed, not the FLOPS figure on the spec sheet. The H200 SXM costs 131% more per month, $2,290 against $990, or $3.18 against $1.38 per GPU-hour.
Rent the H200 SXM when
Serving 70B–120B models without sharding. A 70B model in BF16 fits on two cards with room for a batch; in FP8 it fits on one.
2 290 $US/mo · 640 $US/wk · specifications and stock
Rent the A100 SXM when
The cheapest 80 GB card with NVLink. 80 GB of HBM2e under $1,000 a month, the value pick for multi-week runs.
990 $US/mo · 280 $US/wk · specifications and stock
Where each card is in stock
A dash means the card is on the waitlist in that region. The price is identical in all three, so choose on latency and stock, nothing else.
| Region | H200 SXM | A100 SXM |
|---|---|---|
| DFW-1Dallas, TX | 11 | 40 |
| IAD-1Ashburn, VA | 8 | 22 |
| PDX-1Hillsboro, OR | — | 16 |
H200 SXM against A100 SXM
Is the H200 SXM better than the A100 SXM?
What is the price difference between the H200 SXM and the A100 SXM?
How much VRAM does the H200 SXM have compared to the A100 SXM?
Can I rent either card without KYC?
Which one is available today?
Can I put several H200 SXM cards in one machine?
Rent either one by the week or the month
No identity check, no email address, no card. Fund a balance in any of seven coins and deploy in about ninety seconds.