H100 SXM vs A100 SXM: specs, price and which to rent
GPU Rent Hub rents both cards as dedicated bare metal in three United States datacenters, paid in Bitcoin, Ethereum, USDT, USDC, Monero, Solana or Litecoin with no identity verification. The H100 SXM is $1,690 a month and the A100 SXM is $990 a month. Everything below is measured, not argued.
What is the difference between the H100 SXM and the A100 SXM?
Every figure is the one we rent against, taken from the same catalogue the dashboard prices from. Per-GPU-hour is the flat monthly price divided by 720 hours; you are never billed by the hour.
| H100 SXM | A100 SXM | |
|---|---|---|
| Memory | 80 GB HBM3 | 80 GB HBM2e |
| Memory bandwidth | 3.35 TB/s | 2.04 TB/s |
| Architecture | Hopper (2022) | Ampere (2020) |
| Cores | 16,896 CUDA · 528 Tensor | 6,912 CUDA · 432 Tensor |
| FP8 | 3,958 TFLOPS (sparse) | not supported |
| FP16 | 1,979 TFLOPS (sparse) | 624 TFLOPS (sparse) |
| Interconnect | NVLink · 900 GB/s | NVLink · 600 GB/s |
| Board power | 700 W | 400 W |
| Host vCPU | 20 | 16 |
| Host RAM | 251 GB | 125 GB |
| Local NVMe | 2 TB | 1 TB |
| Weekly price | $475 | $280 |
| Monthly price | $1,690 | $990 |
| Per GPU-hour | $2.35 | $1.38 |
| Price per GB of VRAM | $21.12 | $12.38 |
| In stock now | 63 | 78 |
Which should you rent?
Both cards carry 80 GB, so capacity is not what decides this one. The H100 SXM supports FP8 and the A100 SXM does not, which roughly halves the memory a quantised model needs and is the largest practical difference between the two. Bandwidth is 3.35 TB/s against 2.04 TB/s, and for single-stream token generation it is bandwidth that sets the speed, not the FLOPS figure on the spec sheet. The H100 SXM costs 71% more per month, $1,690 against $990, or $2.35 against $1.38 per GPU-hour.
Rent the H100 SXM when
Multi-week training and fine-tuning runs. A 70B model in FP8 fits on one card; in BF16 it needs two.
$1,690/mo · $475/wk · specifications and stock
Rent the A100 SXM when
The cheapest 80 GB card with NVLink. 80 GB of HBM2e under $1,000 a month, the value pick for multi-week runs.
$990/mo · $280/wk · specifications and stock
Where each card is in stock
A dash means the card is on the waitlist in that region. The price is identical in all three, so choose on latency and stock, nothing else.
| Region | H100 SXM | A100 SXM |
|---|---|---|
| DFW-1Dallas, TX | 32 | 40 |
| IAD-1Ashburn, VA | 19 | 22 |
| PDX-1Hillsboro, OR | 12 | 16 |
H100 SXM against A100 SXM
Is the H100 SXM better than the A100 SXM?
What is the price difference between the H100 SXM and the A100 SXM?
How much VRAM does the H100 SXM have compared to the A100 SXM?
Can I rent either card without KYC?
Which one is available today?
Can I put several H100 SXM cards in one machine?
Rent either one by the week or the month
No identity check, no email address, no card. Fund a balance in any of seven coins and deploy in about ninety seconds.