Specifications Compared
| Spec | A100 | GH200 |
|---|---|---|
| TDP | 400W | 900W |
| VRAM | 40-80 GB | 96 GB |
| CUDA Cores | 6,912 | 16,896 |
| FP8 (dense) | Not published | 1,979 TFLOPS |
| Memory Type | HBM2e | HBM3 |
| Architecture | Ampere | Hopper |
| FP16 (dense) | 312 TFLOPS | 989 TFLOPS |
| Form Factors | SXM4, PCIe | SXM |
| INT8 (dense) | 624 TOPS | 1,979 TOPS |
| Interconnect | NVLink, PCIe 4.0, InfiniBand | NVLink-C2C, PCIe 5.0 |
| Tensor Cores | 432 | 528 |
| FP32 Performance | 19.5 TFLOPS | 67 TFLOPS |
| FP64 Performance | 9.7 TFLOPS | 34 TFLOPS |
| Memory Bandwidth | 2,039 GB/s | 4,000 GB/s |
| FP8 (with sparsity) | Not published | 3,958 TFLOPS |
| FP16 (with sparsity) | 624 TFLOPS | 1,979 TFLOPS |
| INT8 (with sparsity) | 1,248 TOPS | 3,958 TOPS |
Performance Analysis
Dense FP16 performance of 312 TFLOPS on the A100 versus 989 TFLOPS on the GH200 shows that the GH200 executes dense matrix operations more than three times faster. This gap affects training duration and inference latency for workloads that use dense FP16 computations. The corresponding FP32 values of 19.5 TFLOPS versus 67 TFLOPS extend the same advantage to non tensor floating point kernels. FP16 with sparsity delivers 624 TFLOPS on the A100 and 1979 TFLOPS on the GH200. Ratios between the two GPUs remain comparable when both figures use sparsity or both figures use dense mode.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A100
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.68 | $5.42 | Deploy |
| Vast.ai | Slovenia, SI | 1 | $0.73 | — | Deploy |
| ThunderCompute | USA | 2 | $1.09 | $2.18 | Deploy |
| Massed Compute | us-central-3 | 1 | $1.35 | — | Deploy |
| Hyperstack | CANADA-1 | 1 | $1.35 | — | Deploy |
9 providers in stock, 30 offers (cheapest per provider shown). All A100 offers, price history and alerts
GH200
1 provider in stock, 1 offer. All GH200 offers, price history and alerts
Notify me when A100 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.68/GPU-hr.
QuantaCloud
Comparing H-series providers? We broker across all of them.
Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.
When to Choose the A100
The A100 suits environments where power delivery is limited to 400W TDP. Its 40 to 80 GB VRAM capacity meets requirements for models that fit within that range while its 2039 GB/s bandwidth supports moderate batch sizes. Existing NVLink and InfiniBand fabrics already deployed for Ampere systems integrate directly with the A100 without architecture changes.
When to Choose the GH200
The GH200 fits workloads that require 96 GB VRAM and 4000 GB/s bandwidth for larger batches or longer context lengths. Its 989 TFLOPS dense FP16 and 67 TFLOPS FP32 figures shorten training and inference times compared with the A100. New installations that adopt PCIe 5.0 and NVLink C2C benefit from the higher interconnect speeds of the GH200.
Use Cases
The GH200 supplies 989 TFLOPS dense FP16 and 4000 GB/s bandwidth that exceed the 312 TFLOPS and 2039 GB/s of the A100.
The GH200 delivers 1979 TFLOPS FP8 dense that exceed the INT8 dense 624 TOPS of the A100 for quantized inference.
The GH200 provides 96 GB VRAM and 1979 TFLOPS FP16 with sparsity that support larger adapter modules than the A100.
Both GPUs handle the workload with the A100 at 312 TFLOPS dense FP16 and the GH200 at 989 TFLOPS dense FP16.
The GH200 supplies 67 TFLOPS FP32 that exceed the 19.5 TFLOPS of the A100 for double precision adjacent workloads.
Frequently Asked Questions
What is the memory bandwidth difference?▾
The A100 reaches 2039 GB/s while the GH200 reaches 4000 GB/s.
Which GPU has higher dense FP16 performance?▾
The GH200 reaches 989 TFLOPS dense FP16 while the A100 reaches 312 TFLOPS dense FP16.
How do the TDP values compare?▾
The A100 lists 400W TDP while the GH200 lists 900W TDP.
What FP32 performance do the GPUs offer?▾
The A100 provides 19.5 TFLOPS FP32 while the GH200 provides 67 TFLOPS FP32.
Which is cheaper to rent, the A100 or the GH200?▾
Cloud rental prices for both the A100 and GH200 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A100 have compared to the GH200?▾
The A100 has 40 to 80 GB of HBM2e memory. The GH200 has 96 GB of HBM3 memory.
Can I find A100 and GH200 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A100 and the GH200?▾
The A100 uses the Ampere architecture (2020) while the GH200 uses Hopper (2023). The GH200 delivers 3.2x the dense FP16 throughput (989 vs 312 TFLOPS, both without sparsity) and 2.0x the memory bandwidth of the A100.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A100 and the GH200. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A100Every current offer by provider, daily price history and a price alert.
- Rent GH200 Grace HopperEvery current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.