Specifications Compared
| Spec | A16 | H200 |
|---|---|---|
| TDP | 250W | 700W |
| VRAM | 16 GB | 141 GB |
| CUDA Cores | 1,280 | 16,896 |
| FP8 (dense) | Not published | 1,979 TFLOPS |
| Memory Type | GDDR6 | HBM3e |
| Architecture | Ampere | Hopper |
| FP16 (dense) | 17.9 TFLOPS | 989 TFLOPS |
| Form Factors | PCIe | SXM, NVL |
| INT8 (dense) | 35.9 TOPS | 1,979 TOPS |
| Interconnect | PCIe 4.0 | NVLink, PCIe 5.0, InfiniBand |
| Tensor Cores | 40 | 528 |
| FP32 Performance | 4.5 TFLOPS | 67 TFLOPS |
| FP64 Performance | Not published | 34 TFLOPS |
| Memory Bandwidth | 200 GB/s | 4,800 GB/s |
| FP8 (with sparsity) | Not published | 3,958 TFLOPS |
| FP16 (with sparsity) | 35.9 TFLOPS | 1,979 TFLOPS |
| INT8 (with sparsity) | 71.8 TOPS | 3,958 TOPS |
Performance Analysis
The FP16 dense performance reaches 17.9 TFLOPS on the A16 and 989 TFLOPS on the H200 so the H200 completes matrix operations in training workloads at a higher rate. The FP16 figure with sparsity reaches 35.9 TFLOPS on the A16 and 1979 TFLOPS on the H200 therefore sparse workloads also favor the H200 by the same ratio. FP32 throughput of 4.5 TFLOPS on the A16 compared with 67 TFLOPS on the H200 indicates the H200 handles full precision scientific kernels more rapidly. Memory bandwidth of 200 GB/s on the A16 versus 4800 GB/s on the H200 allows the H200 to sustain larger batch sizes during inference without memory stalls.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A16
A16 is not offered on-demand by any provider we track right now. See the A16 rental page for last-seen listed prices and a price alert.
H200
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| DigitalOcean | Atlanta 1 | 1 | $4.47 | — | Deploy |
| RunPod | global | 1 | $5.29 | — | Deploy |
| VERDA | FIN-HEL | 1 | $5.66 | — | Deploy |
| Vast.ai | Czechia, CZ | 1 | $5.69 | — | Deploy |
| Lyceum | Europe | 2 | $6.19 | $12.38 | Deploy |
6 providers in stock, 9 offers (cheapest per provider shown). All H200 offers, price history and alerts
Notify me when A16 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold.
QuantaCloud
Comparing H-series providers? We broker across all of them.
Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.
When to Choose the A16
The A16 GPU suits deployments that require a 250W TDP limit and PCIe connectivity. Workloads that fit within 16 GB GDDR6 memory and need only 17.9 TFLOPS FP16 dense performance benefit from the lower power draw of the A16. Inference tasks that stay under the 35.9 TOPS INT8 dense rating run efficiently on the A16 without excess energy consumption.
When to Choose the H200
The H200 GPU suits large scale training that requires 141 GB HBM3e memory and 4800 GB/s bandwidth. Models that exceed 16 GB capacity or demand 989 TFLOPS FP16 dense performance complete faster on the H200. Inference at 1979 TFLOPS FP8 dense throughput also favors the H200 when batch sizes grow beyond the limits of 200 GB/s bandwidth.
Use Cases
The H200 supplies 989 TFLOPS FP16 dense and 141 GB memory that exceed the A16 specifications for large model training.
The H200 delivers 1979 TFLOPS FP8 dense and 4800 GB/s bandwidth that support higher throughput than the A16 can achieve.
The H200 provides 1979 TFLOPS FP16 with sparsity and 141 GB memory that accommodate fine tuning of models beyond 16 GB capacity.
The H200 offers 1979 TFLOPS FP8 dense performance that accelerates image generation workloads compared with the A16 FP16 dense rating of 17.9 TFLOPS.
The H200 supplies 67 TFLOPS FP32 that surpass the 4.5 TFLOPS FP32 rating of the A16 for precision sensitive calculations.
Frequently Asked Questions
What is the FP16 dense performance difference?▾
The A16 reaches 17.9 TFLOPS FP16 dense while the H200 reaches 989 TFLOPS FP16 dense. The ratio shows the H200 processes dense FP16 operations more than fifty times faster.
Which GPU has higher memory bandwidth?▾
The H200 provides 4800 GB/s memory bandwidth while the A16 provides 200 GB/s memory bandwidth. Higher bandwidth on the H200 supports larger batch sizes during both training and inference.
What TDP values do the GPUs list?▾
The A16 lists a 250W TDP while the H200 lists a 700W TDP. Power limited environments may therefore select the A16 when 250W is the ceiling.
Do both GPUs support sparsity acceleration?▾
Both GPUs publish FP16 figures with sparsity. The A16 reaches 35.9 TFLOPS FP16 with sparsity and the H200 reaches 1979 TFLOPS FP16 with sparsity.
Which is cheaper to rent, the A16 or the H200?▾
Cloud rental prices for both the A16 and H200 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A16 have compared to the H200?▾
The A16 has 16 GB of GDDR6 memory. The H200 has 141 GB of HBM3e memory.
Can I find A16 and H200 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A16 and the H200?▾
The A16 uses the Ampere architecture (2021) while the H200 uses Hopper (2024). The H200 delivers 55.3x the dense FP16 throughput (989 vs 17.9 TFLOPS, both without sparsity) and 24.0x the memory bandwidth of the A16.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A16 and the H200. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A16Every current offer by provider, daily price history and a price alert.
- Rent H200Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.