Specifications Compared
| Spec | H200 | RTX A6000 |
|---|---|---|
| TDP | 700W | 300W |
| VRAM | 141 GB | 48 GB |
| CUDA Cores | 16,896 | 10,752 |
| FP8 (dense) | 1,979 TFLOPS | Not published |
| Memory Type | HBM3e | GDDR6 |
| Architecture | Hopper | Ampere |
| FP16 (dense) | 989 TFLOPS | 154.8 TFLOPS |
| Form Factors | SXM, NVL | PCIe |
| INT8 (dense) | 1,979 TOPS | 309.7 TOPS |
| Interconnect | NVLink, PCIe 5.0, InfiniBand | NVLink, PCIe 4.0 |
| Tensor Cores | 528 | 336 |
| FP32 Performance | 67 TFLOPS | 38.7 TFLOPS |
| FP64 Performance | 34 TFLOPS | Not published |
| Memory Bandwidth | 4,800 GB/s | 768 GB/s |
| FP8 (with sparsity) | 3,958 TFLOPS | Not published |
| FP16 (with sparsity) | 1,979 TFLOPS | 309.6 TFLOPS |
| INT8 (with sparsity) | 3,958 TOPS | 619.4 TOPS |
Performance Analysis
Dense FP16 performance reaches 989 TFLOPS on the H200 compared with 154.8 TFLOPS on the RTX A6000. This six to one ratio indicates the H200 completes matrix operations in training and inference workloads at substantially higher rates than the RTX A6000. Sparse FP16 figures follow the same pattern at 1979 TFLOPS versus 309.6 TFLOPS. Memory bandwidth of 4800 GB/s on the H200 versus 768 GB/s on the RTX A6000 permits larger batch sizes before data movement becomes the limiting factor. FP32 throughput at 67 TFLOPS on the H200 versus 38.7 TFLOPS on the RTX A6000 further widens the gap for precision sensitive scientific kernels.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
H200
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| DigitalOcean | New York 2 | 1 | $4.47 | — | Deploy |
| Vast.ai | Czechia, CZ | 2 | $5.23 | $10.46 | Deploy |
| LeaderGPU | The Netherlands | 1 | $6.22 | — | Deploy |
3 providers in stock, 5 offers (cheapest per provider shown). All H200 offers, price history and alerts
RTX A6000
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.44 | $3.54 | Deploy |
| QuantaCloud | us-midwest-1 | 2 | $0.48 | $0.96 | Deploy |
| Hyperstack | CANADA-1 | 4 | $0.50 | $2.00 | Deploy |
| Massed Compute | us-central-2 | 2 | $0.55 | $1.10 | Deploy |
| Paperspace | ny2 | 2 | $1.89 | $3.78 | Deploy |
5 providers in stock, 40 offers (cheapest per provider shown). All RTX A6000 offers, price history and alerts
Notify me when H200 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $4.47/GPU-hr.
QuantaCloud
Comparing H-series providers? We broker across all of them.
Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.
When to Choose the H200
The H200 suits LLM training and inference tasks that require 141 GB HBM3e capacity together with 4800 GB/s bandwidth. Workloads that scale with 989 TFLOPS dense FP16 or 1979 TFLOPS dense FP8 benefit directly from the higher TDP allowance of 700 W. Multi node clusters connected through NVLink and InfiniBand also favor the H200 form factors.
When to Choose the RTX A6000
The RTX A6000 fits fine tuning jobs and Stable Diffusion pipelines that operate within 48 GB GDDR6 and 300 W TDP limits. Its 154.8 TFLOPS dense FP16 rating remains adequate for smaller batch inference while the PCIe form factor simplifies integration into existing workstations. INT8 dense performance at 309.7 TOPS supports quantized models without exceeding power or thermal constraints.
Use Cases
The H200 supplies 989 TFLOPS dense FP16 and 141 GB memory that accommodate large model training runs.
Dense FP16 throughput of 989 TFLOPS and 4800 GB/s bandwidth on the H200 sustain high token generation rates.
The RTX A6000 meets fine tuning needs with 154.8 TFLOPS dense FP16 inside a 300 W power envelope.
48 GB GDDR6 and 309.7 TOPS dense INT8 on the RTX A6000 handle image generation workloads efficiently.
FP32 performance at 67 TFLOPS combined with 4800 GB/s bandwidth gives the H200 an advantage in simulation codes.
Frequently Asked Questions
What is the memory difference between H200 and RTX A6000?▾
The H200 contains 141 GB HBM3e memory while the RTX A6000 contains 48 GB GDDR6 memory. This difference directly affects maximum model size before swapping occurs.
How does FP16 performance compare between these GPUs?▾
Dense FP16 reaches 989 TFLOPS on the H200 and 154.8 TFLOPS on the RTX A6000. Sparse FP16 reaches 1979 TFLOPS on the H200 and 309.6 TFLOPS on the RTX A6000.
Which GPU has higher memory bandwidth?▾
The H200 lists 4800 GB/s memory bandwidth compared with 768 GB/s on the RTX A6000. Higher bandwidth supports larger batches during training and inference.
What are the TDP ratings for H200 and RTX A6000?▾
The H200 carries a 700 W TDP rating while the RTX A6000 carries a 300 W TDP rating. Power delivery and cooling infrastructure must match these values.
Do both GPUs support NVLink?▾
Both the H200 and RTX A6000 include NVLink interconnect support. The H200 additionally lists InfiniBand connectivity for larger clusters.
Which architecture is newer, Hopper or Ampere?▾
Hopper architecture on the H200 dates to 2024 while Ampere architecture on the RTX A6000 dates to 2020. The generational gap explains the performance differences in the listed TFLOPS figures.
Which is cheaper to rent, the H200 or the RTX A6000?▾
Cloud rental prices for both the H200 and RTX A6000 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the H200 have compared to the RTX A6000?▾
The H200 has 141 GB of HBM3e memory. The RTX A6000 has 48 GB of GDDR6 memory.
Can I find H200 and RTX A6000 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the H200 and the RTX A6000?▾
The H200 uses the Hopper architecture (2024) while the RTX A6000 uses Ampere (2020). The H200 delivers 6.4x the dense FP16 throughput (989 vs 154.8 TFLOPS, both without sparsity) and 6.3x the memory bandwidth of the RTX A6000.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the H200 and the RTX A6000. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent H200Every current offer by provider, daily price history and a price alert.
- Rent RTX A6000Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.