Specifications Compared
| Spec | H200 | RTX 3090 |
|---|---|---|
| TDP | 700W | 350W |
| VRAM | 141 GB | 24 GB |
| CUDA Cores | 16,896 | 10,496 |
| FP8 (dense) | 1,979 TFLOPS | Not published |
| Memory Type | HBM3e | GDDR6X |
| Architecture | Hopper | Ampere |
| FP16 (dense) | 989 TFLOPS | 71 TFLOPS |
| Form Factors | SXM, NVL | PCIe |
| INT8 (dense) | 1,979 TOPS | 284 TOPS |
| Interconnect | NVLink, PCIe 5.0, InfiniBand | NVLink, PCIe 4.0 |
| Tensor Cores | 528 | 328 |
| FP32 Performance | 67 TFLOPS | 35.6 TFLOPS |
| FP64 Performance | 34 TFLOPS | Not published |
| Memory Bandwidth | 4,800 GB/s | 936 GB/s |
| FP8 (with sparsity) | 3,958 TFLOPS | Not published |
| FP16 (with sparsity) | 1,979 TFLOPS | 142 TFLOPS |
| INT8 (with sparsity) | 3,958 TOPS | 568 TOPS |
Performance Analysis
The FP16 dense figure of 989 TFLOPS on the H200 exceeds the FP16 dense figure of 71 TFLOPS on the RTX 3090 by a wide margin and this gap accelerates both training and inference steps for tensor operations. Memory bandwidth of 4800 GB/s on the H200 permits larger batch sizes during inference compared with 936 GB/s on the RTX 3090. The FP32 rating of 67 TFLOPS on the H200 versus 35.6 TFLOPS on the RTX 3090 further widens the advantage for precision sensitive computations while the 700W TDP of the H200 requires more power delivery than the 350W TDP of the RTX 3090.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
H200
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| RunPod | global | 1 | $3.79 | — | Deploy |
| Vast.ai | Czechia, CZ | 2 | $4.52 | $9.03 | Deploy |
| VERDA | FIN-HEL | 2 | $5.60 | $11.20 | Deploy |
| Lyceum | Europe | 1 | $6.19 | — | Deploy |
| LeaderGPU | The Netherlands | 1 | $6.22 | — | Deploy |
5 providers in stock, 10 offers (cheapest per provider shown). All H200 offers, price history and alerts
RTX 3090
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| Vast.ai | Finland, FI | 8 | $0.27 | $2.13 | Deploy |
| LeaderGPU | The Netherlands | 8 | $0.29 | $2.29 | Deploy |
2 providers in stock, 12 offers (cheapest per provider shown). All RTX 3090 offers, price history and alerts
Notify me when H200 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $3.79/GPU-hr.
QuantaCloud
Comparing H-series providers? We broker across all of them.
Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.
When to Choose the H200
The H200 fits large scale LLM training because its 141 GB VRAM and 989 TFLOPS dense FP16 rating accommodate models that exceed the 24 GB limit of the RTX 3090. Its 4800 GB/s bandwidth also supports high throughput inference on extensive datasets.
When to Choose the RTX 3090
The RTX 3090 suits smaller fine tuning jobs because its 350W TDP and PCIe form factor integrate easily into standard workstations. Its 24 GB VRAM handles moderate Stable Diffusion tasks without the infrastructure demands of the H200.
Use Cases
The H200 supplies 989 TFLOPS dense FP16 and 141 GB VRAM which exceed the RTX 3090 specifications for large models.
The H200 delivers 989 TFLOPS dense FP16 along with 4800 GB/s bandwidth that enable larger batches than the RTX 3090.
Both GPUs handle fine tuning yet the RTX 3090 at 350W TDP suits smaller workloads while the H200 addresses larger ones.
The RTX 3090 with 24 GB VRAM and 350W TDP meets typical Stable Diffusion requirements in standard setups.
The H200 provides 67 TFLOPS FP32 and 4800 GB/s bandwidth that accelerate scientific workloads beyond RTX 3090 limits.
Frequently Asked Questions
What is the FP16 dense performance difference between the H200 and RTX 3090?▾
The H200 achieves 989 TFLOPS dense FP16 and the RTX 3090 achieves 71 TFLOPS dense FP16.
Which GPU has higher memory bandwidth?▾
The H200 reaches 4800 GB/s bandwidth compared with 936 GB/s on the RTX 3090.
What TDP values apply to the H200 and RTX 3090?▾
The H200 lists a TDP of 700W and the RTX 3090 lists a TDP of 350W.
Does the H200 support higher precision FP32 than the RTX 3090?▾
The H200 reaches 67 TFLOPS FP32 while the RTX 3090 reaches 35.6 TFLOPS FP32.
What architectures do the H200 and RTX 3090 use?▾
The H200 uses Hopper architecture and the RTX 3090 uses Ampere architecture.
Which is cheaper to rent, the H200 or the RTX 3090?▾
Cloud rental prices for both the H200 and RTX 3090 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the H200 have compared to the RTX 3090?▾
The H200 has 141 GB of HBM3e memory. The RTX 3090 has 24 GB of GDDR6X memory.
Can I find H200 and RTX 3090 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the H200 and the RTX 3090?▾
The H200 uses the Hopper architecture (2024) while the RTX 3090 uses Ampere (2020). The H200 delivers 13.9x the dense FP16 throughput (989 vs 71 TFLOPS, both without sparsity) and 5.1x the memory bandwidth of the RTX 3090.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the H200 and the RTX 3090. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent H200Every current offer by provider, daily price history and a price alert.
- Rent RTX 3090Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.