Specifications Compared
| Spec | H200 NVL | RTX 3090 Ti |
|---|---|---|
| TDP | 700W | 350W |
| VRAM | 141 GB | 24 GB |
| CUDA Cores | 16,896 | 10,496 |
| FP8 (dense) | 1,979 TFLOPS | Not published |
| Memory Type | HBM3e | GDDR6X |
| Architecture | Hopper | Ampere |
| FP16 (dense) | 989 TFLOPS | Not published |
| Form Factors | NVL (PCIe card, NVLink bridged) | PCIe |
| INT8 (dense) | 1,979 TOPS | Not published |
| Interconnect | NVLink bridge, PCIe 5.0 | NVLink |
| Tensor Cores | 528 | 328 |
| FP32 Performance | 67 TFLOPS | 35.6 TFLOPS |
| FP64 Performance | 34 TFLOPS | Not published |
| Memory Bandwidth | 4,800 GB/s | 936 GB/s |
| FP8 (with sparsity) | 3,958 TFLOPS | Not published |
| FP16 (with sparsity) | 1,979 TFLOPS | Not published |
| INT8 (with sparsity) | 3,958 TOPS | Not published |
| FP16 (vendor figure, sparsity not specified) | Not published | 35.6 TFLOPS |
Performance Analysis
The H200 NVL delivers FP16 dense performance of 989 TFLOPS compared to the RTX 3090 Ti FP16 figure of 35.6 TFLOPS while FP32 stands at 67 TFLOPS versus 35.6 TFLOPS. This FP16 dense advantage allows the H200 NVL to process larger batches during training and inference without sparsity assumptions. Memory bandwidth of 4800 GB/s on the H200 NVL versus 936 GB/s on the RTX 3090 Ti supports bigger batch sizes in memory bound operations such as large language model inference. The H200 NVL FP8 dense figure of 1979 TFLOPS further extends its lead in quantized workloads over the RTX 3090 Ti specifications.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
H200 NVL
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| DigitalOcean | New York 2 | 1 | $4.47 | — | Deploy |
| RunPod | global | 1 | $5.29 | — | Deploy |
| VERDA | FIN-HEL | 2 | $5.66 | $11.32 | Deploy |
| Lyceum | Europe | 2 | $6.19 | $12.38 | Deploy |
| LeaderGPU | The Netherlands | 1 | $6.22 | — | Deploy |
5 providers in stock, 6 offers (cheapest per provider shown). All H200 NVL offers, price history and alerts
RTX 3090 Ti
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| Vast.ai | Finland, FI | 4 | $0.27 | $1.07 | Deploy |
| LeaderGPU | The Netherlands | 8 | $0.29 | $2.29 | Deploy |
2 providers in stock, 11 offers (cheapest per provider shown). All RTX 3090 Ti offers, price history and alerts
Notify me when H200 NVL drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $4.47/GPU-hr.
QuantaCloud
Comparing H-series providers? We broker across all of them.
Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.
When to Choose the H200 NVL
The H200 NVL suits large scale LLM training and inference tasks that require 141 GB of HBM3e memory to hold models exceeding 24 GB capacity. Its 4800 GB/s memory bandwidth and 989 TFLOPS FP16 dense rating enable efficient handling of batch sizes that exceed RTX 3090 Ti limits in scientific computing simulations.
When to Choose the RTX 3090 Ti
The RTX 3090 Ti fits smaller fine tuning jobs and Stable Diffusion workloads where 24 GB of GDDR6X memory suffices and 350W TDP keeps power draw lower than 700W. Its PCIe form factor integrates directly into consumer systems without needing NVLink bridge setups for 35.6 TFLOPS FP32 performance.
Use Cases
The H200 NVL 141 GB HBM3e capacity accommodates models larger than the 24 GB limit of the RTX 3090 Ti while providing 989 TFLOPS FP16 dense throughput.
The H200 NVL supports larger batch sizes with 4800 GB/s bandwidth and 1979 TFLOPS FP8 dense performance compared to the RTX 3090 Ti specifications.
Both GPUs handle fine tuning with the RTX 3090 Ti 35.6 TFLOPS FP32 rating sufficient for smaller models and the H200 NVL offering headroom for larger ones.
The RTX 3090 Ti 24 GB GDDR6X memory meets typical Stable Diffusion requirements at a 350W TDP without needing the higher power of the H200 NVL.
The H200 NVL 67 TFLOPS FP32 rating and 141 GB memory enable complex simulations beyond the 24 GB capacity of the RTX 3090 Ti.
Frequently Asked Questions
What is the memory difference between H200 NVL and RTX 3090 Ti?▾
The H200 NVL variant holds 141 GB HBM3e while the RTX 3090 Ti variant holds 24 GB GDDR6X. This 117 GB gap determines which models fit entirely in memory during inference.
How does FP16 performance compare on these GPUs?▾
The H200 NVL provides 989 TFLOPS FP16 dense while the RTX 3090 Ti lists 35.6 TFLOPS FP16. The dense figure allows direct comparison without sparsity multipliers.
What TDP values apply to the H200 NVL versus RTX 3090 Ti?▾
The H200 NVL family TDP is 700W and the RTX 3090 Ti family TDP is 350W. These shared figures apply to the specific variants discussed.
Which GPU offers higher memory bandwidth?▾
The H200 NVL provides 4800 GB/s bandwidth as a family figure while the RTX 3090 Ti provides 936 GB/s. Higher bandwidth supports larger batches in training workloads.
Can the RTX 3090 Ti run models that require more than 24 GB?▾
No. The RTX 3090 Ti variant is limited to 24 GB GDDR6X so models exceeding this capacity require the 141 GB HBM3e of the H200 NVL.
Which is cheaper to rent, the H200 NVL or the RTX 3090 Ti?▾
Cloud rental prices for both the H200 NVL and RTX 3090 Ti vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the H200 NVL have compared to the RTX 3090 Ti?▾
The H200 NVL has 141 GB of HBM3e memory. The RTX 3090 Ti has 24 GB of GDDR6X memory.
Can I find H200 NVL and RTX 3090 Ti GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the H200 NVL and the RTX 3090 Ti?▾
The H200 NVL uses the Hopper architecture (2024) while the RTX 3090 Ti uses Ampere (2020). The H200 NVL delivers 13.9x the dense FP16 throughput (989 vs 71 TFLOPS, both without sparsity) and 5.1x the memory bandwidth of the RTX 3090 Ti.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the H200 NVL and the RTX 3090 Ti. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent H200Every current offer by provider, daily price history and a price alert.
- Rent RTX 3090Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.