Specifications Compared
| Spec | H200 NVL | RTX 4090 |
|---|---|---|
| TDP | 700W | 450W |
| VRAM | 141 GB | 24 GB |
| CUDA Cores | 16,896 | 16,384 |
| FP8 (dense) | 1,979 TFLOPS | 330.3 TFLOPS |
| Memory Type | HBM3e | GDDR6X |
| Architecture | Hopper | Ada Lovelace |
| FP16 (dense) | 989 TFLOPS | 165.2 TFLOPS |
| Form Factors | NVL (PCIe card, NVLink bridged) | PCIe |
| INT8 (dense) | 1,979 TOPS | 660.6 TOPS |
| Interconnect | NVLink bridge, PCIe 5.0 | PCIe 4.0 |
| Tensor Cores | 528 | 512 |
| FP32 Performance | 67 TFLOPS | 82.6 TFLOPS |
| FP64 Performance | 34 TFLOPS | 1.3 TFLOPS |
| Memory Bandwidth | 4,800 GB/s | 1,008 GB/s |
| FP8 (with sparsity) | 3,958 TFLOPS | 660.6 TFLOPS |
| FP16 (with sparsity) | 1,979 TFLOPS | 330.4 TFLOPS |
| INT8 (with sparsity) | 3,958 TOPS | 1,321.2 TOPS |
Performance Analysis
The H200 NVL delivers 989 TFLOPS of dense FP16 throughput and 67 TFLOPS of FP32 throughput while the RTX 4090 delivers 165.2 TFLOPS of dense FP16 throughput and 82.6 TFLOPS of FP32 throughput. A comparison of dense FP16 figures shows the H200 NVL exceeds the RTX 4090 by a factor of six while a comparison of FP32 figures shows the RTX 4090 exceeds the H200 NVL by 23 percent. Memory bandwidth of 4800 GB/s on the H200 NVL versus 1008 GB/s on the RTX 4090 allows larger batch sizes during training and inference on the H200 NVL.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
H200 NVL
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| DigitalOcean | Atlanta 1 | 1 | $4.47 | — | Deploy |
| Vast.ai | Czechia, CZ | 1 | $4.65 | — | Deploy |
| RunPod | global | 1 | $5.29 | — | Deploy |
| VERDA | FIN-HEL | 8 | $5.71 | $45.72 | Deploy |
| Lyceum | Europe | 8 | $6.19 | $49.52 | Deploy |
6 providers in stock, 7 offers (cheapest per provider shown). All H200 NVL offers, price history and alerts
Notify me when H200 NVL drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $4.47/GPU-hr.
QuantaCloud
Comparing H-series providers? We broker across all of them.
Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.
When to Choose the H200 NVL
The H200 NVL variant suits workloads that require 141 GB of HBM3e memory and 4800 GB/s bandwidth such as training models that exceed 24 GB capacity. Its 989 TFLOPS dense FP16 rating supports large scale tensor operations at 700W TDP.
When to Choose the RTX 4090
Its PCIe 4.0 interface matches consumer systems where NVLink is unnecessary.
Use Cases
The H200 NVL variant supplies 141 GB of memory and 989 TFLOPS dense FP16 throughput that accommodate models beyond 24 GB capacity.
The H200 NVL variant supplies 4800 GB/s bandwidth and 1979 TFLOPS FP8 with sparsity that support high throughput serving of large models.
The H200 NVL variant supplies 141 GB of memory that permits fine tuning of models that exceed the 24 GB limit of the RTX 4090 variant.
The RTX 4090 variant supplies 82.6 TFLOPS of FP32 throughput at 450W TDP that suffices for image generation workloads within 24 GB memory.
The RTX 4090 variant offers higher FP32 throughput while the H200 NVL variant offers higher memory capacity so selection depends on exact workload size.
Frequently Asked Questions
How does dense FP16 performance differ between the H200 NVL variant and the RTX 4090 variant?▾
The H200 NVL variant delivers 989 TFLOPS of dense FP16 throughput while the RTX 4090 variant delivers 165.2 TFLOPS of dense FP16 throughput. These figures come from shared family specifications for each model.
What interconnect does the H200 NVL variant use versus the RTX 4090 variant?▾
The H200 NVL variant uses an NVLink bridge together with PCIe 5.0 while the RTX 4090 variant uses PCIe 4.0. These interconnect details belong to the specific variants rather than the broader families.
Which variant has higher FP32 throughput?▾
The RTX 4090 variant has 82.6 TFLOPS of FP32 throughput while the H200 NVL variant has 67 TFLOPS of FP32 throughput. Both values represent shared family performance figures.
What TDP rating applies to each variant?▾
The H200 NVL variant carries a 700W TDP rating while the RTX 4090 variant carries a 450W TDP rating. These TDP values are family figures shared across all variants of each model.
Which is cheaper to rent, the H200 NVL or the RTX 4090?▾
Cloud rental prices for both the H200 NVL and RTX 4090 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the H200 NVL have compared to the RTX 4090?▾
The H200 NVL has 141 GB of HBM3e memory. The RTX 4090 has 24 GB of GDDR6X memory.
Can I find H200 NVL and RTX 4090 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the H200 NVL and the RTX 4090?▾
The H200 NVL uses the Hopper architecture (2024) while the RTX 4090 uses Ada Lovelace (2022). The H200 NVL delivers 6.0x the dense FP16 throughput (989 vs 165.2 TFLOPS, both without sparsity) and 4.8x the memory bandwidth of the RTX 4090.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the H200 NVL and the RTX 4090. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent H200Every current offer by provider, daily price history and a price alert.
- Rent RTX 4090Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.