Specifications Compared
| Spec | H200 | RTX 4090 |
|---|---|---|
| TDP | 700W | 450W |
| VRAM | 141 GB | 24 GB |
| CUDA Cores | 16,896 | 16,384 |
| FP8 (dense) | 1,979 TFLOPS | 330.3 TFLOPS |
| Memory Type | HBM3e | GDDR6X |
| Architecture | Hopper | Ada Lovelace |
| FP16 (dense) | 989 TFLOPS | 165.2 TFLOPS |
| Form Factors | SXM, NVL | PCIe |
| INT8 (dense) | 1,979 TOPS | 660.6 TOPS |
| Interconnect | NVLink, PCIe 5.0, InfiniBand | PCIe 4.0 |
| Tensor Cores | 528 | 512 |
| FP32 Performance | 67 TFLOPS | 82.6 TFLOPS |
| FP64 Performance | 34 TFLOPS | 1.3 TFLOPS |
| Memory Bandwidth | 4,800 GB/s | 1,008 GB/s |
| FP8 (with sparsity) | 3,958 TFLOPS | 660.6 TFLOPS |
| FP16 (with sparsity) | 1,979 TFLOPS | 330.4 TFLOPS |
| INT8 (with sparsity) | 3,958 TOPS | 1,321.2 TOPS |
Performance Analysis
The H200 reaches 989 TFLOPS FP16 dense which surpasses the 165.2 TFLOPS FP16 dense of the RTX 4090 by a ratio of six to one. This margin allows the H200 to process larger batch sizes in training and inference workloads that rely on FP16 dense operations. Memory bandwidth of 4800 GB/s on the H200 compared with 1008 GB/s on the RTX 4090 supports those larger batches by reducing data transfer constraints. FP16 with sparsity shows the H200 at 1979 TFLOPS against 330.4 TFLOPS on the RTX 4090. FP32 performance favors the RTX 4090 at 82.6 TFLOPS over the H200 at 67 TFLOPS. The H200 therefore aligns with reduced precision workloads while the RTX 4090 aligns with FP32 focused workloads.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
H200
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| RunPod | global | 1 | $5.29 | — | Deploy |
| VERDA | FIN-HEL | 2 | $5.66 | $11.32 | Deploy |
| Vast.ai | Czechia, CZ | 1 | $5.85 | — | Deploy |
| Lyceum | Europe | 2 | $6.19 | $12.38 | Deploy |
| LeaderGPU | The Netherlands | 1 | $6.22 | — | Deploy |
5 providers in stock, 6 offers (cheapest per provider shown). All H200 offers, price history and alerts
Notify me when H200 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $5.29/GPU-hr.
QuantaCloud
Comparing H-series providers? We broker across all of them.
Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.
When to Choose the H200
The H200 suits large scale LLM training because its 141 GB VRAM accommodates models that exceed the 24 GB limit of the RTX 4090. Its 989 TFLOPS FP16 dense and 4800 GB/s bandwidth further enable efficient handling of high volume inference batches.
When to Choose the RTX 4090
The RTX 4090 suits FP32 dominant scientific computing because it delivers 82.6 TFLOPS FP32 compared with 67 TFLOPS FP32 on the H200. Its 450 W TDP also fits power constrained single node deployments.
Use Cases
The H200 supplies 989 TFLOPS FP16 dense and 141 GB VRAM compared with 165.2 TFLOPS FP16 dense and 24 GB VRAM on the RTX 4090.
The H200 supplies 1979 TFLOPS FP8 dense and 4800 GB/s bandwidth compared with 330.3 TFLOPS FP8 dense and 1008 GB/s bandwidth on the RTX 4090.
The H200 supplies 141 GB VRAM and 989 TFLOPS FP16 dense compared with 24 GB VRAM and 165.2 TFLOPS FP16 dense on the RTX 4090.
The RTX 4090 supplies 82.6 TFLOPS FP32 and 450 W TDP compared with 67 TFLOPS FP32 and 700 W TDP on the H200.
The RTX 4090 supplies 82.6 TFLOPS FP32 compared with 67 TFLOPS FP32 on the H200.
Frequently Asked Questions
What memory bandwidth does each GPU provide?▾
The H200 provides 4800 GB/s memory bandwidth while the RTX 4090 provides 1008 GB/s memory bandwidth.
How do the FP16 dense ratings compare between the H200 and RTX 4090?▾
The H200 reaches 989 TFLOPS FP16 dense while the RTX 4090 reaches 165.2 TFLOPS FP16 dense.
What FP32 performance does each GPU deliver?▾
The H200 delivers 67 TFLOPS FP32 while the RTX 4090 delivers 82.6 TFLOPS FP32.
Which GPU has higher TDP rating?▾
The H200 has a 700 W TDP rating while the RTX 4090 has a 450 W TDP rating.
What interconnect options exist on each GPU?▾
The H200 supports NVLink and InfiniBand while the RTX 4090 supports PCIe 4.0.
Which is cheaper to rent, the H200 or the RTX 4090?▾
Cloud rental prices for both the H200 and RTX 4090 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the H200 have compared to the RTX 4090?▾
The H200 has 141 GB of HBM3e memory. The RTX 4090 has 24 GB of GDDR6X memory.
Can I find H200 and RTX 4090 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the H200 and the RTX 4090?▾
The H200 uses the Hopper architecture (2024) while the RTX 4090 uses Ada Lovelace (2022). The H200 delivers 6.0x the dense FP16 throughput (989 vs 165.2 TFLOPS, both without sparsity) and 4.8x the memory bandwidth of the RTX 4090.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the H200 and the RTX 4090. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent H200Every current offer by provider, daily price history and a price alert.
- Rent RTX 4090Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.