Specifications Compared
| Spec | H100 SXM5 | RTX 4090 |
|---|---|---|
| TDP | 700W | 450W |
| VRAM | 80 GB | 24 GB |
| CUDA Cores | 16,896 | 16,384 |
| FP8 (dense) | 1,979 TFLOPS | 330.3 TFLOPS |
| Memory Type | HBM3 | GDDR6X |
| Architecture | Hopper | Ada Lovelace |
| FP16 (dense) | 989 TFLOPS | 165.2 TFLOPS |
| Form Factors | SXM5 | PCIe |
| INT8 (dense) | 1,979 TOPS | 660.6 TOPS |
| Interconnect | NVLink, PCIe 5.0, InfiniBand | PCIe 4.0 |
| Tensor Cores | 528 | 512 |
| FP32 Performance | 67 TFLOPS | 82.6 TFLOPS |
| FP64 Performance | 34 TFLOPS | 1.3 TFLOPS |
| Memory Bandwidth | 3,350 GB/s | 1,008 GB/s |
| FP8 (with sparsity) | 3,958 TFLOPS | 660.6 TFLOPS |
| FP16 (with sparsity) | 1,979 TFLOPS | 330.4 TFLOPS |
| INT8 (with sparsity) | 3,958 TOPS | 1,321.2 TOPS |
Performance Analysis
The H100 SXM5 delivers 989 TFLOPS in dense FP16 while the RTX 4090 delivers 165.2 TFLOPS in dense FP16. The same H100 SXM5 reaches 1979 TFLOPS in FP16 with sparsity while the RTX 4090 reaches 330.4 TFLOPS in FP16 with sparsity. Memory bandwidth shared at 3350 GB/s on the H100 SXM5 versus 1008 GB/s on the RTX 4090 allows larger batch sizes during training and inference on the H100 SXM5. FP32 performance shared at 67 TFLOPS on the H100 SXM5 versus 82.6 TFLOPS on the RTX 4090 shows the RTX 4090 holds a modest edge in single precision workloads.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
H100 SXM5
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| QuantaCloud | us-midwest-2 | 1 | $2.59 | — | Deploy |
| Massed Compute | us-central-3 | 1 | $2.73 | — | Deploy |
| Ori | dallas-2 | 1 | $2.90 | — | Deploy |
| LeaderGPU | The Netherlands | 8 | $3.59 | $28.75 | Deploy |
| Vast.ai | Czechia, CZ | 2 | $4.23 | $8.47 | Deploy |
9 providers in stock, 20 offers (cheapest per provider shown). All H100 SXM5 offers, price history and alerts
Notify me when H100 SXM5 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $2.59/GPU-hr.
QuantaCloud
Comparing H-series providers? We broker across all of them.
Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.
When to Choose the H100 SXM5
The H100 SXM5 suits LLM training jobs that require 80 GB HBM3 capacity and 3350 GB/s bandwidth for models exceeding 24 GB. Its NVLink interconnect supports multi GPU scaling in scientific computing clusters that need dense FP16 throughput of 989 TFLOPS.
When to Choose the RTX 4090
The RTX 4090 suits Stable Diffusion workloads and smaller fine tuning tasks that fit within 24 GB GDDR6X and run at 450W TDP. Its PCIe 4.0 interface matches single node inference setups that need dense FP16 throughput of 165.2 TFLOPS without multi GPU scaling.
Use Cases
The H100 SXM5 supplies 80 GB HBM3 and 989 TFLOPS dense FP16 that accommodate large models beyond 24 GB limits.
The H100 SXM5 provides 3350 GB/s bandwidth and 1979 TFLOPS FP8 dense that sustain higher throughput than the RTX 4090 figures.
Both GPUs handle fine tuning when models fit in 24 GB yet the H100 SXM5 scales better with NVLink for larger batches.
The RTX 4090 runs Stable Diffusion efficiently within 24 GB GDDR6X at 450W TDP without requiring the higher capacity of the H100 SXM5.
The H100 SXM5 delivers 67 TFLOPS FP32 and InfiniBand interconnect that benefit multi node scientific simulations.
Frequently Asked Questions
What is the memory bandwidth of each GPU?▾
The H100 SXM5 family shares 3350 GB/s bandwidth and the RTX 4090 family shares 1008 GB/s bandwidth.
Which GPU offers higher dense FP16 performance?▾
The H100 SXM5 reaches 989 TFLOPS in dense FP16 while the RTX 4090 reaches 165.2 TFLOPS in dense FP16.
What TDP values apply to these variants?▾
The H100 SXM5 family shares a 700W TDP and the RTX 4090 family shares a 450W TDP.
Does the H100 SXM5 support NVLink?▾
The H100 SXM5 variant includes NVLink interconnect while the RTX 4090 variant uses only PCIe 4.0.
Which is cheaper to rent, the H100 SXM5 or the RTX 4090?▾
Cloud rental prices for both the H100 SXM5 and RTX 4090 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the H100 SXM5 have compared to the RTX 4090?▾
The H100 SXM5 has 80 GB of HBM3 memory. The RTX 4090 has 24 GB of GDDR6X memory.
Can I find H100 SXM5 and RTX 4090 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the H100 SXM5 and the RTX 4090?▾
The H100 SXM5 uses the Hopper architecture (2022) while the RTX 4090 uses Ada Lovelace (2022). The H100 SXM5 delivers 6.0x the dense FP16 throughput (989 vs 165.2 TFLOPS, both without sparsity) and 3.3x the memory bandwidth of the RTX 4090.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the H100 SXM5 and the RTX 4090. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent H100Every current offer by provider, daily price history and a price alert.
- Rent RTX 4090Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.