Specifications Compared
| Spec | H100 SXM5 | RTX 3090 Ti |
|---|---|---|
| TDP | 700W | 350W |
| VRAM | 80 GB | 24 GB |
| CUDA Cores | 16,896 | 10,496 |
| FP8 (dense) | 1,979 TFLOPS | Not published |
| Memory Type | HBM3 | GDDR6X |
| Architecture | Hopper | Ampere |
| FP16 (dense) | 989 TFLOPS | Not published |
| Form Factors | SXM5 | PCIe |
| INT8 (dense) | 1,979 TOPS | Not published |
| Interconnect | NVLink, PCIe 5.0, InfiniBand | NVLink |
| Tensor Cores | 528 | 328 |
| FP32 Performance | 67 TFLOPS | 35.6 TFLOPS |
| FP64 Performance | 34 TFLOPS | Not published |
| Memory Bandwidth | 3,350 GB/s | 936 GB/s |
| FP8 (with sparsity) | 3,958 TFLOPS | Not published |
| FP16 (with sparsity) | 1,979 TFLOPS | Not published |
| INT8 (with sparsity) | 3,958 TOPS | Not published |
| FP16 (vendor figure, sparsity not specified) | Not published | 35.6 TFLOPS |
Performance Analysis
The FP16 dense performance of 989 TFLOPS on the H100 SXM5 exceeds the 35.6 TFLOPS FP16 figure on the RTX 3090 Ti by a substantial margin and this gap affects training and inference workloads where larger tensor operations benefit from the higher dense throughput. Memory bandwidth at 3350 GB/s shared across H100 variants supports larger batch sizes compared to the 936 GB/s shared across RTX 3090 variants which limits throughput on memory intensive tasks. FP32 performance remains at 67 TFLOPS dense for the H100 family and 35.6 TFLOPS for the RTX 3090 family while the H100 SXM5 TDP of 700W exceeds the RTX 3090 Ti TDP of 350W in power draw for equivalent dense FP16 computations.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
H100 SXM5
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| QuantaCloud | us-midwest-2 | 2 | $2.59 | $5.18 | Deploy |
| Massed Compute | us-central-3 | 2 | $2.73 | $5.46 | Deploy |
| RunPod | global | 1 | $2.89 | — | Deploy |
| Ori | dallas-2 | 8 | $2.90 | $23.20 | Deploy |
| Lambda Labs | us-west-3 | 1 | $3.29 | — | Deploy |
8 providers in stock, 31 offers (cheapest per provider shown). All H100 SXM5 offers, price history and alerts
RTX 3090 Ti
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.29 | $2.29 | Deploy |
| Vast.ai | Finland, FI | 4 | $0.29 | $1.17 | Deploy |
2 providers in stock, 11 offers (cheapest per provider shown). All RTX 3090 Ti offers, price history and alerts
Notify me when H100 SXM5 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $2.59/GPU-hr.
QuantaCloud
Comparing H-series providers? We broker across all of them.
Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.
When to Choose the H100 SXM5
The H100 SXM5 suits scenarios that require 80 GB HBM3 capacity and 3350 GB/s bandwidth for large scale model handling in data center environments. Its SXM5 form factor and InfiniBand support enable configurations where dense FP16 throughput at 989 TFLOPS accelerates workloads beyond the capabilities of the RTX 3090 Ti.
When to Choose the RTX 3090 Ti
The RTX 3090 Ti fits scenarios that operate within 24 GB GDDR6X limits and 350W TDP for smaller models or development tasks. Its PCIe form factor provides simpler integration where the 35.6 TFLOPS FP16 performance meets requirements without the higher power or interconnect demands of the H100 SXM5.
Use Cases
The H100 SXM5 provides 80 GB HBM3 and 989 TFLOPS dense FP16 to handle large models that exceed the 24 GB limit of the RTX 3090 Ti.
Dense FP16 throughput at 989 TFLOPS on the H100 SXM5 supports higher throughput than the 35.6 TFLOPS on the RTX 3090 Ti for sustained inference.
Memory bandwidth of 3350 GB/s shared by H100 variants allows larger batch sizes than the 936 GB/s on the RTX 3090 family during fine-tuning.
The RTX 3090 Ti 24 GB GDDR6X and 350W TDP meet requirements for image generation tasks at lower power than the H100 SXM5.
FP32 performance at 67 TFLOPS on the H100 family combined with NVLink and InfiniBand interconnects accelerates simulations beyond RTX 3090 Ti capabilities.
Frequently Asked Questions
How does FP16 performance differ between these GPUs?▾
The H100 SXM5 delivers 989 TFLOPS dense FP16 while the RTX 3090 Ti delivers 35.6 TFLOPS FP16. The figures must be compared as dense to dense.
What are the TDP values for the H100 SXM5 and RTX 3090 Ti?▾
The H100 family TDP is 700W and the RTX 3090 family TDP is 350W. These values apply to the specific variants discussed.
Does memory bandwidth vary between H100 SXM5 and RTX 3090 Ti variants?▾
Bandwidth is a family figure at 3350 GB/s for all H100 variants and 936 GB/s for all RTX 3090 variants. These numbers apply to the models compared.
Which is cheaper to rent, the H100 SXM5 or the RTX 3090 Ti?▾
Cloud rental prices for both the H100 SXM5 and RTX 3090 Ti vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the H100 SXM5 have compared to the RTX 3090 Ti?▾
The H100 SXM5 has 80 GB of HBM3 memory. The RTX 3090 Ti has 24 GB of GDDR6X memory.
Can I find H100 SXM5 and RTX 3090 Ti GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the H100 SXM5 and the RTX 3090 Ti?▾
The H100 SXM5 uses the Hopper architecture (2022) while the RTX 3090 Ti uses Ampere (2020). The H100 SXM5 delivers 13.9x the dense FP16 throughput (989 vs 71 TFLOPS, both without sparsity) and 3.6x the memory bandwidth of the RTX 3090 Ti.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the H100 SXM5 and the RTX 3090 Ti. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent H100Every current offer by provider, daily price history and a price alert.
- Rent RTX 3090Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.