GPU comparison

H100 NVL vs RTX 3090 Ti

Specifications and current cloud pricing, side by side.

HoppervsAmpereUpdated 32 days ago

This variant comparison is part of the H100 vs RTX 3090 family comparison.

The H100 NVL variant wins for the most common large model workloads because its 94 GB memory and 989 TFLOPS dense FP16 exceed the RTX 3090 Ti variant limits of 24 GB and 71 TFLOPS dense FP16 by wide margins.

H100 NVL from $2.50/GPU/hrRTX 3090 Ti from $0.29/GPU/hr

Right now, from live stock

  • Cheapest right now: RTX 3090 Ti at $0.29/hr on LeaderGPU

    Deploy
  • Most providers in stock: H100 NVL (7)

    See all offers
  • Best $ per TFLOPS FP16 dense right now: H100 NVL ($0.0025 per TFLOPS-hour at 989 TFLOPS)

    Deploy

Specifications Compared

SpecH100 NVLRTX 3090 Ti
TDP700W350W
VRAM94 GB24 GB
CUDA Cores16,89610,496
FP8 (dense)1,979 TFLOPSNot published
Memory TypeHBM3GDDR6X
ArchitectureHopperAmpere
FP16 (dense)989 TFLOPS71 TFLOPS
Form FactorsNVL (PCIe card, NVLink bridged)PCIe
INT8 (dense)1,979 TOPS284 TOPS
InterconnectNVLink bridge, PCIe 5.0NVLink, PCIe 4.0
Tensor Cores528328
FP32 Performance67 TFLOPS35.6 TFLOPS
FP64 Performance34 TFLOPSNot published
Memory Bandwidth3,350 GB/s936 GB/s
FP8 (with sparsity)3,958 TFLOPSNot published
FP16 (with sparsity)1,979 TFLOPS142 TFLOPS
INT8 (with sparsity)3,958 TOPS568 TOPS

Performance Analysis

Dense FP16 throughput reaches 989 TFLOPS on the H100 NVL family and 71 TFLOPS on the RTX 3090 Ti family while FP32 throughput reaches 67 TFLOPS on the H100 NVL family and 35.6 TFLOPS on the RTX 3090 Ti family. Memory bandwidth of 3350 GB/s on the H100 NVL family versus 936 GB/s on the RTX 3090 Ti family supports larger batch sizes before memory capacity of 94 GB versus 24 GB becomes the constraint.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

H100 NVL

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
HyperstackCANADA-12$2.50$5.00Deploy
Vast.aiCzechia, CZ1$2.59—Deploy
QuantaCloudus-midwest-21$2.59—Deploy
Massed Computeus-central-31$2.73—Deploy
Oridallas-22$2.90$5.80Deploy

7 providers in stock, 24 offers (cheapest per provider shown). All H100 NVL offers, price history and alerts

RTX 3090 Ti

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
LeaderGPUThe Netherlands8$0.29$2.29Deploy
Vast.aiCzechia, CZ4$0.37$1.48Deploy

2 providers in stock, 11 offers (cheapest per provider shown). All RTX 3090 Ti offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when H100 NVL drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $2.50/GPU-hr.

QuantaCloud

Comparing H-series providers? We broker across all of them.

Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the H100 NVL

The H100 NVL variant suits jobs that require the 94 GB HBM3 capacity together with 3350 GB/s bandwidth and 989 TFLOPS dense FP16. Its NVL form factor and PCIe 5.0 interconnect fit installations already equipped for 700W TDP and NVLink bridge connections.

When to Choose the RTX 3090 Ti

The RTX 3090 Ti variant suits jobs that fit within 24 GB GDDR6X capacity and operate at 350W TDP with PCIe 4.0 interconnect. Its lower power draw and standard PCIe form factor match systems that cannot accommodate 700W cards or NVLink bridge setups.

Use Cases

LLM Training
H100 NVL

The 94 GB HBM3 capacity and 989 TFLOPS dense FP16 on the H100 NVL variant exceed the 24 GB and 71 TFLOPS dense FP16 limits of the RTX 3090 Ti variant.

LLM Inference
H100 NVL

Memory bandwidth of 3350 GB/s and 1979 TFLOPS FP16 with sparsity on the H100 NVL family allow larger batch sizes than the 936 GB/s and 142 TFLOPS FP16 with sparsity on the RTX 3090 Ti family.

Fine-tuning
H100 NVL

The 94 GB capacity on the H100 NVL variant accommodates models that overflow the 24 GB capacity on the RTX 3090 Ti variant while delivering 989 TFLOPS dense FP16.

Stable Diffusion
RTX 3090 Ti

The 24 GB GDDR6X and 350W TDP on the RTX 3090 Ti variant suffice for typical image generation workloads at lower power than the 700W TDP of the H100 NVL variant.

Scientific Computing
Either

FP32 throughput of 67 TFLOPS on the H100 NVL family versus 35.6 TFLOPS on the RTX 3090 Ti family guides selection when power budget or memory needs align with either 700W or 350W TDP.

Frequently Asked Questions

What are the memory bandwidth figures?▾

Memory bandwidth reaches 3350 GB/s on the H100 NVL family and 936 GB/s on the RTX 3090 Ti family.

What TDP values apply to these variants?▾

TDP equals 700W for the H100 family and 350W for the RTX 3090 family.

How do dense FP16 figures compare?▾

Dense FP16 reaches 989 TFLOPS on the H100 NVL family and 71 TFLOPS on the RTX 3090 Ti family.

Which is cheaper to rent, the H100 NVL or the RTX 3090 Ti?▾

Cloud rental prices for both the H100 NVL and RTX 3090 Ti vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the H100 NVL have compared to the RTX 3090 Ti?▾

The H100 NVL has 94 GB of HBM3 memory. The RTX 3090 Ti has 24 GB of GDDR6X memory.

Can I find H100 NVL and RTX 3090 Ti GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the H100 NVL and the RTX 3090 Ti?▾

The H100 NVL uses the Hopper architecture (2022) while the RTX 3090 Ti uses Ampere (2020). The H100 NVL delivers 13.9x the dense FP16 throughput (989 vs 71 TFLOPS, both without sparsity) and 3.6x the memory bandwidth of the RTX 3090 Ti.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the H100 NVL and the RTX 3090 Ti. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps