GPU comparison

H200 NVL vs RTX 5090

Specifications and current cloud pricing, side by side.

HoppervsBlackwellUpdated 35 days ago

This variant comparison is part of the H200 vs RTX 5090 family comparison.

The H200 NVL variant is the better choice for the most common large model training use case because its 141 GB memory capacity and 989 TFLOPS FP16 dense throughput exceed the RTX 5090 figures by substantial margins.

H200 NVL from $3.79/GPU/hrRTX 5090 from $0.87/GPU/hr

Right now, from live stock

  • Cheapest right now: RTX 5090 at $0.87/hr on Vast.ai

    Deploy
  • Most providers in stock: H200 NVL (5)

    See all offers
  • Best $ per TFLOPS FP16 dense right now: H200 NVL ($0.0038 per TFLOPS-hour at 989 TFLOPS)

    Deploy

Specifications Compared

SpecH200 NVLRTX 5090
TDP700W575W
VRAM141 GB32 GB
CUDA Cores16,89621,760
FP4 (dense)Not published1,676 TFLOPS
FP8 (dense)1,979 TFLOPS419 TFLOPS
Memory TypeHBM3eGDDR7
ArchitectureHopperBlackwell
FP16 (dense)989 TFLOPS209.5 TFLOPS
Form FactorsNVL (PCIe card, NVLink bridged)PCIe
INT8 (dense)1,979 TOPS838 TOPS
InterconnectNVLink bridge, PCIe 5.0PCIe 5.0
Tensor Cores528680
FP32 Performance67 TFLOPS104.8 TFLOPS
FP64 Performance34 TFLOPS1.6 TFLOPS
Memory Bandwidth4,800 GB/s1,792 GB/s
FP4 (with sparsity)Not published3,352 TFLOPS
FP8 (with sparsity)3,958 TFLOPS838 TFLOPS
FP16 (with sparsity)1,979 TFLOPS419 TFLOPS
INT8 (with sparsity)3,958 TOPS1,676 TOPS

Performance Analysis

The H200 NVL family delivers 989 TFLOPS FP16 dense throughput and 67 TFLOPS FP32 throughput while the RTX 5090 family delivers 209.5 TFLOPS FP16 dense throughput and 104.8 TFLOPS FP32 throughput. This FP16 dense to FP32 ratio indicates the H200 NVL processes matrix operations at a higher rate relative to scalar workloads compared with the RTX 5090. The 4800 GB/s memory bandwidth shared across H200 variants supports larger batch sizes in memory intensive tasks than the 1792 GB/s bandwidth shared across RTX 5090 variants.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

H200 NVL

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
RunPodglobal1$3.79—Deploy
Vast.aiCzechia, CZ1$5.45—Deploy
VERDAFIN-HEL2$5.71$11.43Deploy
LyceumEurope2$6.19$12.38Deploy
LeaderGPUThe Netherlands1$6.22—Deploy

5 providers in stock, 7 offers (cheapest per provider shown). All H200 NVL offers, price history and alerts

RTX 5090

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Vast.aiAlberta, CA8$0.87$6.93Deploy
RunPodglobal1$1.19—Deploy
LeaderGPUThe Netherlands1$2.29—Deploy

3 providers in stock, 9 offers (cheapest per provider shown). All RTX 5090 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when H200 NVL drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $3.79/GPU-hr.

QuantaCloud

Comparing H-series providers? We broker across all of them.

Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the H200 NVL

The H200 NVL variant suits workloads that require the 141 GB memory capacity and NVLink bridge interconnect for multi GPU scaling. Its 700W TDP and 4800 GB/s bandwidth align with large model training scenarios where the 989 TFLOPS FP16 dense figure exceeds the RTX 5090 equivalent.

When to Choose the RTX 5090

The RTX 5090 variant fits workloads that operate within the 32 GB memory limit and benefit from the 104.8 TFLOPS FP32 throughput at a 575W TDP. Its PCIe form factor and 1792 GB/s bandwidth support inference tasks where the 209.5 TFLOPS FP16 dense figure meets requirements without excess capacity.

Use Cases

LLM Training
H200 NVL

The H200 NVL variant supplies 141 GB memory and 989 TFLOPS FP16 dense throughput that exceed the RTX 5090 capacity for large models.

LLM Inference
RTX 5090

The RTX 5090 variant operates efficiently within 32 GB memory at 209.5 TFLOPS FP16 dense throughput for standard inference workloads.

Fine-tuning
H200 NVL

The H200 NVL variant provides 141 GB memory and NVLink bridge connectivity that support fine tuning of models larger than 32 GB.

Stable Diffusion
RTX 5090

The RTX 5090 variant delivers 104.8 TFLOPS FP32 throughput within a 32 GB memory envelope suitable for image generation tasks.

Scientific Computing
H200 NVL

The H200 NVL variant offers 67 TFLOPS FP32 throughput paired with 4800 GB/s bandwidth for compute heavy simulations.

Frequently Asked Questions

What memory capacities distinguish the H200 NVL from the RTX 5090?▾

The H200 NVL variant contains 141 GB HBM3e memory while the RTX 5090 variant contains 32 GB GDDR7 memory. These capacities represent the primary difference between the two specific models.

How do the FP16 dense figures compare between the two GPUs?▾

The H200 NVL family reports 989 TFLOPS FP16 dense while the RTX 5090 family reports 209.5 TFLOPS FP16 dense. Both figures apply uniformly across variants within each family.

What TDP values apply to these GPU families?▾

The H200 family including the NVL variant operates at 700W TDP while the RTX 5090 family operates at 575W TDP. These power figures remain consistent across all variants of each family.

How does memory bandwidth differ between the H200 NVL and RTX 5090?▾

The H200 family provides 4800 GB/s memory bandwidth shared by every variant including the NVL model. The RTX 5090 family provides 1792 GB/s memory bandwidth shared by every variant.

Which is cheaper to rent, the H200 NVL or the RTX 5090?▾

Cloud rental prices for both the H200 NVL and RTX 5090 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the H200 NVL have compared to the RTX 5090?▾

The H200 NVL has 141 GB of HBM3e memory. The RTX 5090 has 32 GB of GDDR7 memory.

Can I find H200 NVL and RTX 5090 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the H200 NVL and the RTX 5090?▾

The H200 NVL uses the Hopper architecture (2024) while the RTX 5090 uses Blackwell (2025). The H200 NVL delivers 4.7x the dense FP16 throughput (989 vs 209.5 TFLOPS, both without sparsity) and 2.7x the memory bandwidth of the RTX 5090.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the H200 NVL and the RTX 5090. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps