GPU comparison

H200 vs Quadro RTX 5000

Specifications and current cloud pricing, side by side.

HoppervsTuringUpdated 34 days ago

The H200 wins for the most common use case of LLM training because its 989 TFLOPS dense FP16 and 141 GB memory exceed the corresponding 89.2 TFLOPS dense FP16 and 16 GB memory of the Quadro RTX 5000 by substantial margins.

H200 from $4.47/GPU/hrQuadro RTX 5000 from $0.82/GPU/hr

Right now, from live stock

  • Cheapest right now: Quadro RTX 5000 at $0.82/hr on Paperspace

    Deploy
  • Most providers in stock: H200 (3)

    See all offers
  • Best $ per TFLOPS FP16 dense right now: H200 ($0.0045 per TFLOPS-hour at 989 TFLOPS)

    Deploy

Specifications Compared

SpecH200Quadro RTX 5000
TDP700W230W
VRAM141 GB16 GB
CUDA Cores16,8963,072
FP8 (dense)1,979 TFLOPSNot published
Memory TypeHBM3eGDDR6
ArchitectureHopperTuring
FP16 (dense)989 TFLOPS89.2 TFLOPS
Form FactorsSXM, NVLPCIe
INT8 (dense)1,979 TOPS178.4 TOPS
InterconnectNVLink, PCIe 5.0, InfiniBandNVLink, PCIe 3.0
Tensor Cores528384
FP32 Performance67 TFLOPS11.2 TFLOPS
FP64 Performance34 TFLOPSNot published
Memory Bandwidth4,800 GB/s448 GB/s
FP8 (with sparsity)3,958 TFLOPSNot published
FP16 (with sparsity)1,979 TFLOPSNot published
INT8 (with sparsity)3,958 TOPSNot published

Performance Analysis

The FP16 dense figure of 989 TFLOPS on the H200 exceeds the FP16 dense figure of 89.2 TFLOPS on the Quadro RTX 5000. This difference translates to greater throughput capacity during training and inference operations that rely on dense FP16 calculations. The FP32 value of 67 TFLOPS on the H200 surpasses the FP32 value of 11.2 TFLOPS on the Quadro RTX 5000 and supports precision requirements in scientific workloads. Memory bandwidth of 4800 GB/s on the H200 versus 448 GB/s on the Quadro RTX 5000 permits larger batch sizes by sustaining higher data transfer rates between memory and compute units.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

H200

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
DigitalOceanNew York 21$4.47—Deploy
Vast.aiCzechia, CZ1$5.43—Deploy
LeaderGPUThe Netherlands1$6.22—Deploy

3 providers in stock, 6 offers (cheapest per provider shown). All H200 offers, price history and alerts

Quadro RTX 5000

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Paperspaceny21$0.82—Deploy

1 provider in stock, 2 offers (cheapest per provider shown). All Quadro RTX 5000 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when H200 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $4.47/GPU-hr.

QuantaCloud

Comparing H-series providers? We broker across all of them.

Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the H200

The H200 suits workloads that require 141 GB memory capacity and 989 TFLOPS dense FP16 performance. Scenarios involving large scale model training benefit from the 4800 GB/s memory bandwidth and 700W TDP configuration.

When to Choose the Quadro RTX 5000

The Quadro RTX 5000 fits environments constrained to 230W TDP and 16 GB memory capacity. Tasks that align with 89.2 TFLOPS dense FP16 and PCIe form factor availability find suitable support from this GPU.

Use Cases

LLM Training
H200

The H200 supplies 989 TFLOPS dense FP16 and 141 GB memory that exceed the 89.2 TFLOPS dense FP16 and 16 GB memory of the Quadro RTX 5000.

LLM Inference
H200

The H200 provides 989 TFLOPS dense FP16 along with 4800 GB/s bandwidth for handling inference at scales beyond the Quadro RTX 5000 capabilities.

Fine-tuning
H200

The H200 supports fine tuning through 989 TFLOPS dense FP16 performance and 141 GB memory versus the lower specifications on the Quadro RTX 5000.

Stable Diffusion
Quadro RTX 5000

The Quadro RTX 5000 operates at 230W TDP with 89.2 TFLOPS dense FP16 in form factors compatible with lighter inference demands.

Scientific Computing
H200

The H200 delivers 67 TFLOPS FP32 and 4800 GB/s bandwidth that surpass the 11.2 TFLOPS FP32 and 448 GB/s bandwidth of the Quadro RTX 5000.

Frequently Asked Questions

How does FP16 dense performance compare between the two GPUs?▾

The H200 achieves 989 TFLOPS dense FP16. The Quadro RTX 5000 achieves 89.2 TFLOPS dense FP16.

What TDP values are listed for each GPU?▾

The H200 lists a TDP of 700W. The Quadro RTX 5000 lists a TDP of 230W.

What FP32 performance is specified for the H200 and Quadro RTX 5000?▾

The H200 specifies 67 TFLOPS FP32. The Quadro RTX 5000 specifies 11.2 TFLOPS FP32.

What architectures do these GPUs use?▾

The H200 uses the Hopper architecture. The Quadro RTX 5000 uses the Turing architecture.

Which is cheaper to rent, the H200 or the Quadro RTX 5000?▾

Cloud rental prices for both the H200 and Quadro RTX 5000 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the H200 have compared to the Quadro RTX 5000?▾

The H200 has 141 GB of HBM3e memory. The Quadro RTX 5000 has 16 GB of GDDR6 memory.

Can I find H200 and Quadro RTX 5000 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the H200 and the Quadro RTX 5000?▾

The H200 uses the Hopper architecture (2024) while the Quadro RTX 5000 uses Turing (2018). The H200 delivers 11.1x the dense FP16 throughput (989 vs 89.2 TFLOPS, both without sparsity) and 10.7x the memory bandwidth of the Quadro RTX 5000.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the H200 and the Quadro RTX 5000. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps