GPU comparison

H200 vs RTX 5060

Specifications and current cloud pricing, side by side.

HoppervsBlackwellUpdated 34 days ago

The H200 is the stronger choice for the most common use case of large scale model training because its 141 GB memory and 989 TFLOPS FP16 dense rating exceed the RTX 5060 capabilities by wide margins.

H200 from $3.79/GPU/hrRTX 5060 from $0.18/GPU/hr

Right now, from live stock

  • Cheapest right now: RTX 5060 at $0.18/hr on Vast.ai

    Deploy
  • Most providers in stock: H200 (5)

    See all offers

Specifications Compared

SpecH200RTX 5060
TDP700W145W
VRAM141 GB8-16 GB
CUDA Cores16,8963,840
FP8 (dense)1,979 TFLOPSNot published
Memory TypeHBM3eGDDR7
ArchitectureHopperBlackwell
FP16 (dense)989 TFLOPSNot published
Form FactorsSXM, NVLPCIe
INT8 (dense)1,979 TOPSNot published
InterconnectNVLink, PCIe 5.0, InfiniBandPCIe 5.0
Tensor Cores528120
FP32 Performance67 TFLOPS19.2 TFLOPS
FP64 Performance34 TFLOPSNot published
Memory Bandwidth4,800 GB/s448 GB/s
FP4 (with sparsity)Not published614 TFLOPS
FP8 (with sparsity)3,958 TFLOPSNot published
FP16 (with sparsity)1,979 TFLOPSNot published
INT8 (with sparsity)3,958 TOPSNot published

Performance Analysis

The H200 FP16 dense rating reaches 989 TFLOPS while its FP32 rating stands at 67 TFLOPS. This gap allows the H200 to process half precision operations more than ten times faster than single precision operations during training and inference steps. The RTX 5060 lacks a published FP16 figure so only its FP32 rating of 19.2 TFLOPS serves for comparison. Memory bandwidth on the H200 at 4800 GB/s exceeds the RTX 5060 bandwidth of 448 GB/s by more than ten times and therefore supports substantially larger batch sizes in memory intensive tasks. The H200 FP16 with sparsity rating of 1979 TFLOPS further widens the advantage over dense FP16 workloads when sparsity is available.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

H200

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
RunPodglobal1$3.79—Deploy
Vast.aiCzechia, CZ1$4.76—Deploy
VERDAFIN-HEL8$5.66$45.26Deploy
LyceumEurope8$6.19$49.52Deploy
LeaderGPUThe Netherlands1$6.22—Deploy

5 providers in stock, 6 offers (cheapest per provider shown). All H200 offers, price history and alerts

RTX 5060

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Vast.aiGermany, DE1$0.18—Deploy

1 provider in stock, 2 offers (cheapest per provider shown). All RTX 5060 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when H200 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $3.79/GPU-hr.

QuantaCloud

Comparing H-series providers? We broker across all of them.

Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the H200

The H200 becomes the preferred option for workloads that require 141 GB of memory and 4800 GB/s bandwidth to accommodate large models. Its 989 TFLOPS FP16 dense rating and NVLink interconnect support distributed training across multiple units in data center environments.

When to Choose the RTX 5060

The RTX 5060 serves best in settings limited to 145 W TDP and PCIe form factor where 8 to 16 GB memory suffices. Its FP4 with sparsity rating of 614 TFLOPS addresses lighter inference tasks on consumer hardware.

Use Cases

LLM Training
H200

The H200 supplies 141 GB memory and 989 TFLOPS FP16 dense performance that accommodate large models.

LLM Inference
H200

The H200 4800 GB/s bandwidth and 1979 TFLOPS FP16 with sparsity rating sustain high throughput for large batches.

Fine-tuning
H200

The H200 67 TFLOPS FP32 rating and NVLink interconnect enable efficient updates on sizable datasets.

Stable Diffusion
RTX 5060

The RTX 5060 145 W TDP and 614 TFLOPS FP4 with sparsity rating fit power limited image generation workloads.

Scientific Computing
H200

The H200 67 TFLOPS FP32 rating and 4800 GB/s bandwidth handle compute heavy simulations.

Frequently Asked Questions

What is the FP32 performance of the RTX 5060?▾

The RTX 5060 reaches 19.2 TFLOPS in FP32. Its TDP is limited to 145 W in a PCIe form factor.

Does the H200 support NVLink?▾

The H200 supports NVLink interconnect. It also offers SXM and NVL form factors with 700 W TDP.

What memory type does the RTX 5060 use?▾

The RTX 5060 uses GDDR7 memory in the range of 8 to 16 GB. Bandwidth is rated at 448 GB/s.

What FP16 rating does the H200 provide with sparsity?▾

The H200 provides 1979 TFLOPS FP16 with sparsity. Its dense FP16 rating is 989 TFLOPS.

Which is cheaper to rent, the H200 or the RTX 5060?▾

Cloud rental prices for both the H200 and RTX 5060 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the H200 have compared to the RTX 5060?▾

The H200 has 141 GB of HBM3e memory. The RTX 5060 has 8 to 16 GB of GDDR7 memory.

Can I find H200 and RTX 5060 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the H200 and the RTX 5060?▾

The H200 uses the Hopper architecture (2024) while the RTX 5060 uses Blackwell (2025). The H200 has 141 GB of HBM3e at 4,800 GB/s; the RTX 5060 has 8-16 GB of GDDR7 at 448 GB/s, so the H200 has 10.7x the memory bandwidth of the RTX 5060.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the H200 and the RTX 5060. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps