GPU comparison

H100 vs RTX 2080

Specifications and current cloud pricing, side by side.

HoppervsTuringUpdated 17 days ago

The H100 serves as the stronger choice for the most common use case of LLM training. Its 989 TFLOPS dense FP16 and 3350 GB/s bandwidth exceed the corresponding 40.3 TFLOPS and 448 GB/s values on the RTX 2080 by substantial margins derived from the listed specifications.

H100 listed from $2.50/GPU/hrRTX 2080 listed from $0.12/GPU/hr

Right now, from live stock

Specifications Compared

SpecH100RTX 2080
TDP700W215W
VRAM80-94 GB8-11 GB
CUDA Cores16,8962,944
FP8 (dense)1,979 TFLOPSNot published
Memory TypeHBM3GDDR6
ArchitectureHopperTuring
FP16 (dense)989 TFLOPS40.3 TFLOPS
Form FactorsSXM5, PCIe, NVLPCIe
INT8 (dense)1,979 TOPS161.1 TOPS
InterconnectNVLink, PCIe 5.0, InfiniBandNVLink, PCIe 3.0
Tensor Cores528368
FP32 Performance67 TFLOPS10 TFLOPS
FP64 Performance34 TFLOPSNot published
Memory Bandwidth3,350 GB/s448 GB/s
FP8 (with sparsity)3,958 TFLOPSNot published
FP16 (with sparsity)1,979 TFLOPSNot published
INT8 (with sparsity)3,958 TOPSNot published

Performance Analysis

Dense FP16 performance on the H100 measures 989 TFLOPS against 40.3 TFLOPS dense FP16 on the RTX 2080. This difference scales training throughput by a factor derived directly from those two figures. FP32 to dense FP16 ratios equal 67 TFLOPS to 989 TFLOPS on the H100 and 10 TFLOPS to 40.3 TFLOPS on the RTX 2080. Higher memory bandwidth of 3350 GB/s versus 448 GB/s permits larger batch sizes before memory capacity constraints appear. Sparse FP16 figures of 1979 TFLOPS on the H100 compare only to other sparse values while dense figures compare only to other dense values. The 700W TDP versus 215W TDP further separates sustained operation envelopes for extended workloads.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

H100

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
HyperstackCANADA-11$2.50—Deploy
Vast.aiCzechia, CZ2$2.59$5.17Deploy
QuantaCloudus-midwest-21$2.59—Deploy
Massed Computeus-central-31$2.73—Deploy
Oridallas-21$2.90—Deploy

8 providers in stock, 21 offers (cheapest per provider shown). All H100 offers, price history and alerts

RTX 2080

RTX 2080 is not offered on-demand by any provider we track right now. See the RTX 2080 rental page for last-seen listed prices and a price alert.

Which GPU to watchWatch the price of

Notify me when H100 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $2.50/GPU-hr.

QuantaCloud

Comparing H-series providers? We broker across all of them.

Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the H100

The H100 suits scenarios that demand 989 TFLOPS dense FP16 or 1979 TFLOPS dense FP8. Its 80 to 94 GB HBM3 VRAM and 3350 GB/s bandwidth support models that exceed 11 GB capacity limits of the RTX 2080. Form factors including SXM5 and NVL enable NVLink interconnects for multi GPU scaling.

When to Choose the RTX 2080

The RTX 2080 fits workloads limited to 10 TFLOPS FP32 or 40.3 TFLOPS dense FP16. Its 215W TDP allows operation in standard PCIe slots without 700W power infrastructure. The 8 to 11 GB GDDR6 configuration handles smaller inference tasks that fit within those bounds.

Use Cases

LLM Training
H100

The H100 supplies 989 TFLOPS dense FP16 compared to 40.3 TFLOPS dense FP16 on the RTX 2080.

LLM Inference
H100

The H100 delivers 1979 TFLOPS dense FP8 while the RTX 2080 lacks a published FP8 figure.

Fine-tuning
H100

The H100 provides 80 to 94 GB HBM3 VRAM against 8 to 11 GB GDDR6 VRAM on the RTX 2080.

Stable Diffusion
RTX 2080

The RTX 2080 operates at 215W TDP and fits tasks within 8 to 11 GB GDDR6 limits.

Scientific Computing
H100

The H100 reaches 67 TFLOPS FP32 compared to 10 TFLOPS FP32 on the RTX 2080.

Frequently Asked Questions

How does FP16 performance differ between the H100 and RTX 2080?▾

The H100 achieves 989 TFLOPS in dense FP16. The RTX 2080 reaches 40.3 TFLOPS in dense FP16.

What memory bandwidth values appear in the H100 and RTX 2080 specifications?▾

The H100 lists 3350 GB/s memory bandwidth. The RTX 2080 lists 448 GB/s memory bandwidth.

Which GPU provides higher INT8 throughput?▾

The H100 reaches 1979 TOPS in dense INT8. The RTX 2080 reaches 161.1 TOPS in dense INT8.

What TDP ratings are listed for each GPU?▾

The H100 carries a 700W TDP rating. The RTX 2080 carries a 215W TDP rating.

What FP32 performance figures are provided?▾

The H100 lists 67 TFLOPS FP32. The RTX 2080 lists 10 TFLOPS FP32.

Which is cheaper to rent, the H100 or the RTX 2080?▾

Cloud rental prices for both the H100 and RTX 2080 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the H100 have compared to the RTX 2080?▾

The H100 has 80 to 94 GB of HBM3 memory. The RTX 2080 has 8 to 11 GB of GDDR6 memory.

Can I find H100 and RTX 2080 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the H100 and the RTX 2080?▾

The H100 uses the Hopper architecture (2022) while the RTX 2080 uses Turing (2018). The H100 delivers 24.5x the dense FP16 throughput (989 vs 40.3 TFLOPS, both without sparsity) and 7.5x the memory bandwidth of the RTX 2080.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the H100 and the RTX 2080. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps