GPU comparison

H200 vs MI250X

Specifications and current cloud pricing, side by side.

HoppervsCDNA 2Updated 33 days ago

The H200 wins for the most common use case of LLM training because its 989 TFLOPS dense FP16 and 4800 GB/s bandwidth exceed the corresponding 383 TFLOPS and 3277 GB/s figures of the MI250X by substantial margins.

H200 listed from $5.29/GPU/hrMI250X listed from $1.28/GPU/hr

Right now, from live stock

Specifications Compared

SpecH200MI250X
TDP700W560W
VRAM141 GB128 GB
CUDA Cores16,896Not published
FP8 (dense)1,979 TFLOPSNot published
Memory TypeHBM3eHBM2e
ArchitectureHopperCDNA 2
FP16 (dense)989 TFLOPS383 TFLOPS
Form FactorsSXM, NVLOAM
INT8 (dense)1,979 TOPS383 TOPS
InterconnectNVLink, PCIe 5.0, InfiniBandInfinity Fabric, PCIe 4.0
Tensor Cores528Not published
FP32 Performance67 TFLOPS47.9 TFLOPS
FP64 Performance34 TFLOPS47.9 TFLOPS
Memory Bandwidth4,800 GB/s3,277 GB/s
FP8 (with sparsity)3,958 TFLOPSNot published
FP16 (with sparsity)1,979 TFLOPSNot published
INT8 (with sparsity)3,958 TOPSNot published

Performance Analysis

Dense FP16 throughput measures 989 TFLOPS on the H200 and 383 TFLOPS on the MI250X. This gap means the H200 can process larger matrix operations per second during training runs that rely on dense FP16 arithmetic. The MI250X delivers 383 TOPS in dense INT8 while the H200 reaches 1979 TOPS in dense INT8. Memory bandwidth of 4800 GB/s on the H200 versus 3277 GB/s on the MI250X allows the H200 to sustain larger batch sizes before memory stalls occur. FP32 figures of 67 TFLOPS and 47.9 TFLOPS indicate the H200 maintains an advantage in workloads that stay in single precision.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

H200

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
RunPodglobal1$5.29—Deploy
Vast.aiCzechia, CZ1$5.33—Deploy
VERDAFIN-HEL2$5.60$11.20Deploy
LyceumEurope2$6.19$12.38Deploy
LeaderGPUThe Netherlands1$6.22—Deploy

5 providers in stock, 8 offers (cheapest per provider shown). All H200 offers, price history and alerts

MI250X

MI250X is not offered on-demand by any provider we track right now. See the MI250X rental page for last-seen listed prices and a price alert.

Which GPU to watchWatch the price of

Notify me when H200 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $5.29/GPU-hr.

QuantaCloud

Comparing H-series providers? We broker across all of them.

Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the H200

The H200 suits scenarios that require 141 GB of VRAM and 4800 GB/s bandwidth together with 989 TFLOPS dense FP16. Users select it when dense FP16 or dense FP8 workloads exceed the 383 TFLOPS limit of the MI250X.

When to Choose the MI250X

The MI250X fits deployments where 560W TDP matters more than peak throughput. Its 128 GB VRAM and 3277 GB/s bandwidth remain adequate for workloads that stay below the 383 TFLOPS dense FP16 ceiling.

Use Cases

LLM Training
H200

The H200 supplies 989 TFLOPS dense FP16 and 141 GB VRAM while the MI250X supplies only 383 TFLOPS dense FP16 and 128 GB VRAM.

LLM Inference
H200

Dense FP16 performance of 989 TFLOPS on the H200 supports higher token throughput than the 383 TFLOPS dense FP16 on the MI250X.

Fine-tuning
H200

The 4800 GB/s bandwidth and 141 GB capacity of the H200 accommodate larger fine tuning batches than the 3277 GB/s and 128 GB of the MI250X.

Stable Diffusion
Either

Both cards handle the workload yet the H200 67 TFLOPS FP32 exceeds the MI250X 47.9 TFLOPS FP32.

Scientific Computing
H200

FP32 throughput of 67 TFLOPS on the H200 surpasses the 47.9 TFLOPS FP32 rating of the MI250X.

Frequently Asked Questions

What is the memory bandwidth difference?▾

The H200 reaches 4800 GB/s and the MI250X reaches 3277 GB/s.

Which GPU offers higher dense FP16 performance?▾

The H200 offers 989 TFLOPS dense FP16 while the MI250X offers 383 TFLOPS dense FP16.

How do the TDP ratings compare?▾

The H200 lists 700W TDP and the MI250X lists 560W TDP.

What FP32 numbers are published?▾

The H200 lists 67 TFLOPS FP32 and the MI250X lists 47.9 TFLOPS FP32.

Which is cheaper to rent, the H200 or the MI250X?▾

Cloud rental prices for both the H200 and MI250X vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the H200 have compared to the MI250X?▾

The H200 has 141 GB of HBM3e memory. The MI250X has 128 GB of HBM2e memory.

Can I find H200 and MI250X GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the H200 and the MI250X?▾

The H200 uses the Hopper architecture (2024) while the MI250X uses CDNA 2 (2021). The H200 delivers 2.6x the dense FP16 throughput (989 vs 383 TFLOPS, both without sparsity) and 1.5x the memory bandwidth of the MI250X.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the H200 and the MI250X. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps