GPU comparison

H100 SXM5 vs MI300X

Specifications and current cloud pricing, side by side.

HoppervsCDNA 3Updated 64 days ago

This variant comparison is part of the MI300X vs H100 family comparison.

The MI300X variant provides the stronger option for the most common large model workloads because its 192 GB memory capacity and 5300 GB/s bandwidth exceed the H100 SXM5 variant capabilities in dense FP16 and FP32 metrics.

H100 SXM5 from $2.59/GPU/hrMI300X from $3.39/GPU/hr

Right now, from live stock

  • Cheapest right now: H100 SXM5 at $2.59/hr on QuantaCloud

    Deploy
  • Most providers in stock: H100 SXM5 (11)

    See all offers
  • Best $ per TFLOPS FP16 dense right now: MI300X ($0.0026 per TFLOPS-hour at 1,307.4 TFLOPS)

    Deploy

Specifications Compared

SpecH100 SXM5MI300X
TDP700W750W
VRAM80 GB192 GB
CUDA Cores16,896Not published
FP8 (dense)1,979 TFLOPS2,614.9 TFLOPS
Memory TypeHBM3HBM3
ArchitectureHopperCDNA 3
FP16 (dense)989 TFLOPS1,307.4 TFLOPS
Form FactorsSXM5OAM
INT8 (dense)1,979 TOPS2,614.9 TOPS
InterconnectNVLink, PCIe 5.0, InfiniBandInfinity Fabric, PCIe 5.0
Tensor Cores528Not published
FP32 Performance67 TFLOPS163.4 TFLOPS
FP64 Performance34 TFLOPS81.7 TFLOPS
Memory Bandwidth3,350 GB/s5,300 GB/s
FP8 (with sparsity)3,958 TFLOPS5,229.8 TFLOPS
FP16 (with sparsity)1,979 TFLOPS2,614.9 TFLOPS
INT8 (with sparsity)3,958 TOPS5,229.8 TOPS

Performance Analysis

The MI300X delivers 1307.4 TFLOPS in dense FP16 compared to the 989 TFLOPS dense FP16 of the H100 SXM5 family while both figures represent shared family performance values. In FP32 the MI300X reaches 163.4 TFLOPS against the 67 TFLOPS of the H100 SXM5 family and the MI300X memory bandwidth of 5300 GB/s exceeds the 3350 GB/s of the H100 SXM5 family. Such differences allow the MI300X to handle larger batch sizes in training scenarios that rely on dense FP16 operations and the H100 SXM5 maintains competitive results when sparsity modes are applied at 1979 TFLOPS dense FP16 equivalent scales.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

H100 SXM5

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
QuantaCloudus-midwest-22$2.59$5.18Deploy
Massed Computeus-central-32$2.73$5.46Deploy
Oridallas-24$2.90$11.60Deploy
ScalewayParis, France (PAR2)1$3.15—Deploy
RunPodglobal1$3.19—Deploy

11 providers in stock, 28 offers (cheapest per provider shown). All H100 SXM5 offers, price history and alerts

MI300X

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Hot AisleMichigan8$3.39$27.12Deploy

1 provider in stock, 1 offer. All MI300X offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when H100 SXM5 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $2.59/GPU-hr.

QuantaCloud

Comparing H-series providers? We broker across all of them.

Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the H100 SXM5

The H100 SXM5 variant suits environments that require NVLink connectivity and an SXM5 form factor for integration with existing NVIDIA based clusters. Its 700W TDP also aligns with systems optimized for lower power draw during sustained FP8 dense operations at 1979 TFLOPS.

When to Choose the MI300X

The MI300X variant fits deployments that demand 192 GB HBM3 memory capacity and Infinity Fabric links for scaling memory intensive models. Its 5300 GB/s bandwidth supports larger working sets in FP16 dense computations at 1307.4 TFLOPS.

Use Cases

LLM Training
MI300X

The MI300X 192 GB capacity accommodates larger models without partitioning.

LLM Inference
MI300X

Higher 5300 GB/s bandwidth enables larger batch inference at 1307.4 TFLOPS dense FP16.

Fine-tuning
MI300X

192 GB memory supports extended context lengths during fine tuning runs.

Stable Diffusion
H100 SXM5

The H100 SXM5 NVLink interconnect aids multi GPU image generation pipelines.

Scientific Computing
MI300X

163.4 TFLOPS FP32 performance accelerates simulation workloads on the MI300X.

Frequently Asked Questions

What memory capacities distinguish the H100 SXM5 from the MI300X?▾

The H100 SXM5 variant holds 80 GB HBM3 while the MI300X variant holds 192 GB HBM3. Both values represent the specific variant configurations rather than family ranges.

How do the FP16 dense figures compare between these GPUs?▾

The H100 SXM5 family reports 989 TFLOPS dense FP16 and the MI300X family reports 1307.4 TFLOPS dense FP16. These numbers apply across all variants within each family.

Which GPU offers higher memory bandwidth?▾

The MI300X family provides 5300 GB/s bandwidth compared to 3350 GB/s for the H100 SXM5 family. Bandwidth remains consistent for every variant in each family.

What form factors apply to the H100 SXM5 and MI300X variants?▾

The H100 SXM5 uses the SXM5 form factor while the MI300X uses the OAM form factor. These details belong to the specific variants under comparison.

Do the interconnect options differ between the two variants?▾

The H100 SXM5 supports NVLink while the MI300X supports Infinity Fabric. Both variants also include PCIe 5.0 connectivity.

Which is cheaper to rent, the H100 SXM5 or the MI300X?▾

Cloud rental prices for both the H100 SXM5 and MI300X vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the H100 SXM5 have compared to the MI300X?▾

The H100 SXM5 has 80 GB of HBM3 memory. The MI300X has 192 GB of HBM3 memory.

Can I find H100 SXM5 and MI300X GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the H100 SXM5 and the MI300X?▾

The H100 SXM5 uses the Hopper architecture (2022) while the MI300X uses CDNA 3 (2023). The MI300X delivers 1.3x the dense FP16 throughput (1,307.4 vs 989 TFLOPS, both without sparsity) and 1.6x the memory bandwidth of the H100 SXM5.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the H100 SXM5 and the MI300X. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps