Specifications Compared
| Spec | H200 NVL | MI300X |
|---|---|---|
| TDP | 700W | 750W |
| VRAM | 141 GB | 192 GB |
| CUDA Cores | 16,896 | Not published |
| FP8 (dense) | 1,979 TFLOPS | 2,614.9 TFLOPS |
| Memory Type | HBM3e | HBM3 |
| Architecture | Hopper | CDNA 3 |
| FP16 (dense) | 989 TFLOPS | 1,307.4 TFLOPS |
| Form Factors | NVL (PCIe card, NVLink bridged) | OAM |
| INT8 (dense) | 1,979 TOPS | 2,614.9 TOPS |
| Interconnect | NVLink bridge, PCIe 5.0 | Infinity Fabric, PCIe 5.0 |
| Tensor Cores | 528 | Not published |
| FP32 Performance | 67 TFLOPS | 163.4 TFLOPS |
| FP64 Performance | 34 TFLOPS | 81.7 TFLOPS |
| Memory Bandwidth | 4,800 GB/s | 5,300 GB/s |
| FP8 (with sparsity) | 3,958 TFLOPS | 5,229.8 TFLOPS |
| FP16 (with sparsity) | 1,979 TFLOPS | 2,614.9 TFLOPS |
| INT8 (with sparsity) | 3,958 TOPS | 5,229.8 TOPS |
Performance Analysis
The MI300X variant delivers 1307.4 TFLOPS in dense FP16 while the H200 NVL variant reaches 989 TFLOPS in dense FP16 so the MI300X variant processes larger matrix operations per second during training workloads. In sparse FP16 the MI300X variant achieves 2614.9 TFLOPS against the H200 NVL variant at 1979 TFLOPS allowing the MI300X variant to accelerate pruned models more effectively. Memory bandwidth stands at 5300 GB/s for the MI300X variant compared with 4800 GB/s for the H200 NVL variant which permits the MI300X variant to sustain larger batch sizes in memory bound inference tasks. The MI300X variant also records 163.4 TFLOPS in FP32 against 67 TFLOPS for the H200 NVL variant giving it an advantage in precision sensitive scientific kernels.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
H200 NVL
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| RunPod | global | 1 | $3.79 | — | Deploy |
| DigitalOcean | Atlanta 1 | 1 | $4.47 | — | Deploy |
| Vast.ai | Czechia, CZ | 1 | $4.65 | — | Deploy |
| VERDA | FIN-HEL | 8 | $5.71 | $45.72 | Deploy |
| Lyceum | Europe | 8 | $6.19 | $49.52 | Deploy |
6 providers in stock, 8 offers (cheapest per provider shown). All H200 NVL offers, price history and alerts
MI300X
1 provider in stock, 1 offer. All MI300X offers, price history and alerts
Notify me when H200 NVL drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $3.79/GPU-hr.
QuantaCloud
Comparing H-series providers? We broker across all of them.
Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.
When to Choose the H200 NVL
The H200 NVL variant suits environments that require NVLink bridge connectivity for tight multi GPU coupling at 700 W TDP. Its 141 GB HBM3e capacity fits deployments already optimized for Hopper ecosystem tools where lower power draw reduces cooling demands.
When to Choose the MI300X
The MI300X variant fits workloads that need 192 GB HBM3 capacity and 5300 GB/s bandwidth to handle larger models without frequent offloading. Its 163.4 TFLOPS FP32 rating supports compute heavy scientific computing at the cost of 750 W TDP.
Use Cases
The MI300X variant supplies 192 GB memory and 1307.4 dense FP16 TFLOPS which exceed the H200 NVL variant numbers for handling large parameter counts.
The MI300X variant offers 5300 GB/s bandwidth and 2614.9 dense FP8 TFLOPS allowing higher throughput on long context sequences than the H200 NVL variant.
Both variants provide sufficient memory capacity and tensor performance with the H200 NVL variant at 989 dense FP16 TFLOPS and the MI300X variant at 1307.4 dense FP16 TFLOPS.
The MI300X variant 192 GB capacity and 5300 GB/s bandwidth accommodate high resolution image batches better than the H200 NVL variant 141 GB setup.
The MI300X variant records 163.4 FP32 TFLOPS which surpasses the H200 NVL variant 67 FP32 TFLOPS for double precision heavy simulations.
Frequently Asked Questions
How do the memory bandwidth figures compare?▾
The MI300X variant reaches 5300 GB/s and the H200 NVL variant reaches 4800 GB/s.
What are the dense FP16 ratings for each variant?▾
The H200 NVL variant lists 989 TFLOPS dense FP16 and the MI300X variant lists 1307.4 TFLOPS dense FP16.
Which variant has the lower TDP rating?▾
The H200 NVL variant operates at 700 W TDP while the MI300X variant operates at 750 W TDP.
What interconnect does the H200 NVL variant use?▾
The H200 NVL variant uses NVLink bridge together with PCIe 5.0.
What form factor does the MI300X variant follow?▾
The MI300X variant follows the OAM form factor with Infinity Fabric support.
Which is cheaper to rent, the H200 NVL or the MI300X?▾
Cloud rental prices for both the H200 NVL and MI300X vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the H200 NVL have compared to the MI300X?▾
The H200 NVL has 141 GB of HBM3e memory. The MI300X has 192 GB of HBM3 memory.
Can I find H200 NVL and MI300X GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the H200 NVL and the MI300X?▾
The H200 NVL uses the Hopper architecture (2024) while the MI300X uses CDNA 3 (2023). The MI300X delivers 1.3x the dense FP16 throughput (1,307.4 vs 989 TFLOPS, both without sparsity) and 1.1x the memory bandwidth of the H200 NVL.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the H200 NVL and the MI300X. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent H200Every current offer by provider, daily price history and a price alert.
- Rent MI300XEvery current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.