GPU comparison

MI300X vs V100

Specifications and current cloud pricing, side by side.

CDNA 3vsVoltaUpdated 34 days ago

The MI300X wins for the most common use case of large scale model training. Its 192 GB VRAM, 5300 GB/s bandwidth, and 1307.4 TFLOPS dense FP16 exceed the V100 specifications by wide margins in every published metric.

MI300X listed from $0.95/GPU/hrV100 listed from $0.83/GPU/hr

Right now, from live stock

Specifications Compared

SpecMI300XV100
TDP750W300W
VRAM192 GB16-32 GB
CUDA CoresNot published5,120
FP8 (dense)2,614.9 TFLOPSNot published
Memory TypeHBM3HBM2
ArchitectureCDNA 3Volta
FP16 (dense)1,307.4 TFLOPS125 TFLOPS
Form FactorsOAMSXM2, PCIe
INT8 (dense)2,614.9 TOPSNot published
InterconnectInfinity Fabric, PCIe 5.0NVLink, PCIe 3.0
Tensor CoresNot published640
FP32 Performance163.4 TFLOPS15.7 TFLOPS
FP64 Performance81.7 TFLOPS7.8 TFLOPS
Memory Bandwidth5,300 GB/s900 GB/s
FP8 (with sparsity)5,229.8 TFLOPSNot published
FP16 (with sparsity)2,614.9 TFLOPSNot published
INT8 (with sparsity)5,229.8 TOPSNot published

Performance Analysis

Dense FP16 throughput on the MI300X measures 1307.4 TFLOPS while the V100 reaches 125 TFLOPS. This gap means the MI300X completes matrix operations more than ten times faster under identical dense conditions. FP32 figures follow the same pattern with 163.4 TFLOPS against 15.7 TFLOPS. Memory bandwidth of 5300 GB/s versus 900 GB/s permits substantially larger batch sizes before data movement becomes limiting. Sparse FP16 performance on the MI300X equals 2614.9 TFLOPS. The V100 publishes no sparse FP16 value so only dense to dense comparison applies. TDP ratings of 750 W and 300 W further separate sustained power envelopes.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

MI300X

MI300X is not offered on-demand by any provider we track right now. See the MI300X rental page for last-seen listed prices and a price alert.

V100

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Oribeauharnois1$0.83—Deploy
Paperspaceca11$2.30—Deploy

2 providers in stock, 72 offers (cheapest per provider shown). All V100 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when MI300X drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the MI300X

The MI300X suits workloads that require 192 GB HBM3 capacity and 5300 GB/s bandwidth. Large model training benefits directly from these numbers. Infinity Fabric interconnect supports scale out configurations that exceed PCIe 5.0 limits alone.

When to Choose the V100

The V100 fits environments already equipped with Volta compatible software stacks and SXM2 or PCIe form factors. Its 300 W TDP allows denser node packing where power budgets constrain 750 W devices. FP32 performance of 15.7 TFLOPS remains adequate for established scientific codes that do not demand newer precision formats.

Use Cases

LLM Training
MI300X

The MI300X supplies 192 GB VRAM and 1307.4 TFLOPS dense FP16 that accommodate models too large for the V100 32 GB maximum.

LLM Inference
MI300X

Higher memory bandwidth of 5300 GB/s and 2614.9 TFLOPS dense FP8 enable larger batch inference than the V100 can sustain.

Fine-tuning
MI300X

Dense FP16 performance of 1307.4 TFLOPS combined with 192 GB capacity reduces the need for model parallelism required on the V100.

Stable Diffusion
MI300X

The MI300X 5300 GB/s bandwidth supports higher resolution generation workloads beyond the V100 900 GB/s limit.

Scientific Computing
MI300X

FP32 throughput of 163.4 TFLOPS on the MI300X accelerates simulations compared with the V100 15.7 TFLOPS.

Frequently Asked Questions

What is the FP16 performance difference?▾

Dense FP16 reaches 1307.4 TFLOPS on the MI300X and 125 TFLOPS on the V100. Sparse FP16 on the MI300X reaches 2614.9 TFLOPS.

Which GPU has higher memory bandwidth?▾

The MI300X delivers 5300 GB/s. The V100 delivers 900 GB/s.

What power draw do the GPUs require?▾

The MI300X TDP equals 750 W. The V100 TDP equals 300 W.

Do both GPUs support the same interconnects?▾

The MI300X uses Infinity Fabric and PCIe 5.0. The V100 uses NVLink and PCIe 3.0.

Which is cheaper to rent, the MI300X or the V100?▾

Cloud rental prices for both the MI300X and V100 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the MI300X have compared to the V100?▾

The MI300X has 192 GB of HBM3 memory. The V100 has 16 to 32 GB of HBM2 memory.

Can I find MI300X and V100 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the MI300X and the V100?▾

The MI300X uses the CDNA 3 architecture (2023) while the V100 uses Volta (2017). The MI300X delivers 10.5x the dense FP16 throughput (1,307.4 vs 125 TFLOPS, both without sparsity) and 5.9x the memory bandwidth of the V100.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the MI300X and the V100. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps