GPU comparison

MI300X vs RTX 2080

Specifications and current cloud pricing, side by side.

CDNA 3vsTuringUpdated 34 days ago

The MI300X wins for the most common use case of LLM training because its 192 GB HBM3 memory and 1307.4 TFLOPS dense FP16 exceed the RTX 2080 capabilities by wide margins while the 5300 GB/s bandwidth supports larger batches.

MI300X listed from $0.95/GPU/hrRTX 2080 listed from $0.12/GPU/hr

Specifications Compared

SpecMI300XRTX 2080
TDP750W215W
VRAM192 GB8-11 GB
CUDA CoresNot published2,944
FP8 (dense)2,614.9 TFLOPSNot published
Memory TypeHBM3GDDR6
ArchitectureCDNA 3Turing
FP16 (dense)1,307.4 TFLOPS40.3 TFLOPS
Form FactorsOAMPCIe
INT8 (dense)2,614.9 TOPS161.1 TOPS
InterconnectInfinity Fabric, PCIe 5.0NVLink, PCIe 3.0
Tensor CoresNot published368
FP32 Performance163.4 TFLOPS10 TFLOPS
FP64 Performance81.7 TFLOPSNot published
Memory Bandwidth5,300 GB/s448 GB/s
FP8 (with sparsity)5,229.8 TFLOPSNot published
FP16 (with sparsity)2,614.9 TFLOPSNot published
INT8 (with sparsity)5,229.8 TOPSNot published

Performance Analysis

The MI300X delivers 1307.4 TFLOPS dense FP16 compared with 40.3 TFLOPS dense FP16 on the RTX 2080 which produces a ratio of roughly thirty two times greater dense FP16 throughput on the MI300X. The same pattern holds for FP32 where the MI300X supplies 163.4 TFLOPS against 10 TFLOPS on the RTX 2080. Memory bandwidth of 5300 GB/s on the MI300X versus 448 GB/s on the RTX 2080 permits substantially larger batch sizes during training and inference workloads. The MI300X further provides 2614.9 TFLOPS FP16 with sparsity which has no counterpart listed for the RTX 2080. These differences translate into the MI300X handling larger models at higher throughput while the RTX 2080 remains constrained by its lower memory capacity and bandwidth.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

MI300X

MI300X is not offered on-demand by any provider we track right now. See the MI300X rental page for last-seen listed prices and a price alert.

RTX 2080

RTX 2080 is not offered on-demand by any provider we track right now. See the RTX 2080 rental page for last-seen listed prices and a price alert.

Which GPU to watchWatch the price of

Notify me when MI300X drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the MI300X

The MI300X suits workloads that require 192 GB HBM3 memory and 5300 GB/s bandwidth such as large scale LLM training or scientific computing that utilize 1307.4 TFLOPS dense FP16. Its 750W TDP and Infinity Fabric interconnect support sustained operation in data center environments where the 163.4 TFLOPS FP32 figure accelerates precision sensitive tasks.

When to Choose the RTX 2080

The RTX 2080 suits workloads that fit within 8 to 11 GB GDDR6 memory and operate at a 215W TDP such as smaller inference jobs or development tasks that utilize 40.3 TFLOPS dense FP16. Its PCIe form factor and 10 TFLOPS FP32 performance align with power limited or legacy system deployments.

Use Cases

LLM Training
MI300X

The MI300X supplies 192 GB HBM3 memory and 1307.4 TFLOPS dense FP16 which exceed the RTX 2080 limits for large model training.

LLM Inference
MI300X

The MI300X supplies 5300 GB/s bandwidth and 2614.9 TFLOPS FP16 with sparsity which support higher throughput inference than the RTX 2080 40.3 TFLOPS dense FP16.

Fine-tuning
MI300X

The MI300X supplies 163.4 TFLOPS FP32 and 192 GB memory which accommodate fine tuning of sizable models beyond the RTX 2080 8 to 11 GB capacity.

Stable Diffusion
RTX 2080

The RTX 2080 operates at 215W TDP with 40.3 TFLOPS dense FP16 which suffice for moderate image generation workloads within its 8 to 11 GB memory.

Scientific Computing
MI300X

The MI300X supplies 163.4 TFLOPS FP32 and 5300 GB/s bandwidth which accelerate compute intensive simulations beyond the RTX 2080 10 TFLOPS FP32.

Frequently Asked Questions

What is the memory difference between MI300X and RTX 2080?▾

The MI300X provides 192 GB HBM3 memory while the RTX 2080 provides between 8 and 11 GB GDDR6 memory. The MI300X also lists 5300 GB/s bandwidth against 448 GB/s on the RTX 2080.

How does FP16 performance compare on MI300X versus RTX 2080?▾

The MI300X reaches 1307.4 TFLOPS dense FP16 and 2614.9 TFLOPS FP16 with sparsity. The RTX 2080 reaches 40.3 TFLOPS dense FP16 with no sparsity figure published.

What TDP values apply to each GPU?▾

The MI300X lists a 750W TDP while the RTX 2080 lists a 215W TDP. These values influence power delivery requirements in deployment.

Which interconnects do the GPUs use?▾

The MI300X uses Infinity Fabric and PCIe 5.0 while the RTX 2080 uses NVLink and PCIe 3.0. The MI300X OAM form factor differs from the RTX 2080 PCIe form factor.

What FP32 performance do the GPUs deliver?▾

The MI300X delivers 163.4 TFLOPS FP32 while the RTX 2080 delivers 10 TFLOPS FP32. This gap affects precision sensitive scientific workloads.

How do INT8 figures compare?▾

The MI300X delivers 2614.9 TOPS INT8 dense and 5229.8 TOPS INT8 with sparsity. The RTX 2080 delivers 161.1 TOPS INT8 dense with no sparsity figure published.

Which is cheaper to rent, the MI300X or the RTX 2080?▾

Cloud rental prices for both the MI300X and RTX 2080 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the MI300X have compared to the RTX 2080?▾

The MI300X has 192 GB of HBM3 memory. The RTX 2080 has 8 to 11 GB of GDDR6 memory.

Can I find MI300X and RTX 2080 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the MI300X and the RTX 2080?▾

The MI300X uses the CDNA 3 architecture (2023) while the RTX 2080 uses Turing (2018). The MI300X delivers 32.4x the dense FP16 throughput (1,307.4 vs 40.3 TFLOPS, both without sparsity) and 11.8x the memory bandwidth of the RTX 2080.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the MI300X and the RTX 2080. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps