GPU comparison

MI355X vs RTX 5090

Specifications and current cloud pricing, side by side.

CDNA 4vsBlackwellUpdated 42 days ago

The MI355X wins for the most common large model training and inference use case because its 288 GB memory capacity and 2500 TFLOPS FP16 dense rating exceed the RTX 5090 figures by wide margins while delivering the required bandwidth of 8000 GB/s.

MI355X listed from $2.59/GPU/hrRTX 5090 listed from $0.93/GPU/hr

Right now, from live stock

  • Cheapest right now: RTX 5090 at $0.93/hr on Vast.ai

    Deploy
  • Most providers in stock: RTX 5090 (3)

    See all offers

Specifications Compared

SpecMI355XRTX 5090
TDP1400W575W
VRAM288 GB32 GB
CUDA CoresNot published21,760
FP4 (dense)10,100 TFLOPS1,676 TFLOPS
FP8 (dense)5,000 TFLOPS419 TFLOPS
Memory TypeHBM3eGDDR7
ArchitectureCDNA 4Blackwell
FP16 (dense)2,500 TFLOPS209.5 TFLOPS
Form FactorsOAMPCIe
INT8 (dense)5,000 TOPS838 TOPS
InterconnectInfinity Fabric, PCIe 5.0PCIe 5.0
Tensor CoresNot published680
FP32 Performance157.3 TFLOPS104.8 TFLOPS
FP64 Performance78.6 TFLOPS1.6 TFLOPS
Memory Bandwidth8,000 GB/s1,792 GB/s
FP4 (with sparsity)Not published3,352 TFLOPS
FP8 (with sparsity)10,100 TFLOPS838 TFLOPS
FP16 (with sparsity)5,000 TFLOPS419 TFLOPS
INT8 (with sparsity)10,100 TOPS1,676 TOPS

Performance Analysis

The FP16 dense figure of 2500 TFLOPS on the MI355X versus 209.5 TFLOPS on the RTX 5090 indicates the MI355X can sustain substantially larger matrix operations during training and inference passes. When sparsity is applied the MI355X FP16 figure rises to 5000 TFLOPS against 419 TFLOPS on the RTX 5090 so the same ratio holds for sparse workloads. Memory bandwidth of 8000 GB/s on the MI355X compared with 1792 GB/s on the RTX 5090 permits batch sizes several times larger before data movement becomes the limiter. FP32 performance stands at 157.3 TFLOPS for the MI355X and 104.8 TFLOPS for the RTX 5090 so the MI355X maintains an advantage even in single precision kernels.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

MI355X

MI355X is not offered on-demand by any provider we track right now. See the MI355X rental page for last-seen listed prices and a price alert.

RTX 5090

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Vast.aiAlberta, CA1$0.93—Deploy
RunPodglobal1$1.19—Deploy
LeaderGPUThe Netherlands1$2.29—Deploy

3 providers in stock, 10 offers (cheapest per provider shown). All RTX 5090 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when MI355X drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the MI355X

The MI355X suits deployments that require 288 GB HBM3e capacity and 8000 GB/s bandwidth for models that exceed 32 GB footprints. Its 2500 TFLOPS FP16 dense rating and 5000 TFLOPS FP16 with sparsity rating support large scale training and inference where memory capacity directly limits throughput.

When to Choose the RTX 5090

The RTX 5090 fits environments constrained to 575W TDP and PCIe form factor cards. Its 209.5 TFLOPS FP16 dense rating and 419 TFLOPS FP16 with sparsity rating remain adequate for workloads that fit within 32 GB GDDR7 memory and do not require Infinity Fabric interconnect.

Use Cases

LLM Training
MI355X

The MI355X supplies 288 GB HBM3e memory and 2500 TFLOPS FP16 dense performance that accommodate models too large for 32 GB GDDR7.

LLM Inference
MI355X

The MI355X 8000 GB/s bandwidth and 5000 TFLOPS FP16 with sparsity rating sustain higher token throughput than the RTX 5090 1792 GB/s and 419 TFLOPS FP16 with sparsity rating.

Fine-tuning
MI355X

The MI355X 288 GB capacity permits fine tuning of models that exceed the 32 GB limit of the RTX 5090.

Stable Diffusion
RTX 5090

The RTX 5090 32 GB GDDR7 memory and 575W TDP suffice for typical diffusion workloads while fitting standard PCIe servers.

Scientific Computing
MI355X

The MI355X 157.3 TFLOPS FP32 rating and 8000 GB/s bandwidth accelerate memory bound scientific kernels beyond the RTX 5090 104.8 TFLOPS FP32 rating.

Frequently Asked Questions

What is the FP16 dense performance of each GPU?▾

The MI355X reaches 2500 TFLOPS FP16 dense and the RTX 5090 reaches 209.5 TFLOPS FP16 dense. These numbers determine raw throughput for dense matrix operations in training and inference.

Which GPU offers higher memory bandwidth?▾

The MI355X provides 8000 GB/s bandwidth compared with 1792 GB/s on the RTX 5090. Higher bandwidth supports larger batch sizes before memory stalls occur.

What TDP values are listed for the MI355X and RTX 5090?▾

The MI355X TDP is 1400W and the RTX 5090 TDP is 575W. Power delivery and cooling requirements therefore differ substantially between the two cards.

Does the MI355X support Infinity Fabric?▾

The MI355X lists Infinity Fabric interconnect in addition to PCIe 5.0 while the RTX 5090 lists only PCIe 5.0. Multi GPU scaling therefore follows different topologies on each platform.

Which is cheaper to rent, the MI355X or the RTX 5090?▾

Cloud rental prices for both the MI355X and RTX 5090 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the MI355X have compared to the RTX 5090?▾

The MI355X has 288 GB of HBM3e memory. The RTX 5090 has 32 GB of GDDR7 memory.

Can I find MI355X and RTX 5090 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the MI355X and the RTX 5090?▾

The MI355X uses the CDNA 4 architecture (2025) while the RTX 5090 uses Blackwell (2025). The MI355X delivers 11.9x the dense FP16 throughput (2,500 vs 209.5 TFLOPS, both without sparsity) and 4.5x the memory bandwidth of the RTX 5090.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the MI355X and the RTX 5090. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps