GPU comparison

RTX 5090 vs RTX A6000

Specifications and current cloud pricing, side by side.

BlackwellvsAmpereUpdated 17 days ago

The RTX 5090 wins for the most common use case of LLM inference because its 209.5 TFLOPS dense FP16 exceeds the 154.8 TFLOPS dense FP16 of the RTX A6000 while its 1792 GB/s bandwidth exceeds the 768 GB/s bandwidth of the RTX A6000.

RTX 5090 from $0.53/GPU/hrRTX A6000 from $0.44/GPU/hr

Right now, from live stock

  • Cheapest right now: RTX A6000 at $0.44/hr on LeaderGPU

    Deploy
  • Most providers in stock: RTX A6000 (7)

    See all offers
  • Best $ per TFLOPS FP16 dense right now: RTX 5090 ($0.0025 per TFLOPS-hour at 209.5 TFLOPS)

    Deploy

Specifications Compared

SpecRTX 5090RTX A6000
TDP575W300W
VRAM32 GB48 GB
CUDA Cores21,76010,752
FP4 (dense)1,676 TFLOPSNot published
FP8 (dense)419 TFLOPSNot published
Memory TypeGDDR7GDDR6
ArchitectureBlackwellAmpere
FP16 (dense)209.5 TFLOPS154.8 TFLOPS
Form FactorsPCIePCIe
INT8 (dense)838 TOPS309.7 TOPS
InterconnectPCIe 5.0NVLink, PCIe 4.0
Tensor Cores680336
FP32 Performance104.8 TFLOPS38.7 TFLOPS
FP64 Performance1.6 TFLOPSNot published
Memory Bandwidth1,792 GB/s768 GB/s
FP4 (with sparsity)3,352 TFLOPSNot published
FP8 (with sparsity)838 TFLOPSNot published
FP16 (with sparsity)419 TFLOPS309.6 TFLOPS
INT8 (with sparsity)1,676 TOPS619.4 TOPS

Performance Analysis

The RTX 5090 records 209.5 TFLOPS dense FP16 compared with the RTX A6000 recording 154.8 TFLOPS dense FP16. The RTX 5090 records 104.8 TFLOPS FP32 compared with the RTX A6000 recording 38.7 TFLOPS FP32. This dense FP16 to dense FP16 ratio indicates greater throughput for matrix operations on the RTX 5090 during training and inference steps. The RTX 5090 records 1792 GB/s memory bandwidth compared with the RTX A6000 recording 768 GB/s memory bandwidth. Higher bandwidth on the RTX 5090 supports larger batch sizes before memory capacity becomes the limiting factor. The RTX 5090 records 419 TFLOPS FP16 with sparsity compared with the RTX A6000 recording 309.6 TFLOPS FP16 with sparsity.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

RTX 5090

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Vast.aiSouth Korea, KR1$0.53—Deploy
LeaderGPUThe Netherlands1$2.29—Deploy

2 providers in stock, 11 offers (cheapest per provider shown). All RTX 5090 offers, price history and alerts

RTX A6000

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
LeaderGPUThe Netherlands8$0.44$3.54Deploy
QuantaCloudus-midwest-21$0.48—Deploy
HyperstackCANADA-11$0.50—Deploy
RunPodglobal1$0.53—Deploy
Massed Computeus-central-24$0.55$2.20Deploy

7 providers in stock, 56 offers (cheapest per provider shown). All RTX A6000 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when RTX 5090 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.53/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the RTX 5090

The RTX 5090 suits workloads that prioritize arithmetic throughput over memory capacity. Its 209.5 TFLOPS dense FP16 and 1792 GB/s bandwidth enable faster execution of dense matrix multiplications than the 154.8 TFLOPS dense FP16 and 768 GB/s bandwidth of the RTX A6000. Applications that fit within 32 GB VRAM benefit from these higher figures.

When to Choose the RTX A6000

The RTX A6000 suits workloads that require larger memory capacity at lower power draw. Its 48 GB GDDR6 memory exceeds the 32 GB GDDR7 memory of the RTX 5090 while its 300W TDP remains below the 575W TDP of the RTX 5090. Tasks that scale with additional VRAM rather than peak throughput select the RTX A6000.

Use Cases

LLM Training
RTX 5090

The RTX 5090 supplies 209.5 TFLOPS dense FP16 against the 154.8 TFLOPS dense FP16 of the RTX A6000.

LLM Inference
RTX 5090

The RTX 5090 supplies 209.5 TFLOPS dense FP16 and 1792 GB/s bandwidth against the 154.8 TFLOPS dense FP16 and 768 GB/s bandwidth of the RTX A6000.

Fine-tuning
Either

The RTX 5090 supplies higher dense FP16 throughput while the RTX A6000 supplies 48 GB memory versus 32 GB.

Stable Diffusion
RTX 5090

The RTX 5090 supplies 209.5 TFLOPS dense FP16 against the 154.8 TFLOPS dense FP16 of the RTX A6000.

Scientific Computing
RTX A6000

The RTX A6000 supplies 48 GB memory and 300W TDP against the 32 GB memory and 575W TDP of the RTX 5090.

Frequently Asked Questions

What dense FP16 performance does the RTX 5090 list compared with the RTX A6000?▾

The RTX 5090 lists 209.5 TFLOPS dense FP16. The RTX A6000 lists 154.8 TFLOPS dense FP16.

How does memory bandwidth differ between the RTX 5090 and the RTX A6000?▾

The RTX 5090 lists 1792 GB/s memory bandwidth. The RTX A6000 lists 768 GB/s memory bandwidth.

What FP32 performance does each GPU list?▾

The RTX 5090 lists 104.8 TFLOPS FP32. The RTX A6000 lists 38.7 TFLOPS FP32.

What TDP values appear for each card?▾

The RTX 5090 lists a TDP of 575W. The RTX A6000 lists a TDP of 300W.

How does dense INT8 performance compare?▾

The RTX 5090 lists 838 TOPS dense INT8. The RTX A6000 lists 309.7 TOPS dense INT8.

Which is cheaper to rent, the RTX 5090 or the RTX A6000?▾

Cloud rental prices for both the RTX 5090 and RTX A6000 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the RTX 5090 have compared to the RTX A6000?▾

The RTX 5090 has 32 GB of GDDR7 memory. The RTX A6000 has 48 GB of GDDR6 memory.

Can I find RTX 5090 and RTX A6000 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the RTX 5090 and the RTX A6000?▾

The RTX 5090 uses the Blackwell architecture (2025) while the RTX A6000 uses Ampere (2020). The RTX 5090 delivers 1.4x the dense FP16 throughput (209.5 vs 154.8 TFLOPS, both without sparsity) and 2.3x the memory bandwidth of the RTX A6000.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the RTX 5090 and the RTX A6000. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps