GPU comparison

A40 vs Quadro RTX 8000

Specifications and current cloud pricing, side by side.

AmperevsTuringUpdated 32 days ago

The A40 wins for the most common training and inference use case because its 37.4 TFLOPS FP32 and 149.7 TFLOPS dense FP16 exceed the corresponding 16.3 TFLOPS and 130.5 TFLOPS values while maintaining identical 48 GB memory capacity.

A40 listed from $0.52/GPU/hr

Right now, from live stock

Specifications Compared

SpecA40Quadro RTX 8000
TDP300W260W
VRAM48 GB48 GB
CUDA Cores10,7524,608
Memory TypeGDDR6GDDR6
ArchitectureAmpereTuring
FP16 (dense)149.7 TFLOPS130.5 TFLOPS
Form FactorsPCIePCIe
INT8 (dense)299.3 TOPSNot published
InterconnectNVLink, PCIe 4.0NVLink, PCIe 3.0
Tensor Cores336576
FP32 Performance37.4 TFLOPS16.3 TFLOPS
Memory Bandwidth696 GB/s672 GB/s
FP16 (with sparsity)299.4 TFLOPSNot published
INT8 (with sparsity)598.6 TOPSNot published

Performance Analysis

The A40 delivers FP16 dense performance of 149.7 TFLOPS against the Quadro RTX 8000 FP16 dense performance of 130.5 TFLOPS, producing a ratio of 149.7 to 130.5. This difference translates into faster matrix operations during training and inference workloads that rely on dense FP16 computation. The A40 FP32 figure of 37.4 TFLOPS compared with 16.3 TFLOPS likewise supports larger batch sizes when memory bandwidth of 696 GB/s exceeds 672 GB/s. When sparsity is enabled the A40 reaches FP16 with sparsity of 299.4 TFLOPS while the Quadro RTX 8000 figure remains unavailable for direct comparison.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

A40

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
LeaderGPUThe Netherlands8$0.52$4.13Deploy

1 provider in stock, 1 offer. All A40 offers, price history and alerts

Quadro RTX 8000

Quadro RTX 8000 is not offered on-demand by any provider we track right now. See the Quadro RTX 8000 rental page for last-seen listed prices and a price alert.

Which GPU to watchWatch the price of

Notify me when A40 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.52/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the A40

The A40 suits workloads that require the higher FP32 performance of 37.4 TFLOPS and the denser INT8 dense rating of 299.3 TOPS. Its 696 GB/s memory bandwidth further supports larger batch processing than the 672 GB/s alternative in sustained Ampere based pipelines.

When to Choose the Quadro RTX 8000

The Quadro RTX 8000 fits environments constrained by the 260W TDP limit where the 300W rating of the A40 exceeds power budgets. Its Turing architecture still supplies 48 GB GDDR6 memory and 130.5 TFLOPS dense FP16 for lighter inference tasks.

Use Cases

LLM Training
A40

The A40 supplies 149.7 TFLOPS dense FP16 and 37.4 TFLOPS FP32 which exceed the Quadro RTX 8000 values of 130.5 TFLOPS and 16.3 TFLOPS.

LLM Inference
A40

The A40 INT8 dense rating of 299.3 TOPS combined with 696 GB/s bandwidth enables larger batch inference than the Quadro RTX 8000 specifications allow.

Fine-tuning
A40

FP16 dense performance of 149.7 TFLOPS on the A40 supports fine-tuning throughput beyond the 130.5 TFLOPS dense FP16 of the Quadro RTX 8000.

Stable Diffusion
Either

Both GPUs provide 48 GB GDDR6 memory so either card handles diffusion workloads with the A40 offering higher 149.7 TFLOPS dense FP16.

Scientific Computing
A40

The A40 FP32 rating of 37.4 TFLOPS surpasses the 16.3 TFLOPS of the Quadro RTX 8000 for compute intensive scientific kernels.

Frequently Asked Questions

What is the FP32 performance difference between A40 and Quadro RTX 8000?▾

The A40 reaches 37.4 TFLOPS FP32 while the Quadro RTX 8000 reaches 16.3 TFLOPS FP32. This gap favors the A40 for single precision workloads.

How does memory bandwidth compare on the A40 versus the Quadro RTX 8000?▾

The A40 provides 696 GB/s memory bandwidth whereas the Quadro RTX 8000 provides 672 GB/s. The higher figure on the A40 supports larger data movement per second.

Which GPU offers higher dense FP16 performance?▾

The A40 lists 149.7 TFLOPS dense FP16 compared with 130.5 TFLOPS dense FP16 on the Quadro RTX 8000. The A40 therefore leads in dense half precision throughput.

What are the TDP values for each card?▾

The A40 carries a 300W TDP rating and the Quadro RTX 8000 carries a 260W TDP rating. Power limited deployments may prefer the lower figure.

Do both GPUs support NVLink?▾

Both the A40 and the Quadro RTX 8000 include NVLink interconnect support. The A40 pairs this with PCIe 4.0 while the Quadro RTX 8000 uses PCIe 3.0.

Which architecture is newer?▾

The A40 uses Ampere architecture released in 2020 while the Quadro RTX 8000 uses Turing architecture released in 2018.

Which is cheaper to rent, the A40 or the Quadro RTX 8000?▾

Cloud rental prices for both the A40 and Quadro RTX 8000 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the A40 have compared to the Quadro RTX 8000?▾

The A40 has 48 GB of GDDR6 memory. The Quadro RTX 8000 has 48 GB of GDDR6 memory.

Can I find A40 and Quadro RTX 8000 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the A40 and the Quadro RTX 8000?▾

The A40 uses the Ampere architecture (2020) while the Quadro RTX 8000 uses Turing (2018). The A40 delivers 1.1x the dense FP16 throughput (149.7 vs 130.5 TFLOPS, both without sparsity) and the same memory bandwidth as the Quadro RTX 8000.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the A40 and the Quadro RTX 8000. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps