Specifications Compared
| Spec | A40 | RTX A2000 |
|---|---|---|
| TDP | 300W | 70W |
| VRAM | 48 GB | 6-12 GB |
| CUDA Cores | 10,752 | 3,328 |
| Memory Type | GDDR6 | GDDR6 |
| Architecture | Ampere | Ampere |
| FP16 (dense) | 149.7 TFLOPS | Not published |
| Form Factors | PCIe | PCIe |
| INT8 (dense) | 299.3 TOPS | Not published |
| Interconnect | NVLink, PCIe 4.0 | PCIe 4.0 |
| Tensor Cores | 336 | 104 |
| FP32 Performance | 37.4 TFLOPS | 8 TFLOPS |
| Memory Bandwidth | 696 GB/s | 288 GB/s |
| FP16 (with sparsity) | 299.4 TFLOPS | 63.9 TFLOPS |
| INT8 (with sparsity) | 598.6 TOPS | Not published |
Performance Analysis
The A40 delivers 149.7 TFLOPS dense FP16 and 37.4 TFLOPS FP32 while the RTX A2000 lists 63.9 TFLOPS FP16 with sparsity and 8 TFLOPS FP32. The dense FP16 figure on the A40 exceeds the sparse FP16 figure on the RTX A2000 by more than double, which affects training throughput when sparsity cannot be applied. Memory bandwidth of 696 GB/s on the A40 versus 288 GB/s on the RTX A2000 permits larger batch sizes during inference or fine tuning before memory capacity becomes the limit. The A40 further lists 299.3 TOPS dense INT8 compared with no INT8 value published for the RTX A2000.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A40
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.52 | $4.13 | Deploy |
| RunPod | global | 1 | $0.59 | — | Deploy |
2 providers in stock, 2 offers. All A40 offers, price history and alerts
RTX A2000
RTX A2000 is not offered on-demand by any provider we track right now. See the RTX A2000 rental page for last-seen listed prices and a price alert.
Notify me when A40 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.52/GPU-hr.
QuantaCloud
Comparing providers? We broker across all of them.
Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.
When to Choose the A40
The A40 suits workloads that require 48 GB GDDR6 memory and 696 GB/s bandwidth together with NVLink connectivity. Scientific computing jobs that run at 37.4 TFLOPS FP32 benefit from the higher memory capacity and the 300 W TDP allowance for sustained operation.
When to Choose the RTX A2000
The RTX A2000 fits compact systems that operate within a 70 W TDP envelope and need only 6 to 12 GB GDDR6 memory. Inference tasks that tolerate 63.9 TFLOPS FP16 with sparsity and 8 TFLOPS FP32 can run efficiently on this lower power card.
Use Cases
The A40 supplies 48 GB memory and 149.7 TFLOPS dense FP16 that support larger models than the 6 to 12 GB and 63.9 TFLOPS sparse FP16 on the RTX A2000.
The A40 provides 696 GB/s bandwidth and 299.3 TOPS dense INT8 that allow higher throughput than the 288 GB/s and unpublished INT8 on the RTX A2000.
The A40 lists 48 GB memory and 299.4 TFLOPS FP16 with sparsity that accommodate larger batch sizes than the 12 GB maximum and 63.9 TFLOPS sparse FP16 on the RTX A2000.
The RTX A2000 operates at 70 W TDP and 8 TFLOPS FP32 which suffice for moderate resolution workloads while consuming less power than the 300 W TDP on the A40.
The A40 delivers 37.4 TFLOPS FP32 together with NVLink that benefit multi GPU scientific simulations beyond the 8 TFLOPS FP32 and PCIe 4.0 only on the RTX A2000.
Frequently Asked Questions
What is the memory bandwidth difference?▾
The A40 reaches 696 GB/s whereas the RTX A2000 reaches 288 GB/s.
Which GPU offers higher FP32 performance?▾
The A40 lists 37.4 TFLOPS FP32 compared with 8 TFLOPS FP32 on the RTX A2000.
Does the A40 support NVLink?▾
Yes the A40 includes NVLink while the RTX A2000 supports only PCIe 4.0.
What are the power requirements?▾
The A40 has a 300 W TDP and the RTX A2000 has a 70 W TDP.
How do FP16 figures compare?▾
The A40 lists 149.7 TFLOPS dense FP16 and 299.4 TFLOPS FP16 with sparsity while the RTX A2000 lists 63.9 TFLOPS FP16 with sparsity.
Which is cheaper to rent, the A40 or the RTX A2000?▾
Cloud rental prices for both the A40 and RTX A2000 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A40 have compared to the RTX A2000?▾
The A40 has 48 GB of GDDR6 memory. The RTX A2000 has 6 to 12 GB of GDDR6 memory.
Can I find A40 and RTX A2000 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A40 and the RTX A2000?▾
The A40 uses the Ampere architecture (2020) while the RTX A2000 uses Ampere (2021). The A40 has 48 GB of GDDR6 at 696 GB/s; the RTX A2000 has 6-12 GB of GDDR6 at 288 GB/s, so the A40 has 2.4x the memory bandwidth of the RTX A2000.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A40 and the RTX A2000. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A40Every current offer by provider, daily price history and a price alert.
- Rent RTX A2000Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.