Specifications Compared
| Spec | A40 | RTX A4000 |
|---|---|---|
| TDP | 300W | 140W |
| VRAM | 48 GB | 16-20 GB |
| CUDA Cores | 10,752 | 6,144 |
| Memory Type | GDDR6 | GDDR6 |
| Architecture | Ampere | Ampere |
| FP16 (dense) | 149.7 TFLOPS | Not published |
| Form Factors | PCIe | PCIe |
| INT8 (dense) | 299.3 TOPS | Not published |
| Interconnect | NVLink, PCIe 4.0 | PCIe 4.0 |
| Tensor Cores | 336 | 192 |
| FP32 Performance | 37.4 TFLOPS | 19.2 TFLOPS |
| Memory Bandwidth | 696 GB/s | 448 GB/s |
| FP16 (with sparsity) | 299.4 TFLOPS | 153.4 TFLOPS |
| INT8 (with sparsity) | 598.6 TOPS | Not published |
Performance Analysis
Sparse FP16 performance on the A40 reaches 299.4 TFLOPS. This value nearly doubles the 153.4 TFLOPS with sparsity on the RTX A4000. Dense FP16 on the A40 measures 149.7 TFLOPS with no corresponding dense figure published for the RTX A4000. The FP32 advantage of the A40 stands at 37.4 TFLOPS against 19.2 TFLOPS on the RTX A4000. Higher memory bandwidth of 696 GB/s versus 448 GB/s on the A40 supports larger batch sizes during both training and inference operations. The 300 W TDP of the A40 compared with 140 W on the RTX A4000 reflects the greater computational capacity available for sustained workloads.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A40
1 provider in stock, 1 offer. All A40 offers, price history and alerts
RTX A4000
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| Hyperstack | NORWAY-1 | 1 | $0.15 | — | Deploy |
| Paperspace | ny2 | 2 | $0.76 | $1.52 | Deploy |
2 providers in stock, 7 offers (cheapest per provider shown). All RTX A4000 offers, price history and alerts
Notify me when A40 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.52/GPU-hr.
QuantaCloud
Comparing providers? We broker across all of them.
Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.
When to Choose the A40
The A40 suits scenarios that require 48 GB VRAM for large model training or inference tasks. Its 696 GB/s bandwidth and 299.4 TFLOPS sparse FP16 enable bigger batch processing than the RTX A4000. NVLink support further aids multi GPU scaling in scientific computing applications.
When to Choose the RTX A4000
The RTX A4000 fits workloads where 140 W TDP and PCIe only interconnect suffice for smaller models. Its 19.2 TFLOPS FP32 handles moderate inference or fine tuning jobs with 16 to 20 GB VRAM without excess power draw.
Use Cases
The A40 supplies 48 GB VRAM and 299.4 TFLOPS sparse FP16 to accommodate larger models than the RTX A4000.
Higher 696 GB/s bandwidth and 37.4 TFLOPS FP32 on the A40 support increased throughput for demanding inference.
Both cards handle fine tuning with their Ampere architecture though the A40 processes larger batches via 48 GB VRAM.
The RTX A4000 meets requirements for Stable Diffusion at 140 W TDP with 16 to 20 GB VRAM sufficient for typical image generation.
NVLink and 299.4 TFLOPS sparse FP16 on the A40 accelerate scientific workloads beyond the RTX A4000 capabilities.
Frequently Asked Questions
What FP32 performance do the A40 and RTX A4000 deliver?▾
The A40 achieves 37.4 TFLOPS FP32. The RTX A4000 reaches 19.2 TFLOPS FP32. The ratio favors the A40 by nearly two times.
How does memory bandwidth compare on these GPUs?▾
The A40 lists 696 GB/s bandwidth. The RTX A4000 lists 448 GB/s bandwidth. Larger batches become feasible on the higher bandwidth card.
Which GPU has higher sparse FP16 performance?▾
The A40 reaches 299.4 TFLOPS with sparsity in FP16. The RTX A4000 reaches 153.4 TFLOPS with sparsity in FP16. The A40 holds a clear lead.
Do both GPUs support the same interconnect options?▾
The A40 includes NVLink alongside PCIe 4.0. The RTX A4000 supports only PCIe 4.0. Multi GPU scaling differs accordingly.
What TDP ratings apply to the A40 versus RTX A4000?▾
The A40 carries a 300 W TDP. The RTX A4000 carries a 140 W TDP. Power consumption varies by more than double between the two.
Which is cheaper to rent, the A40 or the RTX A4000?▾
Cloud rental prices for both the A40 and RTX A4000 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A40 have compared to the RTX A4000?▾
The A40 has 48 GB of GDDR6 memory. The RTX A4000 has 16 to 20 GB of GDDR6 memory.
Can I find A40 and RTX A4000 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A40 and the RTX A4000?▾
The A40 uses the Ampere architecture (2020) while the RTX A4000 uses Ampere (2021). The A40 has 48 GB of GDDR6 at 696 GB/s; the RTX A4000 has 16-20 GB of GDDR6 at 448 GB/s, so the A40 has 1.6x the memory bandwidth of the RTX A4000.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A40 and the RTX A4000. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A40Every current offer by provider, daily price history and a price alert.
- Rent RTX A4000Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.