Specifications Compared
| Spec | A40 | RTX 4090 |
|---|---|---|
| TDP | 300W | 450W |
| VRAM | 48 GB | 24 GB |
| CUDA Cores | 10,752 | 16,384 |
| FP8 (dense) | Not published | 330.3 TFLOPS |
| Memory Type | GDDR6 | GDDR6X |
| Architecture | Ampere | Ada Lovelace |
| FP16 (dense) | 149.7 TFLOPS | 165.2 TFLOPS |
| Form Factors | PCIe | PCIe |
| INT8 (dense) | 299.3 TOPS | 660.6 TOPS |
| Interconnect | NVLink, PCIe 4.0 | PCIe 4.0 |
| Tensor Cores | 336 | 512 |
| FP32 Performance | 37.4 TFLOPS | 82.6 TFLOPS |
| FP64 Performance | Not published | 1.3 TFLOPS |
| Memory Bandwidth | 696 GB/s | 1,008 GB/s |
| FP8 (with sparsity) | Not published | 660.6 TFLOPS |
| FP16 (with sparsity) | 299.4 TFLOPS | 330.4 TFLOPS |
| INT8 (with sparsity) | 598.6 TOPS | 1,321.2 TOPS |
Performance Analysis
The RTX 4090 delivers 82.6 TFLOPS FP32 compared to the A40 at 37.4 TFLOPS FP32 which means the RTX 4090 supports faster single precision operations in training and inference pipelines. The A40 FP16 dense performance reaches 149.7 TFLOPS while the RTX 4090 FP16 dense performance reaches 165.2 TFLOPS so the RTX 4090 holds a modest advantage in dense FP16 workloads. Memory bandwidth of 1008 GB/s on the RTX 4090 versus 696 GB/s on the A40 allows larger batch sizes in memory bound operations when both GPUs run dense FP16 or dense INT8 workloads.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A40
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.52 | $4.13 | Deploy |
| RunPod | global | 1 | $0.59 | — | Deploy |
2 providers in stock, 2 offers. All A40 offers, price history and alerts
Notify me when A40 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.52/GPU-hr.
QuantaCloud
Comparing providers? We broker across all of them.
Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.
When to Choose the A40
The A40 GPU suits scenarios that require 48 GB GDDR6 memory and NVLink interconnect for multi GPU scaling. Its 300W TDP also fits deployments where power limits constrain hardware selection over the 450W TDP of the RTX 4090.
When to Choose the RTX 4090
The RTX 4090 GPU suits scenarios that require 82.6 TFLOPS FP32 and 1008 GB/s memory bandwidth for single GPU acceleration. Its 165.2 TFLOPS FP16 dense rating exceeds the A40 149.7 TFLOPS FP16 dense rating in precision heavy tasks.
Use Cases
The RTX 4090 supplies 82.6 TFLOPS FP32 and 165.2 TFLOPS FP16 dense which exceed the A40 figures of 37.4 TFLOPS FP32 and 149.7 TFLOPS FP16 dense.
The RTX 4090 supplies 165.2 TFLOPS FP16 dense and 1008 GB/s bandwidth which support faster inference throughput than the A40 149.7 TFLOPS FP16 dense and 696 GB/s bandwidth.
The A40 supplies 48 GB GDDR6 memory which accommodates larger model states than the 24 GB GDDR6X memory on the RTX 4090.
The RTX 4090 supplies 165.2 TFLOPS FP16 dense and 1008 GB/s bandwidth which accelerate image generation steps compared to the A40 149.7 TFLOPS FP16 dense and 696 GB/s bandwidth.
The A40 supplies NVLink interconnect and 48 GB GDDR6 memory which enable distributed scientific simulations beyond the PCIe only RTX 4090.
Frequently Asked Questions
What are the FP32 ratings for the A40 and RTX 4090?▾
The A40 delivers 37.4 TFLOPS FP32 and the RTX 4090 delivers 82.6 TFLOPS FP32.
Which GPU has higher memory bandwidth?▾
The RTX 4090 has 1008 GB/s memory bandwidth while the A40 has 696 GB/s memory bandwidth.
Does the A40 support NVLink?▾
The A40 supports NVLink interconnect while the RTX 4090 supports only PCIe 4.0 interconnect.
What are the dense FP16 figures for both GPUs?▾
The A40 reaches 149.7 TFLOPS FP16 dense and the RTX 4090 reaches 165.2 TFLOPS FP16 dense.
How do the TDP values compare?▾
The A40 has a 300W TDP and the RTX 4090 has a 450W TDP.
Which is cheaper to rent, the A40 or the RTX 4090?▾
Cloud rental prices for both the A40 and RTX 4090 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A40 have compared to the RTX 4090?▾
The A40 has 48 GB of GDDR6 memory. The RTX 4090 has 24 GB of GDDR6X memory.
Can I find A40 and RTX 4090 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A40 and the RTX 4090?▾
The A40 uses the Ampere architecture (2020) while the RTX 4090 uses Ada Lovelace (2022). The RTX 4090 delivers 1.1x the dense FP16 throughput (165.2 vs 149.7 TFLOPS, both without sparsity) and 1.4x the memory bandwidth of the A40.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A40 and the RTX 4090. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A40Every current offer by provider, daily price history and a price alert.
- Rent RTX 4090Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.