Specifications Compared
| Spec | A40 | RTX 4080 |
|---|---|---|
| TDP | 300W | 320W |
| VRAM | 48 GB | 16 GB |
| CUDA Cores | 10,752 | 9,728 |
| FP8 (dense) | Not published | 194.9 TFLOPS |
| Memory Type | GDDR6 | GDDR6X |
| Architecture | Ampere | Ada Lovelace |
| FP16 (dense) | 149.7 TFLOPS | 97.5 TFLOPS |
| Form Factors | PCIe | PCIe |
| INT8 (dense) | 299.3 TOPS | 389.9 TOPS |
| Interconnect | NVLink, PCIe 4.0 | PCIe 4.0 |
| Tensor Cores | 336 | 304 |
| FP32 Performance | 37.4 TFLOPS | 48.7 TFLOPS |
| Memory Bandwidth | 696 GB/s | 717 GB/s |
| FP8 (with sparsity) | Not published | 389.8 TFLOPS |
| FP16 (with sparsity) | 299.4 TFLOPS | 195 TFLOPS |
| INT8 (with sparsity) | 598.6 TOPS | 779.8 TOPS |
Performance Analysis
The A40 delivers 149.7 TFLOPS dense FP16 against the RTX 4080 97.5 TFLOPS dense FP16 while the A40 also supplies 299.4 TFLOPS FP16 with sparsity against 195 TFLOPS FP16 with sparsity on the RTX 4080. This gap means the A40 processes larger batches during mixed precision training where dense FP16 operations dominate. The RTX 4080 provides 48.7 TFLOPS FP32 compared with 37.4 TFLOPS FP32 on the A40 so it completes certain single precision workloads faster. Memory bandwidth stands at 696 GB/s for the A40 and 717 GB/s for the RTX 4080 which allows similar data movement rates yet the A40 48 GB capacity supports larger resident datasets than the 16 GB capacity on the RTX 4080.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A40
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.52 | $4.13 | Deploy |
| RunPod | global | 1 | $0.59 | — | Deploy |
2 providers in stock, 2 offers. All A40 offers, price history and alerts
RTX 4080
RTX 4080 is not offered on-demand by any provider we track right now. See the RTX 4080 rental page for last-seen listed prices and a price alert.
Notify me when A40 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.52/GPU-hr.
QuantaCloud
Comparing providers? We broker across all of them.
Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.
When to Choose the A40
The A40 suits scenarios that require 48 GB of memory to hold large models during LLM training or fine tuning. Its 149.7 TFLOPS dense FP16 and NVLink interconnect further support distributed training setups that exceed the 16 GB limit of the RTX 4080.
When to Choose the RTX 4080
Use Cases
The A40 supplies 48 GB VRAM and 149.7 TFLOPS dense FP16 which accommodate larger models than the 16 GB and 97.5 TFLOPS dense FP16 on the RTX 4080.
The A40 48 GB capacity allows bigger batch sizes during inference compared with the 16 GB on the RTX 4080.
The A40 provides 48 GB memory and 299.4 TFLOPS FP16 with sparsity for fine tuning large models that exceed RTX 4080 limits.
The RTX 4080 delivers 48.7 TFLOPS FP32 which accelerates certain diffusion steps relative to the 37.4 TFLOPS FP32 of the A40.
The RTX 4080 reaches 48.7 TFLOPS FP32 which benefits precision sensitive scientific workloads over the 37.4 TFLOPS FP32 of the A40.
Frequently Asked Questions
What are the dense FP16 ratings for the A40 and RTX 4080?▾
The A40 achieves 149.7 TFLOPS dense FP16. The RTX 4080 achieves 97.5 TFLOPS dense FP16.
Which GPU has higher FP32 performance?▾
The RTX 4080 reaches 48.7 TFLOPS FP32. The A40 reaches 37.4 TFLOPS FP32.
Do both GPUs support the same interconnect options?▾
The A40 includes NVLink in addition to PCIe 4.0. The RTX 4080 supports only PCIe 4.0.
What are the TDP values for these GPUs?▾
The A40 lists a 300W TDP. The RTX 4080 lists a 320W TDP.
How does memory bandwidth compare between the A40 and RTX 4080?▾
The A40 provides 696 GB/s bandwidth. The RTX 4080 provides 717 GB/s bandwidth.
Which is cheaper to rent, the A40 or the RTX 4080?▾
Cloud rental prices for both the A40 and RTX 4080 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A40 have compared to the RTX 4080?▾
The A40 has 48 GB of GDDR6 memory. The RTX 4080 has 16 GB of GDDR6X memory.
Can I find A40 and RTX 4080 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A40 and the RTX 4080?▾
The A40 uses the Ampere architecture (2020) while the RTX 4080 uses Ada Lovelace (2022). The A40 delivers 1.5x the dense FP16 throughput (149.7 vs 97.5 TFLOPS, both without sparsity) and the same memory bandwidth as the RTX 4080.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A40 and the RTX 4080. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A40Every current offer by provider, daily price history and a price alert.
- Rent RTX 4080Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.