Specifications Compared
| Spec | A40 | RTX 3080 |
|---|---|---|
| TDP | 300W | 320W |
| VRAM | 48 GB | 10-12 GB |
| CUDA Cores | 10,752 | 8,704 |
| Memory Type | GDDR6 | GDDR6X |
| Architecture | Ampere | Ampere |
| FP16 (dense) | 149.7 TFLOPS | 59.5 TFLOPS |
| Form Factors | PCIe | PCIe |
| INT8 (dense) | 299.3 TOPS | 238 TOPS |
| Interconnect | NVLink, PCIe 4.0 | PCIe 4.0 |
| Tensor Cores | 336 | 272 |
| FP32 Performance | 37.4 TFLOPS | 29.8 TFLOPS |
| Memory Bandwidth | 696 GB/s | 760 GB/s |
| FP16 (with sparsity) | 299.4 TFLOPS | 119 TFLOPS |
| INT8 (with sparsity) | 598.6 TOPS | 476 TOPS |
Performance Analysis
The FP16 dense rating of 149.7 TFLOPS on the A40 exceeds the FP16 dense rating of 59.5 TFLOPS on the RTX 3080 by a factor of 2.5. This gap indicates that training and inference steps expressed in dense FP16 arithmetic complete more operations per second on the A40. The FP16 rating with sparsity of 299.4 TFLOPS on the A40 likewise exceeds the FP16 rating with sparsity of 119 TFLOPS on the RTX 3080. Memory bandwidth of 696 GB/s on the A40 versus 760 GB/s on the RTX 3080 affects the maximum batch size that fits within sustained data movement limits. The A40 INT8 dense rating of 299.3 TOPS exceeds the RTX 3080 INT8 dense rating of 238 TOPS, while the A40 INT8 rating with sparsity of 598.6 TOPS exceeds the RTX 3080 INT8 rating with sparsity of 476 TOPS.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A40
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.52 | $4.13 | Deploy |
| RunPod | global | 1 | $0.59 | — | Deploy |
2 providers in stock, 2 offers. All A40 offers, price history and alerts
RTX 3080
RTX 3080 is not offered on-demand by any provider we track right now. See the RTX 3080 rental page for last-seen listed prices and a price alert.
Notify me when A40 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.52/GPU-hr.
QuantaCloud
Comparing providers? We broker across all of them.
Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.
When to Choose the A40
The A40 suits workloads that require the 48 GB VRAM capacity and the FP32 rating of 37.4 TFLOPS. Its 300W TDP also reduces power draw relative to the 320W TDP of the RTX 3080 when dense FP16 throughput of 149.7 TFLOPS is needed.
When to Choose the RTX 3080
The RTX 3080 suits workloads that fit within 10-12 GB VRAM and that benefit from the 760 GB/s memory bandwidth. Its FP16 dense rating of 59.5 TFLOPS remains adequate for lighter inference tasks that do not require the higher tensor ratings of the A40.
Use Cases
The A40 supplies 48 GB VRAM and an FP16 dense rating of 149.7 TFLOPS that together support larger batch sizes than the 10-12 GB VRAM and 59.5 TFLOPS dense FP16 rating on the RTX 3080.
The A40 INT8 dense rating of 299.3 TOPS exceeds the RTX 3080 INT8 dense rating of 238 TOPS and its 48 GB VRAM accommodates bigger models.
The A40 FP32 rating of 37.4 TFLOPS and 48 GB VRAM exceed the RTX 3080 values of 29.8 TFLOPS and 10-12 GB.
The RTX 3080 memory bandwidth of 760 GB/s exceeds the A40 bandwidth of 696 GB/s for diffusion workloads that fit in 10-12 GB.
The A40 FP32 rating of 37.4 TFLOPS and lower TDP of 300W provide an advantage over the RTX 3080 FP32 rating of 29.8 TFLOPS and TDP of 320W.
Frequently Asked Questions
What is the FP32 performance difference between the A40 and the RTX 3080?▾
The A40 lists an FP32 rating of 37.4 TFLOPS while the RTX 3080 lists an FP32 rating of 29.8 TFLOPS.
Which GPU has higher memory bandwidth?▾
The RTX 3080 lists 760 GB/s while the A40 lists 696 GB/s.
How do the FP16 dense ratings compare?▾
The A40 FP16 dense rating reaches 149.7 TFLOPS while the RTX 3080 FP16 dense rating reaches 59.5 TFLOPS.
What are the TDP values for each card?▾
The A40 TDP is 300W and the RTX 3080 TDP is 320W.
Do both GPUs support NVLink?▾
Only the A40 lists NVLink support while the RTX 3080 lists PCIe 4.0 interconnect only.
Which is cheaper to rent, the A40 or the RTX 3080?▾
Cloud rental prices for both the A40 and RTX 3080 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A40 have compared to the RTX 3080?▾
The A40 has 48 GB of GDDR6 memory. The RTX 3080 has 10 to 12 GB of GDDR6X memory.
Can I find A40 and RTX 3080 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A40 and the RTX 3080?▾
The A40 uses the Ampere architecture (2020) while the RTX 3080 uses Ampere (2020). The A40 delivers 2.5x the dense FP16 throughput (149.7 vs 59.5 TFLOPS, both without sparsity) while the RTX 3080 has 1.1x the memory bandwidth of the A40.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A40 and the RTX 3080. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A40Every current offer by provider, daily price history and a price alert.
- Rent RTX 3080Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.