Specifications Compared
| Spec | A16 | A40 |
|---|---|---|
| TDP | 250W | 300W |
| VRAM | 16 GB | 48 GB |
| CUDA Cores | 1,280 | 10,752 |
| Memory Type | GDDR6 | GDDR6 |
| Architecture | Ampere | Ampere |
| FP16 (dense) | 17.9 TFLOPS | 149.7 TFLOPS |
| Form Factors | PCIe | PCIe |
| INT8 (dense) | 35.9 TOPS | 299.3 TOPS |
| Interconnect | PCIe 4.0 | NVLink, PCIe 4.0 |
| Tensor Cores | 40 | 336 |
| FP32 Performance | 4.5 TFLOPS | 37.4 TFLOPS |
| Memory Bandwidth | 200 GB/s | 696 GB/s |
| FP16 (with sparsity) | 35.9 TFLOPS | 299.4 TFLOPS |
| INT8 (with sparsity) | 71.8 TOPS | 598.6 TOPS |
Performance Analysis
The A40 delivers 149.7 TFLOPS FP16 dense performance against the A16 17.9 TFLOPS FP16 dense performance, producing an eightfold difference in dense FP16 throughput. The same ratio appears when comparing FP16 with sparsity figures of 299.4 TFLOPS on the A40 against 35.9 TFLOPS on the A16. Memory bandwidth of 696 GB/s on the A40 versus 200 GB/s on the A16 permits larger batch sizes during inference or training workloads that move substantial activation data. FP32 performance follows the same pattern with 37.4 TFLOPS on the A40 against 4.5 TFLOPS on the A16.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A16
A16 is not offered on-demand by any provider we track right now. See the A16 rental page for last-seen listed prices and a price alert.
A40
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.52 | $4.13 | Deploy |
| RunPod | global | 1 | $0.59 | — | Deploy |
2 providers in stock, 2 offers. All A40 offers, price history and alerts
Notify me when A16 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold.
QuantaCloud
Comparing providers? We broker across all of them.
Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.
When to Choose the A16
The A16 suits inference workloads that fit within 16 GB VRAM and require only 17.9 TFLOPS FP16 dense throughput. Its 250 W TDP also fits deployments where power draw must stay below the A40 300 W rating while still handling INT8 dense tasks at 35.9 TOPS.
When to Choose the A40
The A40 suits training and inference jobs that demand 48 GB VRAM together with 149.7 TFLOPS FP16 dense or 299.3 TOPS INT8 dense capacity. Its 696 GB/s bandwidth further supports larger batches in fine-tuning or scientific computing workloads that exceed the limits of 16 GB and 200 GB/s.
Use Cases
The A40 supplies 48 GB VRAM and 37.4 TFLOPS FP32 that accommodate large model training runs beyond the 16 GB and 4.5 TFLOPS FP32 limits of the A16.
The A40 provides 149.7 TFLOPS FP16 dense and 696 GB/s bandwidth that support higher throughput and larger batch sizes than the A16 17.9 TFLOPS FP16 dense and 200 GB/s bandwidth.
The A40 48 GB VRAM and 299.4 TFLOPS FP16 with sparsity enable fine-tuning of models that exceed the memory and compute capacity of the A16.
The A40 48 GB VRAM and 149.7 TFLOPS FP16 dense rating handle higher resolution generation workloads that do not fit within the A16 16 GB VRAM.
The A40 37.4 TFLOPS FP32 and 696 GB/s bandwidth accelerate double precision and data movement tasks beyond the A16 4.5 TFLOPS FP32 and 200 GB/s bandwidth.
Frequently Asked Questions
What is the FP16 dense performance difference?▾
The A40 reaches 149.7 TFLOPS FP16 dense compared with 17.9 TFLOPS FP16 dense on the A16.
Which GPU offers higher memory bandwidth?▾
The A40 provides 696 GB/s memory bandwidth while the A16 provides 200 GB/s memory bandwidth.
What are the TDP ratings for the A16 and A40?▾
The A16 lists a 250 W TDP and the A40 lists a 300 W TDP.
Do both GPUs support NVLink?▾
The A40 supports NVLink in addition to PCIe 4.0 while the A16 supports only PCIe 4.0.
How do the INT8 dense ratings compare?▾
The A40 reaches 299.3 TOPS INT8 dense while the A16 reaches 35.9 TOPS INT8 dense.
Which is cheaper to rent, the A16 or the A40?▾
Cloud rental prices for both the A16 and A40 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A16 have compared to the A40?▾
The A16 has 16 GB of GDDR6 memory. The A40 has 48 GB of GDDR6 memory.
Can I find A16 and A40 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A16 and the A40?▾
The A16 uses the Ampere architecture (2021) while the A40 uses Ampere (2020). The A40 delivers 8.4x the dense FP16 throughput (149.7 vs 17.9 TFLOPS, both without sparsity) and 3.5x the memory bandwidth of the A16.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A16 and the A40. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A16Every current offer by provider, daily price history and a price alert.
- Rent A40Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.