Specifications Compared
| Spec | A16 | RTX 4090 |
|---|---|---|
| TDP | 250W | 450W |
| VRAM | 16 GB | 24 GB |
| CUDA Cores | 1,280 | 16,384 |
| FP8 (dense) | Not published | 330.3 TFLOPS |
| Memory Type | GDDR6 | GDDR6X |
| Architecture | Ampere | Ada Lovelace |
| FP16 (dense) | 17.9 TFLOPS | 165.2 TFLOPS |
| Form Factors | PCIe | PCIe |
| INT8 (dense) | 35.9 TOPS | 660.6 TOPS |
| Interconnect | PCIe 4.0 | PCIe 4.0 |
| Tensor Cores | 40 | 512 |
| FP32 Performance | 4.5 TFLOPS | 82.6 TFLOPS |
| FP64 Performance | Not published | 1.3 TFLOPS |
| Memory Bandwidth | 200 GB/s | 1,008 GB/s |
| FP8 (with sparsity) | Not published | 660.6 TFLOPS |
| FP16 (with sparsity) | 35.9 TFLOPS | 330.4 TFLOPS |
| INT8 (with sparsity) | 71.8 TOPS | 1,321.2 TOPS |
Performance Analysis
The FP16 dense performance reaches 17.9 TFLOPS on the A16 compared with 165.2 TFLOPS dense on the RTX 4090. This ninefold difference in dense FP16 throughput affects training and inference duration for models that rely on half precision arithmetic. The FP16 with sparsity figure stands at 35.9 TFLOPS on the A16 against 330.4 TFLOPS with sparsity on the RTX 4090 so the same ratio applies when sparsity acceleration is available.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A16
A16 is not offered on-demand by any provider we track right now. See the A16 rental page for last-seen listed prices and a price alert.
RTX 4090
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| Vast.ai | United Kingdom, GB | 8 | $0.53 | $4.27 | Deploy |
| LeaderGPU | The Netherlands | 1 | $1.66 | — | Deploy |
2 providers in stock, 6 offers (cheapest per provider shown). All RTX 4090 offers, price history and alerts
Notify me when A16 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold.
QuantaCloud
Comparing providers? We broker across all of them.
Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.
When to Choose the A16
The A16 suits deployments where TDP must remain at 250W and memory bandwidth requirements stay near 200 GB/s. Tasks that operate within 16 GB VRAM and utilize INT8 dense throughput of 35.9 TOPS benefit from the lower power envelope without exceeding PCIe interconnect limits.
When to Choose the RTX 4090
The RTX 4090 suits deployments where FP32 throughput of 82.6 TFLOPS and memory bandwidth of 1008 GB/s enable larger batch sizes. Tasks that require FP8 dense performance of 330.3 TFLOPS or INT8 with sparsity at 1321.2 TOPS complete faster within the 24 GB VRAM capacity.
Use Cases
The RTX 4090 delivers 82.6 TFLOPS FP32 compared with 4.5 TFLOPS FP32 on the A16.
The RTX 4090 supplies 165.2 TFLOPS dense FP16 and 1008 GB/s bandwidth versus 17.9 TFLOPS dense FP16 and 200 GB/s on the A16.
The RTX 4090 provides 24 GB VRAM and 330.4 TFLOPS FP16 with sparsity against 16 GB VRAM and 35.9 TFLOPS FP16 with sparsity on the A16.
The A16 operates at 250W TDP with 4.5 TFLOPS FP32 while the RTX 4090 operates at 450W TDP with 82.6 TFLOPS FP32 so selection depends on power constraints.
Frequently Asked Questions
What FP16 dense performance does the A16 provide?▾
The A16 provides 17.9 TFLOPS FP16 dense and 35.9 TFLOPS FP16 with sparsity.
How does RTX 4090 FP32 compare to A16 FP32?▾
The RTX 4090 reaches 82.6 TFLOPS FP32 while the A16 reaches 4.5 TFLOPS FP32.
What memory bandwidth does each GPU deliver?▾
The A16 delivers 200 GB/s while the RTX 4090 delivers 1008 GB/s.
Which GPU has higher INT8 performance with sparsity?▾
The RTX 4090 reaches 1321.2 TOPS INT8 with sparsity while the A16 reaches 71.8 TOPS INT8 with sparsity.
What TDP values apply to the A16 and RTX 4090?▾
The A16 lists 250W TDP and the RTX 4090 lists 450W TDP.
Do both GPUs use the same interconnect?▾
Both the A16 and the RTX 4090 use PCIe 4.0 interconnect.
Which is cheaper to rent, the A16 or the RTX 4090?▾
Cloud rental prices for both the A16 and RTX 4090 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A16 have compared to the RTX 4090?▾
The A16 has 16 GB of GDDR6 memory. The RTX 4090 has 24 GB of GDDR6X memory.
Can I find A16 and RTX 4090 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A16 and the RTX 4090?▾
The A16 uses the Ampere architecture (2021) while the RTX 4090 uses Ada Lovelace (2022). The RTX 4090 delivers 9.2x the dense FP16 throughput (165.2 vs 17.9 TFLOPS, both without sparsity) and 5.0x the memory bandwidth of the A16.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A16 and the RTX 4090. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A16Every current offer by provider, daily price history and a price alert.
- Rent RTX 4090Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.