Specifications Compared
| Spec | A40 | RTX 6000 Ada |
|---|---|---|
| TDP | 300W | 300W |
| VRAM | 48 GB | 48 GB |
| CUDA Cores | 10,752 | 18,176 |
| FP8 (dense) | Not published | 728.5 TFLOPS |
| Memory Type | GDDR6 | GDDR6 |
| Architecture | Ampere | Ada Lovelace |
| FP16 (dense) | 149.7 TFLOPS | 364 TFLOPS |
| Form Factors | PCIe | PCIe |
| INT8 (dense) | 299.3 TOPS | 728.5 TOPS |
| Interconnect | NVLink, PCIe 4.0 | PCIe 4.0 |
| Tensor Cores | 336 | 568 |
| FP32 Performance | 37.4 TFLOPS | 91.1 TFLOPS |
| Memory Bandwidth | 696 GB/s | 960 GB/s |
| FP8 (with sparsity) | Not published | 1,457 TFLOPS |
| FP16 (with sparsity) | 299.4 TFLOPS | 728 TFLOPS |
| INT8 (with sparsity) | 598.6 TOPS | 1,457 TOPS |
Performance Analysis
Dense FP16 performance stands at 149.7 TFLOPS for the A40 and 364 TFLOPS for the RTX 6000 Ada so the latter supplies more than double the dense FP16 rate. The same ratio appears in FP32 where 91.1 TFLOPS exceeds 37.4 TFLOPS by a factor of 2.4. Memory bandwidth of 960 GB/s versus 696 GB/s allows the RTX 6000 Ada to sustain larger batch sizes during training or inference steps that move substantial activation data. Sparse FP16 figures of 728 TFLOPS on the RTX 6000 Ada likewise exceed the A40 sparse FP16 rating of 299.4 TFLOPS by the same factor of approximately 2.4.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A40
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.52 | $4.13 | Deploy |
| RunPod | global | 1 | $0.59 | — | Deploy |
2 providers in stock, 2 offers. All A40 offers, price history and alerts
RTX 6000 Ada
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| Massed Compute | us-central-3 | 1 | $0.79 | — | Deploy |
| QuantaCloud | us-midwest-2 | 1 | $0.79 | — | Deploy |
| LeaderGPU | The Netherlands | 8 | $0.91 | $7.29 | Deploy |
3 providers in stock, 6 offers (cheapest per provider shown). All RTX 6000 Ada offers, price history and alerts
Notify me when A40 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.52/GPU-hr.
QuantaCloud
Comparing providers? We broker across all of them.
Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.
When to Choose the A40
The A40 becomes preferable in deployments that require NVLink interconnect for multi GPU communication because the RTX 6000 Ada lacks this feature entirely. Workloads that already achieve acceptable throughput at 149.7 dense FP16 TFLOPS and that benefit from the A40 PCIe form factor in existing Ampere based servers also favor retention of the older card.
When to Choose the RTX 6000 Ada
The RTX 6000 Ada suits environments that demand the highest single GPU throughput because its 364 dense FP16 TFLOPS and 91.1 FP32 TFLOPS exceed the corresponding A40 values by more than twofold. Applications sensitive to memory bandwidth gain additional headroom from the 960 GB/s rating when processing large tensors within the shared 48 GB capacity.
Use Cases
The RTX 6000 Ada supplies 364 dense FP16 TFLOPS against the A40 149.7 dense FP16 TFLOPS allowing faster iteration on large models.
Dense FP16 throughput of 364 TFLOPS on the RTX 6000 Ada exceeds the A40 rating of 149.7 TFLOPS and supports higher token generation rates.
FP32 performance reaches 91.1 TFLOPS on the RTX 6000 Ada compared with 37.4 TFLOPS on the A40 enabling quicker gradient updates.
The RTX 6000 Ada 364 dense FP16 TFLOPS figure accelerates diffusion steps relative to the A40 149.7 TFLOPS value within the same 48 GB memory.
Both GPUs provide 48 GB GDDR6 yet the A40 NVLink interconnect may offset its lower 37.4 FP32 TFLOPS in tightly coupled multi GPU simulations.
Frequently Asked Questions
What FP16 performance separates the two cards?▾
The A40 records 149.7 dense FP16 TFLOPS and 299.4 sparse FP16 TFLOPS. The RTX 6000 Ada records 364 dense FP16 TFLOPS and 728 sparse FP16 TFLOPS.
Do both GPUs support NVLink?▾
Only the A40 includes NVLink interconnect. The RTX 6000 Ada relies solely on PCIe 4.0 for multi GPU communication.
What is the TDP rating shared by both models?▾
Both the A40 and the RTX 6000 Ada carry a 300 W TDP specification. Form factor remains PCIe for each card.
How does INT8 throughput compare?▾
The A40 delivers 299.3 dense INT8 TOPS. The RTX 6000 Ada delivers 728.5 dense INT8 TOPS within the same 48 GB memory envelope.
Which architecture generation does each GPU belong to?▾
The A40 uses Ampere architecture released in 2020. The RTX 6000 Ada uses Ada Lovelace architecture released in 2022.
Which is cheaper to rent, the A40 or the RTX 6000 Ada?▾
Cloud rental prices for both the A40 and RTX 6000 Ada vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A40 have compared to the RTX 6000 Ada?▾
The A40 has 48 GB of GDDR6 memory. The RTX 6000 Ada has 48 GB of GDDR6 memory.
Can I find A40 and RTX 6000 Ada GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A40 and the RTX 6000 Ada?▾
The A40 uses the Ampere architecture (2020) while the RTX 6000 Ada uses Ada Lovelace (2022). The RTX 6000 Ada delivers 2.4x the dense FP16 throughput (364 vs 149.7 TFLOPS, both without sparsity) and 1.4x the memory bandwidth of the A40.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A40 and the RTX 6000 Ada. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A40Every current offer by provider, daily price history and a price alert.
- Rent RTX 6000 ADAEvery current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.