Specifications Compared
| Spec | A100 SXM4 40GB | RTX A6000 |
|---|---|---|
| TDP | 400W | 300W |
| VRAM | 40 GB | 48 GB |
| CUDA Cores | 6,912 | 10,752 |
| Memory Type | HBM2e | GDDR6 |
| Architecture | Ampere | Ampere |
| FP16 (dense) | 312 TFLOPS | Not published |
| Form Factors | SXM4 | PCIe |
| INT8 (dense) | 624 TOPS | Not published |
| Interconnect | NVLink, PCIe 4.0, InfiniBand | NVLink |
| Tensor Cores | 432 | 336 |
| FP32 Performance | 19.5 TFLOPS | 38.7 TFLOPS |
| FP64 Performance | 9.7 TFLOPS | 0.6 TFLOPS |
| Memory Bandwidth | 2,039 GB/s | 768 GB/s |
| FP16 (with sparsity) | 624 TFLOPS | Not published |
| INT8 (with sparsity) | 1,248 TOPS | Not published |
| FP16 (vendor figure, sparsity not specified) | Not published | 38.7 TFLOPS |
Performance Analysis
The A100 SXM4 40GB delivers FP16 dense performance of 312 TFLOPS compared to the RTX A6000 FP16 figure of 38.7 TFLOPS. This gap means the A100 SXM4 40GB completes matrix operations in training and inference at roughly eight times the rate of the RTX A6000 when both operate in dense mode. The RTX A6000 provides FP32 performance of 38.7 TFLOPS while the A100 SXM4 40GB reaches only 19.5 TFLOPS in FP32. Memory bandwidth of 2039 GB/s on the A100 SXM4 40GB versus 768 GB/s on the RTX A6000 allows larger batch sizes during training before memory capacity limits are reached.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A100 SXM4 40GB
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.68 | $5.42 | Deploy |
| Vast.ai | Czechia, CZ | 1 | $0.73 | — | Deploy |
| ThunderCompute | USA | 2 | $1.09 | $2.18 | Deploy |
| Massed Compute | us-central-3 | 2 | $1.35 | $2.70 | Deploy |
| Hyperstack | CANADA-1 | 1 | $1.35 | — | Deploy |
11 providers in stock, 44 offers (cheapest per provider shown). All A100 SXM4 40GB offers, price history and alerts
RTX A6000
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.44 | $3.54 | Deploy |
| QuantaCloud | us-midwest-3 | 2 | $0.48 | $0.96 | Deploy |
| Hyperstack | CANADA-1 | 2 | $0.50 | $1.00 | Deploy |
| Massed Compute | us-central-2 | 2 | $0.55 | $1.10 | Deploy |
| VERDA | FIN-HEL | 1 | $0.74 | — | Deploy |
6 providers in stock, 46 offers (cheapest per provider shown). All RTX A6000 offers, price history and alerts
Notify me when A100 SXM4 40GB drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.68/GPU-hr.
QuantaCloud
Comparing A100 providers? We broker across all of them.
Need 16+ A100s reserved for fine-tuning, simulation, or production inference? We quote volume pricing across multiple data center partners: one quote at partner rates, 24h turnaround.
When to Choose the A100 SXM4 40GB
The A100 SXM4 40GB suits large scale training jobs that require the 312 TFLOPS FP16 dense throughput and 2039 GB/s memory bandwidth. Its SXM4 form factor and NVLink plus InfiniBand interconnect options fit multi node clusters where the 400W TDP is acceptable.
When to Choose the RTX A6000
Its PCIe form factor simplifies integration into standard servers without SXM4 support.
Use Cases
The A100 SXM4 40GB supplies 312 TFLOPS FP16 dense performance and 2039 GB/s bandwidth that support larger models and faster iteration than the RTX A6000.
FP16 dense throughput of 312 TFLOPS on the A100 SXM4 40GB enables higher tokens per second than the 38.7 TFLOPS available on the RTX A6000.
The 2039 GB/s memory bandwidth and 312 TFLOPS FP16 dense rating on the A100 SXM4 40GB allow efficient gradient updates at scale.
The RTX A6000 provides 48 GB GDDR6 memory that accommodates larger diffusion models within its PCIe form factor.
The A100 SXM4 40GB delivers 624 TOPS INT8 dense performance and NVLink interconnect that accelerate simulation workloads.
Frequently Asked Questions
What memory bandwidth does the A100 SXM4 40GB provide?▾
The A100 SXM4 40GB provides 2039 GB/s memory bandwidth. This figure applies across all A100 variants and exceeds the 768 GB/s bandwidth of the RTX A6000.
How does FP16 performance compare between these two GPUs?▾
The A100 SXM4 40GB reaches 312 TFLOPS in FP16 dense mode. The RTX A6000 reaches 38.7 TFLOPS in FP16.
What TDP ratings apply to each card?▾
The A100 SXM4 40GB carries a 400W TDP rating. The RTX A6000 carries a 300W TDP rating.
Which interconnect options exist on the A100 SXM4 40GB?▾
The A100 SXM4 40GB supports NVLink, PCIe 4.0, and InfiniBand. The RTX A6000 supports only NVLink.
Do both GPUs share the same architecture year?▾
Both the A100 SXM4 40GB and the RTX A6000 use the Ampere architecture introduced in 2020.
Which is cheaper to rent, the A100 SXM4 40GB or the RTX A6000?▾
Cloud rental prices for both the A100 SXM4 40GB and RTX A6000 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A100 SXM4 40GB have compared to the RTX A6000?▾
The A100 SXM4 40GB has 40 GB of HBM2e memory. The RTX A6000 has 48 GB of GDDR6 memory.
Can I find A100 SXM4 40GB and RTX A6000 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A100 SXM4 40GB and the RTX A6000?▾
The A100 SXM4 40GB uses the Ampere architecture (2020) while the RTX A6000 uses Ampere (2020). The A100 SXM4 40GB delivers 2.0x the dense FP16 throughput (312 vs 154.8 TFLOPS, both without sparsity) and 2.7x the memory bandwidth of the RTX A6000.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A100 SXM4 40GB and the RTX A6000. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A100Every current offer by provider, daily price history and a price alert.
- Rent RTX A6000Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.