Specifications Compared
| Spec | A100 PCIe 80GB | RTX 3090 |
|---|---|---|
| TDP | 400W | 350W |
| VRAM | 80 GB | 24 GB |
| CUDA Cores | 6,912 | 10,496 |
| Memory Type | HBM2e | GDDR6X |
| Architecture | Ampere | Ampere |
| FP16 (dense) | 312 TFLOPS | Not published |
| Form Factors | PCIe | PCIe |
| INT8 (dense) | 624 TOPS | Not published |
| Interconnect | PCIe 4.0, InfiniBand; NVLink only via a bridge between card pairs | NVLink |
| Tensor Cores | 432 | 328 |
| FP32 Performance | 19.5 TFLOPS | 35.6 TFLOPS |
| FP64 Performance | 9.7 TFLOPS | Not published |
| Memory Bandwidth | 2,039 GB/s | 936 GB/s |
| FP16 (with sparsity) | 624 TFLOPS | Not published |
| INT8 (with sparsity) | 1,248 TOPS | Not published |
| FP16 (vendor figure, sparsity not specified) | Not published | 35.6 TFLOPS |
Performance Analysis
The FP16 dense figure of 312 TFLOPS on the A100 exceeds the 35.6 TFLOPS FP16 rating of the RTX 3090 by a factor of eight point eight. Memory bandwidth of 2039 GB/s versus 936 GB/s allows the A100 to sustain larger batches during inference without swapping to host memory. FP32 throughput stands at 19.5 TFLOPS on the A100 and 35.6 TFLOPS on the RTX 3090 so workloads that remain in single precision may favor the RTX 3090 when model size stays under 24 GB.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A100 PCIe 80GB
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.68 | $5.42 | Deploy |
| Vast.ai | Czechia, CZ | 1 | $0.73 | — | Deploy |
| ThunderCompute | USA | 1 | $1.09 | — | Deploy |
| Hyperstack | CANADA-1 | 1 | $1.35 | — | Deploy |
| Massed Compute | us-central-3 | 1 | $1.38 | — | Deploy |
11 providers in stock, 36 offers (cheapest per provider shown). All A100 PCIe 80GB offers, price history and alerts
Notify me when A100 PCIe 80GB drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.68/GPU-hr.
QuantaCloud
Comparing A100 providers? We broker across all of them.
Need 16+ A100s reserved for fine-tuning, simulation, or production inference? We quote volume pricing across multiple data center partners: one quote at partner rates, 24h turnaround.
When to Choose the A100 PCIe 80GB
The A100 PCIe 80GB suits training runs that require 80 GB HBM2e capacity and 312 TFLOPS FP16 dense throughput. Its 2039 GB/s bandwidth supports larger batch sizes in scientific computing codes that exceed the 24 GB limit of the RTX 3090 variant.
When to Choose the RTX 3090
The RTX 3090 variant fits inference tasks or fine tuning jobs where 24 GB GDDR6X suffices and 35.6 TFLOPS FP32 performance meets requirements. Its 350 W TDP also reduces power draw compared with the 400 W rating of the A100 PCIe 80GB.
Use Cases
The 80 GB HBM2e capacity and 312 TFLOPS FP16 dense rating allow training runs that exceed the 24 GB limit of the RTX 3090.
Higher memory bandwidth of 2039 GB/s sustains larger batch sizes during inference compared with 936 GB/s on the RTX 3090.
The 24 GB GDDR6X memory and 35.6 TFLOPS FP16 rating meet typical image generation demands at lower TDP of 350 W.
The 80 GB capacity combined with 19.5 TFLOPS FP32 supports large simulation datasets that exceed 24 GB.
Frequently Asked Questions
What is the memory difference between the A100 PCIe 80GB and RTX 3090?▾
The A100 PCIe 80GB variant contains 80 GB HBM2e while the RTX 3090 variant contains 24 GB GDDR6X.
How does FP16 performance compare between these two GPUs?▾
The A100 delivers 312 TFLOPS FP16 dense whereas the RTX 3090 delivers 35.6 TFLOPS FP16.
Which card offers higher memory bandwidth?▾
The A100 provides 2039 GB/s memory bandwidth while the RTX 3090 provides 936 GB/s.
What are the TDP ratings for the A100 PCIe 80GB and RTX 3090?▾
The A100 carries a 400 W TDP and the RTX 3090 carries a 350 W TDP.
Do both GPUs support NVLink?▾
The RTX 3090 includes NVLink while the A100 PCIe 80GB variant requires a bridge for NVLink between card pairs.
Which architecture do these GPUs share?▾
Both the A100 PCIe 80GB and RTX 3090 belong to the Ampere architecture released in 2020.
Which is cheaper to rent, the A100 PCIe 80GB or the RTX 3090?▾
Cloud rental prices for both the A100 PCIe 80GB and RTX 3090 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A100 PCIe 80GB have compared to the RTX 3090?▾
The A100 PCIe 80GB has 80 GB of HBM2e memory. The RTX 3090 has 24 GB of GDDR6X memory.
Can I find A100 PCIe 80GB and RTX 3090 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A100 PCIe 80GB and the RTX 3090?▾
The A100 PCIe 80GB uses the Ampere architecture (2020) while the RTX 3090 uses Ampere (2020). The A100 PCIe 80GB delivers 4.4x the dense FP16 throughput (312 vs 71 TFLOPS, both without sparsity) and 2.2x the memory bandwidth of the RTX 3090.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A100 PCIe 80GB and the RTX 3090. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A100Every current offer by provider, daily price history and a price alert.
- Rent RTX 3090Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.