Specifications Compared
| Spec | A100 PCIe 80GB | RTX 4090 |
|---|---|---|
| TDP | 400W | 450W |
| VRAM | 80 GB | 24 GB |
| CUDA Cores | 6,912 | 16,384 |
| FP8 (dense) | Not published | 330.3 TFLOPS |
| Memory Type | HBM2e | GDDR6X |
| Architecture | Ampere | Ada Lovelace |
| FP16 (dense) | 312 TFLOPS | 165.2 TFLOPS |
| Form Factors | PCIe | PCIe |
| INT8 (dense) | 624 TOPS | 660.6 TOPS |
| Interconnect | PCIe 4.0, InfiniBand; NVLink only via a bridge between card pairs | PCIe 4.0 |
| Tensor Cores | 432 | 512 |
| FP32 Performance | 19.5 TFLOPS | 82.6 TFLOPS |
| FP64 Performance | 9.7 TFLOPS | 1.3 TFLOPS |
| Memory Bandwidth | 2,039 GB/s | 1,008 GB/s |
| FP8 (with sparsity) | Not published | 660.6 TFLOPS |
| FP16 (with sparsity) | 624 TFLOPS | 330.4 TFLOPS |
| INT8 (with sparsity) | 1,248 TOPS | 1,321.2 TOPS |
Performance Analysis
The A100 PCIe 80GB delivers FP16 dense throughput of 312 TFLOPS against the RTX 4090 FP16 dense throughput of 165.2 TFLOPS while FP32 figures stand at 19.5 TFLOPS for the A100 family and 82.6 TFLOPS for the RTX 4090 family. Memory bandwidth shared by every A100 variant reaches 2039 GB/s compared with 1008 GB/s shared by every RTX 4090 variant so larger batch sizes become feasible on the A100 PCIe 80GB during training workloads. Direct comparison of dense FP16 figures shows the A100 PCIe 80GB at 312 TFLOPS versus 165.2 TFLOPS on the RTX 4090 and the same pattern holds when sparsity is applied at 624 TFLOPS versus 330.4 TFLOPS.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A100 PCIe 80GB
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.68 | $5.42 | Deploy |
| Vast.ai | Czechia, CZ | 1 | $0.73 | — | Deploy |
| ThunderCompute | USA | 1 | $1.09 | — | Deploy |
| Hyperstack | CANADA-1 | 1 | $1.35 | — | Deploy |
| Massed Compute | us-central-3 | 2 | $1.35 | $2.70 | Deploy |
11 providers in stock, 44 offers (cheapest per provider shown). All A100 PCIe 80GB offers, price history and alerts
Notify me when A100 PCIe 80GB drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.68/GPU-hr.
QuantaCloud
Comparing A100 providers? We broker across all of them.
Need 16+ A100s reserved for fine-tuning, simulation, or production inference? We quote volume pricing across multiple data center partners: one quote at partner rates, 24h turnaround.
When to Choose the A100 PCIe 80GB
The A100 PCIe 80GB suits workloads that require 80 GB memory capacity together with 2039 GB/s bandwidth for large model training. Its 400W TDP and InfiniBand interconnect further support multi node scaling where the 24 GB limit of the RTX 4090 would constrain batch sizes.
When to Choose the RTX 4090
Its architecture yields higher dense FP32 performance than the 19.5 TFLOPS of the A100 family for graphics or mixed precision inference tasks that fit inside 24 GB.
Use Cases
The A100 PCIe 80GB supplies 80 GB memory and 312 TFLOPS dense FP16 that accommodate larger models than the 24 GB and 165.2 TFLOPS dense FP16 of the RTX 4090.
The A100 PCIe 80GB provides 2039 GB/s bandwidth and 624 TFLOPS FP16 with sparsity that support higher throughput for models exceeding 24 GB.
The A100 PCIe 80GB 80 GB capacity and 312 TFLOPS dense FP16 enable fine tuning of models that exceed the 24 GB limit of the RTX 4090.
The RTX 4090 delivers 82.6 TFLOPS FP32 and 165.2 TFLOPS dense FP16 within consumer power limits for diffusion workloads that fit in 24 GB.
Frequently Asked Questions
How does memory bandwidth differ between these two GPUs?▾
Memory bandwidth shared by every A100 variant measures 2039 GB/s while bandwidth shared by every RTX 4090 variant measures 1008 GB/s.
Which GPU provides higher dense FP16 throughput?▾
The A100 family provides 312 TFLOPS dense FP16 while the RTX 4090 family provides 165.2 TFLOPS dense FP16.
What TDP ratings apply to the A100 PCIe 80GB and RTX 4090?▾
The A100 family TDP stands at 400W while the RTX 4090 family TDP stands at 450W.
Does the A100 PCIe 80GB support NVLink?▾
The A100 PCIe 80GB supports NVLink only via a bridge between card pairs in addition to InfiniBand and PCIe 4.0.
What FP32 performance do these GPUs deliver?▾
The A100 family delivers 19.5 TFLOPS FP32 while the RTX 4090 family delivers 82.6 TFLOPS FP32.
Which is cheaper to rent, the A100 PCIe 80GB or the RTX 4090?▾
Cloud rental prices for both the A100 PCIe 80GB and RTX 4090 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A100 PCIe 80GB have compared to the RTX 4090?▾
The A100 PCIe 80GB has 80 GB of HBM2e memory. The RTX 4090 has 24 GB of GDDR6X memory.
Can I find A100 PCIe 80GB and RTX 4090 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A100 PCIe 80GB and the RTX 4090?▾
The A100 PCIe 80GB uses the Ampere architecture (2020) while the RTX 4090 uses Ada Lovelace (2022). The A100 PCIe 80GB delivers 1.9x the dense FP16 throughput (312 vs 165.2 TFLOPS, both without sparsity) and 2.0x the memory bandwidth of the RTX 4090.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A100 PCIe 80GB and the RTX 4090. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A100Every current offer by provider, daily price history and a price alert.
- Rent RTX 4090Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.