Specifications Compared
| Spec | A100 SXM4 40GB | RTX 4090 |
|---|---|---|
| TDP | 400W | 450W |
| VRAM | 40 GB | 24 GB |
| CUDA Cores | 6,912 | 16,384 |
| FP8 (dense) | Not published | 330.3 TFLOPS |
| Memory Type | HBM2e | GDDR6X |
| Architecture | Ampere | Ada Lovelace |
| FP16 (dense) | 312 TFLOPS | 165.2 TFLOPS |
| Form Factors | SXM4 | PCIe |
| INT8 (dense) | 624 TOPS | 660.6 TOPS |
| Interconnect | NVLink, PCIe 4.0, InfiniBand | PCIe 4.0 |
| Tensor Cores | 432 | 512 |
| FP32 Performance | 19.5 TFLOPS | 82.6 TFLOPS |
| FP64 Performance | 9.7 TFLOPS | 1.3 TFLOPS |
| Memory Bandwidth | 2,039 GB/s | 1,008 GB/s |
| FP8 (with sparsity) | Not published | 660.6 TFLOPS |
| FP16 (with sparsity) | 624 TFLOPS | 330.4 TFLOPS |
| INT8 (with sparsity) | 1,248 TOPS | 1,321.2 TOPS |
Performance Analysis
The A100 SXM4 40GB delivers 312 TFLOPS FP16 dense and 19.5 TFLOPS FP32 while the RTX 4090 provides 165.2 TFLOPS FP16 dense and 82.6 TFLOPS FP32 with both sets of figures representing family shared values. This FP16 to FP32 ratio indicates the A100 SXM4 40GB suits workloads that prioritize lower precision tensor operations over single precision throughput whereas the RTX 4090 reverses that emphasis. Memory bandwidth stands at 2039 GB/s for the A100 family and 1008 GB/s for the RTX 4090 family allowing larger batch sizes on the A100 SXM4 40GB variant during memory intensive tasks. When comparing like figures the A100 SXM4 40GB reaches 624 TFLOPS FP16 with sparsity against the RTX 4090 value of 330.4 TFLOPS FP16 with sparsity confirming consistent scaling in sparse modes.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A100 SXM4 40GB
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.68 | $5.42 | Deploy |
| Vast.ai | Czechia, CZ | 1 | $0.73 | — | Deploy |
| ThunderCompute | USA | 2 | $1.09 | $2.18 | Deploy |
| Hyperstack | CANADA-1 | 2 | $1.35 | $2.70 | Deploy |
| Massed Compute | us-central-3 | 1 | $1.35 | — | Deploy |
10 providers in stock, 35 offers (cheapest per provider shown). All A100 SXM4 40GB offers, price history and alerts
RTX 4090
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| Vast.ai | Hungary, HU | 1 | $1.53 | — | Deploy |
| LeaderGPU | The Netherlands | 1 | $1.66 | — | Deploy |
2 providers in stock, 7 offers (cheapest per provider shown). All RTX 4090 offers, price history and alerts
Notify me when A100 SXM4 40GB drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.68/GPU-hr.
QuantaCloud
Comparing A100 providers? We broker across all of them.
Need 16+ A100s reserved for fine-tuning, simulation, or production inference? We quote volume pricing across multiple data center partners: one quote at partner rates, 24h turnaround.
When to Choose the A100 SXM4 40GB
The A100 SXM4 40GB variant suits multi GPU clusters that require NVLink connectivity and 40 GB HBM2e memory capacity for handling large models. Its 400W TDP and 2039 GB/s bandwidth support sustained operation in scientific computing environments where InfiniBand interconnects integrate with existing data center infrastructure.
When to Choose the RTX 4090
Its 450W TDP and 24 GB GDDR6X memory align with graphics oriented or consumer grade inference tasks where high single precision throughput matters most.
Use Cases
The A100 SXM4 40GB variant supplies 40 GB HBM2e memory and NVLink support that accommodate larger model scales during training runs.
The RTX 4090 variant achieves 82.6 TFLOPS FP32 which accelerates inference steps that rely on single precision calculations.
The A100 SXM4 40GB provides 312 TFLOPS FP16 dense throughput along with 40 GB memory capacity for fine tuning large parameter sets.
The RTX 4090 variant delivers 165.2 TFLOPS FP16 dense performance in a PCIe form factor suited to graphics generation pipelines.
The A100 SXM4 40GB includes InfiniBand interconnect and 2039 GB/s bandwidth that match requirements for distributed scientific simulations.
Frequently Asked Questions
What memory types distinguish the A100 SXM4 40GB from the RTX 4090?▾
The A100 SXM4 40GB variant uses 40 GB HBM2e memory while the RTX 4090 variant uses 24 GB GDDR6X memory with both capacities fixed for these specific models.
How do the FP16 dense figures compare between these GPUs?▾
The A100 SXM4 40GB reaches 312 TFLOPS FP16 dense and the RTX 4090 reaches 165.2 TFLOPS FP16 dense with both values shared across their respective families.
Which GPU supports NVLink connectivity?▾
The A100 SXM4 40GB variant includes NVLink interconnect whereas the RTX 4090 variant is limited to PCIe 4.0 interconnect.
What are the TDP ratings for each model?▾
The A100 SXM4 40GB carries a 400W TDP and the RTX 4090 carries a 450W TDP with these figures applying across their families.
Which is cheaper to rent, the A100 SXM4 40GB or the RTX 4090?▾
Cloud rental prices for both the A100 SXM4 40GB and RTX 4090 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A100 SXM4 40GB have compared to the RTX 4090?▾
The A100 SXM4 40GB has 40 GB of HBM2e memory. The RTX 4090 has 24 GB of GDDR6X memory.
Can I find A100 SXM4 40GB and RTX 4090 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A100 SXM4 40GB and the RTX 4090?▾
The A100 SXM4 40GB uses the Ampere architecture (2020) while the RTX 4090 uses Ada Lovelace (2022). The A100 SXM4 40GB delivers 1.9x the dense FP16 throughput (312 vs 165.2 TFLOPS, both without sparsity) and 2.0x the memory bandwidth of the RTX 4090.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A100 SXM4 40GB and the RTX 4090. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A100Every current offer by provider, daily price history and a price alert.
- Rent RTX 4090Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.