Specifications Compared
| Spec | L40 | RTX A5000 |
|---|---|---|
| TDP | 300W | 230W |
| VRAM | 48 GB | 24 GB |
| CUDA Cores | 18,176 | 8,192 |
| FP8 (dense) | 362 TFLOPS | Not published |
| Memory Type | GDDR6 | GDDR6 |
| Architecture | Ada Lovelace | Ampere |
| FP16 (dense) | 181.05 TFLOPS | Not published |
| Form Factors | PCIe | PCIe |
| INT8 (dense) | 362 TOPS | Not published |
| Interconnect | PCIe 4.0 | NVLink, PCIe 4.0 |
| Tensor Cores | 568 | 256 |
| FP32 Performance | 90.5 TFLOPS | 27.8 TFLOPS |
| Memory Bandwidth | 864 GB/s | 768 GB/s |
| FP8 (with sparsity) | 724 TFLOPS | Not published |
| FP16 (with sparsity) | 362.1 TFLOPS | 222.2 TFLOPS |
| INT8 (with sparsity) | 724 TOPS | Not published |
Performance Analysis
The L40 achieves 181.05 TFLOPS in dense FP16 and 90.5 TFLOPS in FP32 whereas the RTX A5000 lists 222.2 TFLOPS in FP16 with sparsity and 27.8 TFLOPS in FP32. Sparse FP16 performance reaches 362.1 TFLOPS on the L40 against 222.2 TFLOPS on the RTX A5000. The higher memory bandwidth of 864 GB/s on the L40 versus 768 GB/s on the RTX A5000 supports larger batch sizes during training and inference operations that move substantial data volumes between memory and compute units.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
L40
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| ThunderCompute | USA | 1 | $0.79 | — | Deploy |
| Massed Compute | us-central-3 | 1 | $0.86 | — | Deploy |
| QuantaCloud | us-midwest-2 | 4 | $0.94 | $3.75 | Deploy |
| Hyperstack | CANADA-1 | 1 | $1.00 | — | Deploy |
4 providers in stock, 12 offers (cheapest per provider shown). All L40 offers, price history and alerts
RTX A5000
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| Vast.ai | Romania, RO | 1 | $0.23 | — | Deploy |
| Paperspace | ny2 | 4 | $1.38 | $5.52 | Deploy |
2 providers in stock, 9 offers (cheapest per provider shown). All RTX A5000 offers, price history and alerts
Notify me when L40 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.79/GPU-hr.
QuantaCloud
Comparing providers? We broker across all of them.
Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.
When to Choose the L40
The L40 suits scenarios that require 48 GB VRAM and 90.5 TFLOPS FP32 throughput for large model handling. Its 864 GB/s bandwidth and dense FP16 rating of 181.05 TFLOPS further support intensive compute tasks where the 300W TDP remains acceptable.
When to Choose the RTX A5000
The RTX A5000 fits deployments that prioritize the 230W TDP and NVLink interconnect option alongside 24 GB VRAM. Its FP16 performance with sparsity at 222.2 TFLOPS meets needs in environments where lower power draw takes precedence over peak dense throughput figures.
Use Cases
The L40 supplies 48 GB VRAM and 90.5 TFLOPS FP32 that exceed the RTX A5000 values of 24 GB and 27.8 TFLOPS.
The L40 provides 362.1 TFLOPS FP16 with sparsity and 864 GB/s bandwidth compared to 222.2 TFLOPS and 768 GB/s on the RTX A5000.
The L40 offers 181.05 TFLOPS dense FP16 and 48 GB VRAM that allow larger fine-tuning batches than the RTX A5000 specifications.
Both GPUs handle the workload with the L40 using higher VRAM and the RTX A5000 using lower 230W TDP.
The L40 delivers 90.5 TFLOPS FP32 and 362 TFLOPS dense FP8 that surpass the RTX A5000 FP32 rating of 27.8 TFLOPS.
Frequently Asked Questions
How does FP32 performance compare on these GPUs?▾
The L40 reaches 90.5 TFLOPS in FP32. The RTX A5000 reaches 27.8 TFLOPS in FP32. The ratio favors the L40 by more than three times.
Which GPU has higher memory bandwidth?▾
The L40 lists 864 GB/s memory bandwidth. The RTX A5000 lists 768 GB/s memory bandwidth. The L40 therefore sustains higher data movement rates.
What are the TDP values for L40 and RTX A5000?▾
The L40 requires 300W TDP. The RTX A5000 requires 230W TDP. Lower power draw on the RTX A5000 reduces cooling demands in dense installations.
Does the RTX A5000 support NVLink?▾
The RTX A5000 includes NVLink interconnect support. The L40 relies on PCIe 4.0 interconnect only. Multi-GPU scaling options therefore differ between the two.
Which is cheaper to rent, the L40 or the RTX A5000?▾
Cloud rental prices for both the L40 and RTX A5000 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the L40 have compared to the RTX A5000?▾
The L40 has 48 GB of GDDR6 memory. The RTX A5000 has 24 GB of GDDR6 memory.
Can I find L40 and RTX A5000 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the L40 and the RTX A5000?▾
The L40 uses the Ada Lovelace architecture (2023) while the RTX A5000 uses Ampere (2021). The L40 has 48 GB of GDDR6 at 864 GB/s; the RTX A5000 has 24 GB of GDDR6 at 768 GB/s, so the L40 has 1.1x the memory bandwidth of the RTX A5000.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the L40 and the RTX A5000. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent L40Every current offer by provider, daily price history and a price alert.
- Rent RTX A5000Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.