Specifications Compared
| Spec | L40S | RTX A5000 |
|---|---|---|
| TDP | 350W | 230W |
| VRAM | 48 GB | 24 GB |
| CUDA Cores | 18,176 | 8,192 |
| FP8 (dense) | 733 TFLOPS | Not published |
| Memory Type | GDDR6 | GDDR6 |
| Architecture | Ada Lovelace | Ampere |
| FP16 (dense) | 362.05 TFLOPS | Not published |
| Form Factors | PCIe | PCIe |
| INT8 (dense) | 733 TOPS | Not published |
| Interconnect | PCIe 4.0 | NVLink, PCIe 4.0 |
| Tensor Cores | 568 | 256 |
| FP32 Performance | 91.6 TFLOPS | 27.8 TFLOPS |
| FP64 Performance | 1.4 TFLOPS | Not published |
| Memory Bandwidth | 864 GB/s | 768 GB/s |
| FP8 (with sparsity) | 1,466 TFLOPS | Not published |
| FP16 (with sparsity) | 733 TFLOPS | 222.2 TFLOPS |
| INT8 (with sparsity) | 1,466 TOPS | Not published |
Performance Analysis
Tensor performance shows the L40S at 362.05 TFLOPS dense FP16 while the RTX A5000 lists 222.2 TFLOPS with sparsity only. Sparse FP16 comparison places the L40S at 733 TFLOPS against 222.2 TFLOPS on the RTX A5000. FP32 figures stand at 91.6 TFLOPS for the L40S and 27.8 TFLOPS for the RTX A5000 so training workloads experience different throughput based on these dense values. Memory bandwidth at 864 GB/s on the L40S versus 768 GB/s on the RTX A5000 permits larger batch sizes during inference or fine tuning sessions that stay within the 48 GB versus 24 GB VRAM limits.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
L40S
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| Massed Compute | us-central-3 | 4 | $0.97 | $3.88 | Deploy |
| QuantaCloud | us-midwest-2 | 2 | $1.09 | $2.18 | Deploy |
| Ori | lille-4 | 1 | $1.55 | — | Deploy |
| VERDA | FIN-HEL | 1 | $1.77 | — | Deploy |
| Lyceum | Europe | 2 | $1.99 | $3.98 | Deploy |
5 providers in stock, 16 offers (cheapest per provider shown). All L40S offers, price history and alerts
RTX A5000
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| Paperspace | ams1 | 1 | $1.38 | — | Deploy |
1 provider in stock, 6 offers (cheapest per provider shown). All RTX A5000 offers, price history and alerts
Notify me when L40S drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.97/GPU-hr.
QuantaCloud
Comparing providers? We broker across all of them.
Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.
When to Choose the L40S
The L40S suits workloads that require 48 GB VRAM and 362.05 TFLOPS dense FP16 for inference tasks. Its 864 GB/s bandwidth and 91.6 TFLOPS FP32 also support scientific computing runs that exceed the limits of 24 GB configurations.
When to Choose the RTX A5000
The RTX A5000 fits deployments where 230W TDP matters more than peak tensor rates and where NVLink interconnect provides value for multi GPU scaling within 24 GB VRAM bounds.
Use Cases
The L40S supplies 48 GB VRAM and 91.6 TFLOPS FP32 which exceed the 24 GB and 27.8 TFLOPS on the RTX A5000.
Dense FP16 performance reaches 362.05 TFLOPS on the L40S while the RTX A5000 offers only 222.2 TFLOPS with sparsity.
The L40S provides 733 TFLOPS FP16 with sparsity and 48 GB VRAM against 222.2 TFLOPS sparse and 24 GB on the RTX A5000.
Both GPUs handle the workload yet the L40S offers higher 864 GB/s bandwidth while the RTX A5000 uses lower 230W TDP.
FP32 performance of 91.6 TFLOPS on the L40S surpasses 27.8 TFLOPS on the RTX A5000.
Frequently Asked Questions
What are the FP32 ratings for these GPUs?▾
The L40S reaches 91.6 TFLOPS FP32 and the RTX A5000 reaches 27.8 TFLOPS FP32.
Which GPU has higher memory bandwidth?▾
The L40S lists 864 GB/s memory bandwidth compared to 768 GB/s on the RTX A5000.
What power limits apply to each card?▾
The L40S carries a 350W TDP and the RTX A5000 carries a 230W TDP.
Do both GPUs support the same interconnect?▾
The L40S uses PCIe 4.0 while the RTX A5000 supports both NVLink and PCIe 4.0.
How do the sparse FP16 figures compare?▾
The L40S achieves 733 TFLOPS FP16 with sparsity while the RTX A5000 achieves 222.2 TFLOPS FP16 with sparsity.
Which is cheaper to rent, the L40S or the RTX A5000?▾
Cloud rental prices for both the L40S and RTX A5000 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the L40S have compared to the RTX A5000?▾
The L40S has 48 GB of GDDR6 memory. The RTX A5000 has 24 GB of GDDR6 memory.
Can I find L40S and RTX A5000 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the L40S and the RTX A5000?▾
The L40S uses the Ada Lovelace architecture (2023) while the RTX A5000 uses Ampere (2021). The L40S has 48 GB of GDDR6 at 864 GB/s; the RTX A5000 has 24 GB of GDDR6 at 768 GB/s, so the L40S has 1.1x the memory bandwidth of the RTX A5000.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the L40S and the RTX A5000. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent L40SEvery current offer by provider, daily price history and a price alert.
- Rent RTX A5000Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.