Specifications Compared
| Spec | L40S | RTX 4060 Ti |
|---|---|---|
| TDP | 350W | 115W |
| VRAM | 48 GB | 8 GB |
| CUDA Cores | 18,176 | 3,072 |
| FP8 (dense) | 733 TFLOPS | Not published |
| Memory Type | GDDR6 | GDDR6 |
| Architecture | Ada Lovelace | Ada Lovelace |
| FP16 (dense) | 362.05 TFLOPS | Not published |
| Form Factors | PCIe | PCIe |
| INT8 (dense) | 733 TOPS | Not published |
| Interconnect | PCIe 4.0 | Not published |
| Tensor Cores | 568 | 96 |
| FP32 Performance | 91.6 TFLOPS | 15.1 TFLOPS |
| FP64 Performance | 1.4 TFLOPS | Not published |
| Memory Bandwidth | 864 GB/s | 272 GB/s |
| FP8 (with sparsity) | 1,466 TFLOPS | Not published |
| FP16 (with sparsity) | 733 TFLOPS | Not published |
| INT8 (with sparsity) | 1,466 TOPS | Not published |
| FP16 (vendor figure, sparsity not specified) | Not published | 15.1 TFLOPS |
| INT8 (vendor figure, sparsity not specified) | Not published | 242 TOPS |
Performance Analysis
Dense FP16 performance registers at 362.05 TFLOPS on the L40S family compared with the 15.1 TFLOPS FP16 figure on the RTX 4060 Ti family. The FP32 rating stands at 91.6 TFLOPS for the L40S family and 15.1 TFLOPS for the RTX 4060 Ti family. This gap in dense FP16 throughput translates to substantially higher throughput for matrix operations during training and inference on the L40S. Memory bandwidth of 864 GB/s versus 272 GB/s permits larger batch sizes without swapping on the L40S family. Dense FP8 performance reaches 733 TFLOPS on the L40S family while the RTX 4060 Ti family lists INT8 throughput at 242 TOPS without a sparsity designation.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
L40S
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| Massed Compute | us-central-3 | 4 | $0.97 | $3.88 | Deploy |
| QuantaCloud | us-midwest-1 | 8 | $1.09 | $8.72 | Deploy |
| Lyceum | Europe | 1 | $1.99 | — | Deploy |
3 providers in stock, 16 offers (cheapest per provider shown). All L40S offers, price history and alerts
RTX 4060 Ti
RTX 4060 Ti is not offered on-demand by any provider we track right now. See the RTX 4060 Ti rental page for last-seen listed prices and a price alert.
Notify me when L40S drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.97/GPU-hr.
QuantaCloud
Comparing providers? We broker across all of them.
Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.
When to Choose the L40S
The L40S variant with 48 GB GDDR6 suits scenarios that require extensive memory for large model parameters. Its 362.05 TFLOPS dense FP16 rating and 864 GB/s bandwidth support sustained operation on memory intensive tasks where the 8 GB capacity of the RTX 4060 Ti variant would constrain batch sizes or model scale.
When to Choose the RTX 4060 Ti
The RTX 4060 Ti variant with 8 GB GDDR6 fits environments that operate under strict power limits given its 115 W TDP. Its 15.1 TFLOPS FP16 rating handles smaller inference workloads efficiently when the 350 W TDP and higher memory capacity of the L40S variant exceed requirements.
Use Cases
The L40S variant supplies 48 GB GDDR6 that accommodates larger models while the RTX 4060 Ti variant limits training to 8 GB.
Dense FP16 throughput of 362.05 TFLOPS on the L40S family exceeds the 15.1 TFLOPS figure on the RTX 4060 Ti family for sustained inference throughput.
The 864 GB/s bandwidth on the L40S family supports larger batch sizes during fine tuning compared with 272 GB/s on the RTX 4060 Ti family.
The 115 W TDP on the RTX 4060 Ti family meets lower power needs for image generation tasks that fit within 8 GB GDDR6.
FP32 performance of 91.6 TFLOPS on the L40S family combined with 48 GB capacity handles compute heavy scientific workloads beyond the RTX 4060 Ti variant limits.
Frequently Asked Questions
How does dense FP16 performance compare between these two variants?▾
The L40S family delivers 362.05 TFLOPS dense FP16 while the RTX 4060 Ti family lists 15.1 TFLOPS FP16 without a sparsity designation. The L40S family also lists 91.6 TFLOPS FP32.
What TDP values apply to the L40S and RTX 4060 Ti families?▾
The L40S family operates at 350 W TDP. The RTX 4060 Ti family operates at 115 W TDP. Both variants use PCIe form factor and PCIe 4.0 interconnect.
Which variant supports larger batch sizes during inference?▾
The L40S family with 864 GB/s memory bandwidth supports larger batch sizes than the 272 GB/s bandwidth on the RTX 4060 Ti family. The 48 GB capacity further enables this advantage over the 8 GB capacity.
What INT8 throughput figures are listed for each family?▾
The L40S family lists 733 TOPS dense INT8. The RTX 4060 Ti family lists 242 TOPS INT8 without a sparsity designation.
Which is cheaper to rent, the L40S or the RTX 4060 Ti?▾
Cloud rental prices for both the L40S and RTX 4060 Ti vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the L40S have compared to the RTX 4060 Ti?▾
The L40S has 48 GB of GDDR6 memory. The RTX 4060 Ti has 8 GB of GDDR6 memory.
Can I find L40S and RTX 4060 Ti GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the L40S and the RTX 4060 Ti?▾
The L40S uses the Ada Lovelace architecture (2023) while the RTX 4060 Ti uses Ada Lovelace (2023). The L40S has 48 GB of GDDR6 at 864 GB/s; the RTX 4060 Ti has 8 GB of GDDR6 at 272 GB/s, so the L40S has 3.2x the memory bandwidth of the RTX 4060 Ti.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the L40S and the RTX 4060 Ti. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent L40SEvery current offer by provider, daily price history and a price alert.
- Rent RTX 4060Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.