GPU comparison

L40 vs RTX 5060

Specifications and current cloud pricing, side by side.

Ada LovelacevsBlackwellUpdated 29 days ago

The L40 is the stronger choice for the most common training and inference workloads because its 48 GB memory capacity and 181.05 TFLOPS FP16 dense rating exceed the corresponding capabilities of the RTX 5060.

L40 listed from $0.79/GPU/hrRTX 5060 listed from $0.16/GPU/hr

Right now, from live stock

  • Cheapest right now: L40 at $0.79/hr on ThunderCompute

    Deploy
  • Most providers in stock: L40 (4)

    See all offers

Specifications Compared

SpecL40RTX 5060
TDP300W145W
VRAM48 GB8-16 GB
CUDA Cores18,1763,840
FP8 (dense)362 TFLOPSNot published
Memory TypeGDDR6GDDR7
ArchitectureAda LovelaceBlackwell
FP16 (dense)181.05 TFLOPSNot published
Form FactorsPCIePCIe
INT8 (dense)362 TOPSNot published
InterconnectPCIe 4.0PCIe 5.0
Tensor Cores568120
FP32 Performance90.5 TFLOPS19.2 TFLOPS
Memory Bandwidth864 GB/s448 GB/s
FP4 (with sparsity)Not published614 TFLOPS
FP8 (with sparsity)724 TFLOPSNot published
FP16 (with sparsity)362.1 TFLOPSNot published
INT8 (with sparsity)724 TOPSNot published

Performance Analysis

The L40 supplies FP16 dense performance of 181.05 TFLOPS and FP16 with sparsity of 362.1 TFLOPS while the RTX 5060 publishes no FP16 figures. FP32 performance of 90.5 TFLOPS on the L40 exceeds the 19.2 TFLOPS of the RTX 5060 by a factor of 4.7. Higher memory bandwidth of 864 GB/s on the L40 supports larger batch sizes than the 448 GB/s available on the RTX 5060. The L40 also lists FP8 dense at 362 TFLOPS and FP8 with sparsity at 724 TFLOPS together with matching INT8 figures. These values indicate the L40 sustains greater throughput for precision formats that remain unspecified on the RTX 5060.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

L40

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
ThunderComputeUSA2$0.79$1.58Deploy
Massed Computeus-central-32$0.86$1.72Deploy
QuantaCloudus-midwest-24$0.94$3.75Deploy
HyperstackCANADA-12$1.00$2.00Deploy

4 providers in stock, 15 offers (cheapest per provider shown). All L40 offers, price history and alerts

RTX 5060

RTX 5060 is not offered on-demand by any provider we track right now. See the RTX 5060 rental page for last-seen listed prices and a price alert.

Which GPU to watchWatch the price of

Notify me when L40 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.79/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the L40

The L40 suits workloads that require 48 GB of memory and FP16 dense throughput of 181.05 TFLOPS. Its 864 GB/s bandwidth and 300W TDP accommodate sustained large batch processing on PCIe 4.0.

When to Choose the RTX 5060

The RTX 5060 fits power constrained environments that operate within 145W TDP and PCIe 5.0 interconnect. Its FP4 with sparsity rating of 614 TFLOPS addresses compact inference tasks that fit inside 8 to 16 GB of GDDR7.

Use Cases

LLM Training
L40

The L40 supplies 48 GB memory and FP16 dense performance of 181.05 TFLOPS that support larger models than the RTX 5060 can accommodate.

LLM Inference
L40

FP8 dense throughput of 362 TFLOPS on the L40 enables higher throughput than the unspecified FP8 rating of the RTX 5060.

Fine-tuning
L40

Memory bandwidth of 864 GB/s on the L40 permits larger batch sizes during fine tuning compared with 448 GB/s on the RTX 5060.

Stable Diffusion
RTX 5060

The RTX 5060 operates at 145W TDP and delivers FP4 with sparsity of 614 TFLOPS for compact image generation workloads.

Scientific Computing
L40

FP32 performance of 90.5 TFLOPS on the L40 exceeds the 19.2 TFLOPS of the RTX 5060 for double precision scientific tasks.

Frequently Asked Questions

What is the TDP of the RTX 5060?▾

The RTX 5060 has a TDP of 145W and uses PCIe 5.0 interconnect.

Does the L40 list FP16 performance?▾

The L40 lists FP16 dense at 181.05 TFLOPS and FP16 with sparsity at 362.1 TFLOPS.

What FP32 rating does the RTX 5060 carry?▾

The RTX 5060 carries an FP32 rating of 19.2 TFLOPS.

What is the FP4 sparse rating of the RTX 5060?▾

The RTX 5060 lists FP4 with sparsity at 614 TFLOPS.

Which is cheaper to rent, the L40 or the RTX 5060?▾

Cloud rental prices for both the L40 and RTX 5060 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the L40 have compared to the RTX 5060?▾

The L40 has 48 GB of GDDR6 memory. The RTX 5060 has 8 to 16 GB of GDDR7 memory.

Can I find L40 and RTX 5060 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the L40 and the RTX 5060?▾

The L40 uses the Ada Lovelace architecture (2023) while the RTX 5060 uses Blackwell (2025). The L40 has 48 GB of GDDR6 at 864 GB/s; the RTX 5060 has 8-16 GB of GDDR7 at 448 GB/s, so the L40 has 1.9x the memory bandwidth of the RTX 5060.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the L40 and the RTX 5060. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps