GPU comparison

L40 vs Quadro RTX 5000

Specifications and current cloud pricing, side by side.

Ada LovelacevsTuringUpdated 32 days ago

For the most common use case of LLM inference the L40 provides superior performance through its 181.05 TFLOPS dense FP16 and 48 GB memory capacity over the Quadro RTX 5000.

L40 from $0.79/GPU/hrQuadro RTX 5000 from $0.82/GPU/hr

Right now, from live stock

  • Cheapest right now: L40 at $0.79/hr on ThunderCompute

    Deploy
  • Most providers in stock: L40 (5)

    See all offers
  • Best $ per TFLOPS FP16 dense right now: L40 ($0.0044 per TFLOPS-hour at 181.05 TFLOPS)

    Deploy

Specifications Compared

SpecL40Quadro RTX 5000
TDP300W230W
VRAM48 GB16 GB
CUDA Cores18,1763,072
FP8 (dense)362 TFLOPSNot published
Memory TypeGDDR6GDDR6
ArchitectureAda LovelaceTuring
FP16 (dense)181.05 TFLOPS89.2 TFLOPS
Form FactorsPCIePCIe
INT8 (dense)362 TOPS178.4 TOPS
InterconnectPCIe 4.0NVLink, PCIe 3.0
Tensor Cores568384
FP32 Performance90.5 TFLOPS11.2 TFLOPS
Memory Bandwidth864 GB/s448 GB/s
FP8 (with sparsity)724 TFLOPSNot published
FP16 (with sparsity)362.1 TFLOPSNot published
INT8 (with sparsity)724 TOPSNot published

Performance Analysis

The FP16 dense performance of 181.05 TFLOPS on the L40 doubles the 89.2 TFLOPS dense FP16 on the Quadro RTX 5000. This delta allows faster training iterations and larger model handling in inference scenarios that use dense operations. For sparse workloads the L40 provides 362.1 TFLOPS with sparsity compared to the absence of a published sparse figure for the Quadro RTX 5000. Memory bandwidth of 864 GB/s versus 448 GB/s supports larger batch sizes during both training and inference on the L40. The FP32 figure of 90.5 TFLOPS dense on the L40 versus 11.2 TFLOPS on the Quadro RTX 5000 indicates substantial advantages in precision sensitive computations.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

L40

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
ThunderComputeUSA1$0.79—Deploy
RunPodglobal1$0.82—Deploy
Massed Computeus-central-31$0.86—Deploy
QuantaCloudus-midwest-24$0.94$3.75Deploy
HyperstackCANADA-14$1.00$4.00Deploy

5 providers in stock, 18 offers (cheapest per provider shown). All L40 offers, price history and alerts

Quadro RTX 5000

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Paperspaceny22$0.82$1.64Deploy

1 provider in stock, 2 offers (cheapest per provider shown). All Quadro RTX 5000 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when L40 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.79/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the L40

The L40 suits applications requiring 48 GB VRAM and 864 GB/s bandwidth such as large scale inference with dense FP16 at 181.05 TFLOPS. Its 300W TDP accommodates data center deployments where higher compute density matters.

When to Choose the Quadro RTX 5000

The Quadro RTX 5000 fits environments with power constraints at 230W TDP and tasks that operate within 16 GB VRAM limits using its 89.2 TFLOPS dense FP16.

Use Cases

LLM Training
L40

The L40 offers 181.05 TFLOPS dense FP16 and 48 GB VRAM which exceed the 89.2 TFLOPS and 16 GB on the Quadro RTX 5000.

LLM Inference
L40

The L40 delivers 181.05 TFLOPS dense FP16 along with 864 GB/s bandwidth for handling larger batches than the 89.2 TFLOPS and 448 GB/s on the Quadro RTX 5000.

Fine-tuning
L40

The L40 supports fine tuning with 48 GB VRAM and 362.1 TFLOPS FP16 with sparsity compared to the lower 16 GB and 89.2 TFLOPS dense FP16 on the Quadro RTX 5000.

Stable Diffusion
L40

The L40 provides 48 GB VRAM and 181.05 TFLOPS dense FP16 for image generation workloads exceeding the 16 GB and 89.2 TFLOPS dense FP16 of the Quadro RTX 5000.

Scientific Computing
L40

The L40 achieves 90.5 TFLOPS FP32 which surpasses the 11.2 TFLOPS FP32 on the Quadro RTX 5000 for compute intensive scientific tasks.

Frequently Asked Questions

How does FP16 performance compare between the L40 and Quadro RTX 5000?▾

The L40 provides 181.05 TFLOPS dense FP16 while the Quadro RTX 5000 provides 89.2 TFLOPS dense FP16. The L40 also lists 362.1 TFLOPS FP16 with sparsity.

Which GPU has higher memory bandwidth?▾

The L40 reaches 864 GB/s memory bandwidth compared to 448 GB/s on the Quadro RTX 5000.

What are the TDP ratings for the L40 and Quadro RTX 5000?▾

The L40 has a TDP of 300W and the Quadro RTX 5000 has a TDP of 230W.

How does FP32 performance differ between these GPUs?▾

The L40 delivers 90.5 TFLOPS FP32 while the Quadro RTX 5000 delivers 11.2 TFLOPS FP32.

Does the Quadro RTX 5000 publish an FP8 figure?▾

The Quadro RTX 5000 does not publish an FP8 figure while the L40 lists 362 TFLOPS dense FP8.

Which is cheaper to rent, the L40 or the Quadro RTX 5000?▾

Cloud rental prices for both the L40 and Quadro RTX 5000 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the L40 have compared to the Quadro RTX 5000?▾

The L40 has 48 GB of GDDR6 memory. The Quadro RTX 5000 has 16 GB of GDDR6 memory.

Can I find L40 and Quadro RTX 5000 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the L40 and the Quadro RTX 5000?▾

The L40 uses the Ada Lovelace architecture (2023) while the Quadro RTX 5000 uses Turing (2018). The L40 delivers 2.0x the dense FP16 throughput (181.05 vs 89.2 TFLOPS, both without sparsity) and 1.9x the memory bandwidth of the Quadro RTX 5000.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the L40 and the Quadro RTX 5000. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps