GPU comparison

L4 vs L40

Specifications and current cloud pricing, side by side.

Ada LovelacevsAda LovelaceUpdated 33 days ago

The L40 wins for the most common use case of LLM inference because its 48 GB memory and 864 GB/s bandwidth exceed the L4 specifications by wide margins while FP16 dense performance of 181.05 TFLOPS supports larger models effectively.

L4 from $0.59/GPU/hrL40 from $0.79/GPU/hr

Right now, from live stock

  • Cheapest right now: L4 at $0.59/hr on RunPod

    Deploy
  • Most providers in stock: L40 (4)

    See all offers
  • Best $ per TFLOPS FP16 dense right now: L40 ($0.0044 per TFLOPS-hour at 181.05 TFLOPS)

    Deploy

Specifications Compared

SpecL4L40
TDP72W300W
VRAM24 GB48 GB
CUDA Cores7,42418,176
FP8 (dense)242 TFLOPS362 TFLOPS
Memory TypeGDDR6GDDR6
ArchitectureAda LovelaceAda Lovelace
FP16 (dense)121 TFLOPS181.05 TFLOPS
Form FactorsPCIePCIe
INT8 (dense)242 TOPS362 TOPS
InterconnectPCIe 4.0PCIe 4.0
Tensor Cores232568
FP32 Performance30.3 TFLOPS90.5 TFLOPS
FP64 Performance0.5 TFLOPSNot published
Memory Bandwidth300 GB/s864 GB/s
FP8 (with sparsity)485 TFLOPS724 TFLOPS
FP16 (with sparsity)242 TFLOPS362.1 TFLOPS
INT8 (with sparsity)485 TOPS724 TOPS

Performance Analysis

The FP16 dense figure of 121 TFLOPS on the L4 exceeds its FP32 value of 30.3 TFLOPS by a factor of four while the L40 shows an FP16 dense value of 181.05 TFLOPS against its FP32 value of 90.5 TFLOPS by a factor of two. This ratio indicates the L4 favors mixed precision operations more than the L40 in training scenarios that alternate between FP16 dense and FP32. Memory bandwidth of 300 GB/s on the L4 versus 864 GB/s on the L40 limits maximum batch sizes on the L4 to roughly one third those possible on the L40 during large model inference. FP16 with sparsity comparisons show 242 TFLOPS on the L4 against 362.1 TFLOPS on the L40 while FP8 with sparsity reaches 485 TFLOPS versus 724 TFLOPS.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

L4

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
RunPodglobal1$0.59—Deploy
ScalewayWarsaw, Poland (WAW2)2$0.89$1.77Deploy

2 providers in stock, 4 offers (cheapest per provider shown). All L4 offers, price history and alerts

L40

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
ThunderComputeUSA2$0.79$1.58Deploy
Massed Computeus-central-31$0.86—Deploy
QuantaCloudus-midwest-24$0.94$3.75Deploy
HyperstackCANADA-11$1.00—Deploy

4 providers in stock, 15 offers (cheapest per provider shown). All L40 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when L4 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.59/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the L4

The L4 suits deployments where TDP must remain at 72W and memory needs stay within 24 GB. PCIe interconnect at 4.0 supports these compact installations without exceeding power limits of edge servers. FP32 performance of 30.3 TFLOPS meets requirements for lighter scientific computing tasks that do not demand the 90.5 TFLOPS of the L40.

When to Choose the L40

The L40 fits scenarios that require 48 GB of memory and 864 GB/s bandwidth to handle larger batches. FP16 dense performance of 181.05 TFLOPS accelerates training and inference compared with the 121 TFLOPS of the L4. Higher TDP of 300W remains acceptable in data center racks that prioritize throughput over efficiency.

Use Cases

LLM Training
L40

The L40 supplies 181.05 TFLOPS FP16 dense and 48 GB memory that exceed the L4 values for sustained training runs.

LLM Inference
L40

The L40 provides 362 TFLOPS FP8 dense and 864 GB/s bandwidth that allow larger batch sizes than the L4.

Fine-tuning
L40

The L40 FP16 with sparsity at 362.1 TFLOPS supports fine-tuning workloads more efficiently than the L4 at 242 TFLOPS.

Stable Diffusion
Either

Both GPUs deliver adequate FP16 dense performance though the L40 handles higher resolution batches with 48 GB memory.

Scientific Computing
L4

The L4 at 72W TDP and 30.3 TFLOPS FP32 meets requirements where power limits preclude the 300W L40.

Frequently Asked Questions

What is the memory difference between L4 and L40?▾

The L4 contains 24 GB GDDR6 while the L40 contains 48 GB GDDR6. Bandwidth measures 300 GB/s on the L4 and 864 GB/s on the L40.

How does FP16 performance compare on L4 versus L40?▾

FP16 dense reaches 121 TFLOPS on the L4 and 181.05 TFLOPS on the L40. FP16 with sparsity measures 242 TFLOPS on the L4 and 362.1 TFLOPS on the L40.

What TDP values apply to each GPU?▾

The L4 lists a TDP of 72W. The L40 lists a TDP of 300W. Both use PCIe form factors.

Which GPU offers higher FP32 performance?▾

The L40 reaches 90.5 TFLOPS FP32. The L4 reaches 30.3 TFLOPS FP32.

Do both GPUs support the same interconnect?▾

Both the L4 and L40 use PCIe 4.0 interconnect. Form factors remain PCIe for each model.

How do INT8 figures differ?▾

INT8 dense measures 242 TOPS on the L4 and 362 TOPS on the L40. INT8 with sparsity measures 485 TOPS on the L4 and 724 TOPS on the L40.

Which is cheaper to rent, the L4 or the L40?▾

Cloud rental prices for both the L4 and L40 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the L4 have compared to the L40?▾

The L4 has 24 GB of GDDR6 memory. The L40 has 48 GB of GDDR6 memory.

Can I find L4 and L40 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the L4 and the L40?▾

The L4 uses the Ada Lovelace architecture (2023) while the L40 uses Ada Lovelace (2023). The L40 delivers 1.5x the dense FP16 throughput (181.05 vs 121 TFLOPS, both without sparsity) and 2.9x the memory bandwidth of the L4.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the L4 and the L40. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps