GPU comparison

L40 vs RTX 4080

Specifications and current cloud pricing, side by side.

Ada LovelacevsAda LovelaceUpdated 32 days ago

The L40 wins for the most common use case of LLM inference because its 48 GB VRAM and 181.05 TFLOPS dense FP16 enable larger batch sizes and higher throughput than the RTX 4080 can achieve with 16 GB VRAM and 97.5 TFLOPS dense FP16.

L40 listed from $0.79/GPU/hrRTX 4080 listed from $0.50/GPU/hr

Right now, from live stock

  • Cheapest right now: L40 at $0.79/hr on ThunderCompute

    Deploy
  • Most providers in stock: L40 (4)

    See all offers

Specifications Compared

SpecL40RTX 4080
TDP300W320W
VRAM48 GB16 GB
CUDA Cores18,1769,728
FP8 (dense)362 TFLOPS194.9 TFLOPS
Memory TypeGDDR6GDDR6X
ArchitectureAda LovelaceAda Lovelace
FP16 (dense)181.05 TFLOPS97.5 TFLOPS
Form FactorsPCIePCIe
INT8 (dense)362 TOPS389.9 TOPS
InterconnectPCIe 4.0PCIe 4.0
Tensor Cores568304
FP32 Performance90.5 TFLOPS48.7 TFLOPS
Memory Bandwidth864 GB/s717 GB/s
FP8 (with sparsity)724 TFLOPS389.8 TFLOPS
FP16 (with sparsity)362.1 TFLOPS195 TFLOPS
INT8 (with sparsity)724 TOPS779.8 TOPS

Performance Analysis

The FP16 dense performance delta shows the L40 at 181.05 TFLOPS versus 97.5 TFLOPS on the RTX 4080 which translates to faster matrix operations during both training and inference passes. The same pattern holds when comparing FP16 with sparsity where the L40 reaches 362.1 TFLOPS against 195 TFLOPS on the RTX 4080. Memory bandwidth differences affect achievable batch sizes because the L40 sustains 864 GB/s while the RTX 4080 sustains 717 GB/s allowing larger batches before memory becomes the limiter. FP32 figures follow the same ratio with the L40 at 90.5 TFLOPS and the RTX 4080 at 48.7 TFLOPS indicating proportional gains in single precision scientific kernels.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

L40

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
ThunderComputeUSA2$0.79$1.58Deploy
Massed Computeus-central-21$0.86—Deploy
QuantaCloudus-midwest-24$0.94$3.75Deploy
HyperstackCANADA-14$1.00$4.00Deploy

4 providers in stock, 17 offers (cheapest per provider shown). All L40 offers, price history and alerts

RTX 4080

RTX 4080 is not offered on-demand by any provider we track right now. See the RTX 4080 rental page for last-seen listed prices and a price alert.

Which GPU to watchWatch the price of

Notify me when L40 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.79/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the L40

The L40 suits workloads that require 48 GB VRAM and 181.05 TFLOPS dense FP16 such as training or fine tuning models that exceed 16 GB capacity. Its 300 W TDP also reduces power draw relative to the 320 W rating of the RTX 4080 while delivering 90.5 TFLOPS FP32 for scientific computing tasks.

When to Choose the RTX 4080

The RTX 4080 fits inference scenarios where 389.9 TOPS dense INT8 throughput and a compact form factor matter more than raw memory capacity. Its 16 GB VRAM remains sufficient for smaller models that do not require the 48 GB offered by the L40.

Use Cases

LLM Training
L40

The L40 supplies 48 GB VRAM and 181.05 TFLOPS dense FP16 which support larger models than the 16 GB and 97.5 TFLOPS dense FP16 of the RTX 4080.

LLM Inference
L40

The L40 provides 864 GB/s bandwidth and 362.1 TFLOPS FP16 with sparsity allowing higher throughput than the RTX 4080 at 717 GB/s and 195 TFLOPS FP16 with sparsity.

Fine-tuning
L40

The L40 offers 48 GB VRAM and 362 TFLOPS dense FP8 which accommodate larger fine tuning batches than the 16 GB and 194.9 TFLOPS dense FP8 of the RTX 4080.

Stable Diffusion
Either

Both cards deliver Ada Lovelace architecture with comparable FP8 dense figures near 362 TFLOPS on the L40 and 194.9 TFLOPS on the RTX 4080 yet memory needs determine final selection.

Scientific Computing
L40

The L40 reaches 90.5 TFLOPS FP32 and 300 W TDP which provide higher single precision performance at lower power than the 48.7 TFLOPS FP32 and 320 W TDP of the RTX 4080.

Frequently Asked Questions

What is the FP32 performance of each GPU?▾

The L40 delivers 90.5 TFLOPS FP32. The RTX 4080 delivers 48.7 TFLOPS FP32. The L40 therefore sustains nearly double the single precision throughput.

Which GPU has higher memory bandwidth?▾

The L40 reaches 864 GB/s. The RTX 4080 reaches 717 GB/s. Higher bandwidth on the L40 supports larger batches before data movement becomes the bottleneck.

What TDP ratings apply to the L40 and RTX 4080?▾

The L40 lists a 300 W TDP. The RTX 4080 lists a 320 W TDP. The L40 operates at lower power while delivering higher FP32 and FP16 throughput.

Do both GPUs use the same interconnect?▾

Both the L40 and RTX 4080 employ PCIe 4.0. Form factor remains PCIe for each card.

Which is cheaper to rent, the L40 or the RTX 4080?▾

Cloud rental prices for both the L40 and RTX 4080 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the L40 have compared to the RTX 4080?▾

The L40 has 48 GB of GDDR6 memory. The RTX 4080 has 16 GB of GDDR6X memory.

Can I find L40 and RTX 4080 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the L40 and the RTX 4080?▾

The L40 uses the Ada Lovelace architecture (2023) while the RTX 4080 uses Ada Lovelace (2022). The L40 delivers 1.9x the dense FP16 throughput (181.05 vs 97.5 TFLOPS, both without sparsity) and 1.2x the memory bandwidth of the RTX 4080.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the L40 and the RTX 4080. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps