GPU comparison

L40 vs RTX 5070

Specifications and current cloud pricing, side by side.

Ada LovelacevsBlackwellUpdated 33 days ago

The L40 provides the stronger choice for the most common use case of LLM inference because its 48 GB memory capacity accommodates larger models than the 12 GB to 16 GB available on the RTX 5070 while delivering higher dense FP16 throughput of 181.05 TFLOPS.

L40 listed from $0.79/GPU/hrRTX 5070 listed from $0.17/GPU/hr

Right now, from live stock

  • Cheapest right now: L40 at $0.79/hr on ThunderCompute

    Deploy
  • Most providers in stock: L40 (4)

    See all offers

Specifications Compared

SpecL40RTX 5070
TDP300W250W
VRAM48 GB12-16 GB
CUDA Cores18,1766,144
FP4 (dense)Not published493.9 TFLOPS
FP8 (dense)362 TFLOPS123.5 TFLOPS
Memory TypeGDDR6GDDR7
ArchitectureAda LovelaceBlackwell
FP16 (dense)181.05 TFLOPS61.7 TFLOPS
Form FactorsPCIePCIe
INT8 (dense)362 TOPS246.9 TOPS
InterconnectPCIe 4.0PCIe 5.0
Tensor Cores568192
FP32 Performance90.5 TFLOPS30.9 TFLOPS
Memory Bandwidth864 GB/s672 GB/s
FP4 (with sparsity)Not published987.8 TFLOPS
FP8 (with sparsity)724 TFLOPS246.9 TFLOPS
FP16 (with sparsity)362.1 TFLOPS123.5 TFLOPS
INT8 (with sparsity)724 TOPS493.9 TOPS

Performance Analysis

The FP16 dense performance of the L40 reaches 181.05 TFLOPS compared to 61.7 TFLOPS dense on the RTX 5070. The FP16 figure with sparsity stands at 362.1 TFLOPS for the L40 against 123.5 TFLOPS with sparsity for the RTX 5070. The FP32 rating of 90.5 TFLOPS on the L40 yields a two times ratio to its dense FP16 value while the RTX 5070 maintains the same two times ratio between its 30.9 TFLOPS FP32 and 61.7 TFLOPS dense FP16. Memory bandwidth of 864 GB/s on the L40 exceeds the 672 GB/s on the RTX 5070 and therefore supports larger batch sizes in memory intensive operations. The FP8 dense rating of 362 TFLOPS on the L40 compares directly to 123.5 TFLOPS dense on the RTX 5070 while the corresponding sparsity figures are 724 TFLOPS and 246.9 TFLOPS.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

L40

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
ThunderComputeUSA2$0.79$1.58Deploy
Massed Computeus-central-22$0.86$1.72Deploy
QuantaCloudus-midwest-24$0.94$3.75Deploy
HyperstackCANADA-12$1.00$2.00Deploy

4 providers in stock, 17 offers (cheapest per provider shown). All L40 offers, price history and alerts

RTX 5070

RTX 5070 is not offered on-demand by any provider we track right now. See the RTX 5070 rental page for last-seen listed prices and a price alert.

Which GPU to watchWatch the price of

Notify me when L40 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.79/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the L40

The L40 suits workloads that demand 48 GB of memory such as training models that exceed the 12 GB to 16 GB capacity of the RTX 5070. Its 864 GB/s bandwidth further enables sustained data movement in large batch inference scenarios where the 300 W TDP remains acceptable.

When to Choose the RTX 5070

The RTX 5070 fits environments that prioritize 250 W power draw and PCIe 5.0 interconnect over maximum memory size. Its Blackwell architecture supports FP4 dense performance of 493.9 TFLOPS for emerging low precision tasks that fit within 12 GB to 16 GB.

Use Cases

LLM Training
L40

The L40 supplies 48 GB of memory that exceeds the 12 GB to 16 GB limit of the RTX 5070 and therefore handles larger training batches.

LLM Inference
L40

The L40 delivers 181.05 TFLOPS dense FP16 that surpasses the 61.7 TFLOPS dense FP16 of the RTX 5070 for sustained inference throughput.

Fine-tuning
L40

The L40 offers 362.1 TFLOPS FP16 with sparsity and 48 GB memory that together support fine tuning of models beyond the capacity of the RTX 5070.

Stable Diffusion
RTX 5070

The RTX 5070 provides 493.9 TFLOPS FP4 dense performance within a 250 W TDP that suits image generation workloads fitting in 12 GB to 16 GB.

Scientific Computing
L40

The L40 achieves 90.5 TFLOPS FP32 that doubles the 30.9 TFLOPS FP32 of the RTX 5070 for compute heavy scientific simulations.

Frequently Asked Questions

What is the FP16 dense performance difference between the L40 and RTX 5070?▾

The L40 reaches 181.05 TFLOPS in dense FP16 while the RTX 5070 reaches 61.7 TFLOPS in dense FP16. The ratio favors the L40 by nearly three times for dense tensor operations.

Which GPU has higher memory bandwidth?▾

The L40 provides 864 GB/s of memory bandwidth compared to 672 GB/s on the RTX 5070. Higher bandwidth on the L40 supports increased data throughput in bandwidth limited kernels.

How do the TDP ratings differ between the L40 and RTX 5070?▾

The L40 lists a 300 W TDP while the RTX 5070 lists a 250 W TDP. The lower TDP on the RTX 5070 reduces power requirements in dense deployments.

What FP32 performance does each GPU deliver?▾

The L40 delivers 90.5 TFLOPS in FP32 while the RTX 5070 delivers 30.9 TFLOPS in FP32. The L40 therefore supplies nearly three times the FP32 throughput.

Which interconnect does the RTX 5070 use compared to the L40?▾

The RTX 5070 uses PCIe 5.0 while the L40 uses PCIe 4.0. The newer standard on the RTX 5070 enables higher theoretical transfer rates between host and device.

Which is cheaper to rent, the L40 or the RTX 5070?▾

Cloud rental prices for both the L40 and RTX 5070 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the L40 have compared to the RTX 5070?▾

The L40 has 48 GB of GDDR6 memory. The RTX 5070 has 12 to 16 GB of GDDR7 memory.

Can I find L40 and RTX 5070 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the L40 and the RTX 5070?▾

The L40 uses the Ada Lovelace architecture (2023) while the RTX 5070 uses Blackwell (2025). The L40 delivers 2.9x the dense FP16 throughput (181.05 vs 61.7 TFLOPS, both without sparsity) and 1.3x the memory bandwidth of the RTX 5070.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the L40 and the RTX 5070. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps