GPU comparison

L40 vs RTX 4070

Specifications and current cloud pricing, side by side.

Ada LovelacevsAda LovelaceUpdated 31 days ago

The L40 wins for the most common large scale training and inference use cases because its 48 GB memory and 181.05 TFLOPS dense FP16 exceed the RTX 4070 by clear margins in every tensor metric.

L40 listed from $0.79/GPU/hrRTX 4070 listed from $0.50/GPU/hr

Right now, from live stock

  • Cheapest right now: L40 at $0.79/hr on ThunderCompute

    Deploy
  • Most providers in stock: L40 (5)

    See all offers

Specifications Compared

SpecL40RTX 4070
TDP300W200W
VRAM48 GB12-16 GB
CUDA Cores18,1765,888
FP8 (dense)362 TFLOPS116.6 TFLOPS
Memory TypeGDDR6GDDR6X
ArchitectureAda LovelaceAda Lovelace
FP16 (dense)181.05 TFLOPS58.3 TFLOPS
Form FactorsPCIePCIe
INT8 (dense)362 TOPS233.2 TOPS
InterconnectPCIe 4.0PCIe 4.0
Tensor Cores568184
FP32 Performance90.5 TFLOPS29.1 TFLOPS
Memory Bandwidth864 GB/s504 GB/s
FP8 (with sparsity)724 TFLOPS233.2 TFLOPS
FP16 (with sparsity)362.1 TFLOPS116.6 TFLOPS
INT8 (with sparsity)724 TOPS466.4 TOPS

Performance Analysis

Dense FP16 performance reaches 181.05 TFLOPS on the L40 against 58.3 TFLOPS on the RTX 4070. The same ratio appears when sparsity is applied: 362.1 TFLOPS versus 116.6 TFLOPS. FP32 figures remain half the dense FP16 values on each card, confirming the expected doubling from tensor cores. Memory bandwidth of 864 GB/s on the L40 supports larger batch sizes than the 504 GB/s available on the RTX 4070. FP8 dense throughput equals 362 TFLOPS on the L40 and 116.6 TFLOPS on the RTX 4070, preserving the identical three to one advantage.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

L40

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
ThunderComputeUSA1$0.79—Deploy
RunPodglobal1$0.82—Deploy
Massed Computeus-central-32$0.86$1.72Deploy
QuantaCloudus-midwest-24$0.94$3.75Deploy
HyperstackCANADA-14$1.00$4.00Deploy

5 providers in stock, 18 offers (cheapest per provider shown). All L40 offers, price history and alerts

RTX 4070

RTX 4070 is not offered on-demand by any provider we track right now. See the RTX 4070 rental page for last-seen listed prices and a price alert.

Which GPU to watchWatch the price of

Notify me when L40 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.79/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the L40

The L40 suits workloads that require 48 GB of memory and 181.05 TFLOPS dense FP16 throughput. Scientific computing and large model training benefit directly from the 864 GB/s bandwidth and 300 W TDP envelope. INT8 dense performance of 362 TOPS further favors the L40 when quantization is applied.

When to Choose the RTX 4070

The RTX 4070 fits deployments limited to 200 W TDP and 12 to 16 GB memory. Inference tasks that fit within those bounds avoid the higher power draw of 300 W while still delivering 58.3 TFLOPS dense FP16.

Use Cases

LLM Training
L40

The L40 supplies 48 GB memory and 181.05 TFLOPS dense FP16 that accommodate larger models than the 12 to 16 GB and 58.3 TFLOPS on the RTX 4070.

LLM Inference
L40

Fine-tuning
L40

The 48 GB capacity and 181.05 TFLOPS dense FP16 allow full parameter updates that exceed the limits of 12 to 16 GB on the RTX 4070.

Stable Diffusion
RTX 4070

The RTX 4070 meets typical image generation needs inside 16 GB memory at 200 W TDP while the L40 exceeds requirements.

Scientific Computing
L40

FP32 throughput of 90.5 TFLOPS and 864 GB/s bandwidth on the L40 accelerate simulations beyond the 29.1 TFLOPS and 504 GB/s of the RTX 4070.

Frequently Asked Questions

What is the memory bandwidth difference between these two GPUs?▾

The L40 reaches 864 GB/s and the RTX 4070 reaches 504 GB/s.

Which GPU offers higher dense FP16 performance?▾

The L40 delivers 181.05 TFLOPS dense FP16 while the RTX 4070 delivers 58.3 TFLOPS dense FP16.

How do the TDP values compare?▾

The L40 is rated at 300 W and the RTX 4070 is rated at 200 W.

Do both cards support the same interconnect?▾

Both the L40 and the RTX 4070 use PCIe 4.0.

What FP32 performance is listed for each card?▾

The L40 lists 90.5 TFLOPS FP32 and the RTX 4070 lists 29.1 TFLOPS FP32.

Which is cheaper to rent, the L40 or the RTX 4070?▾

Cloud rental prices for both the L40 and RTX 4070 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the L40 have compared to the RTX 4070?▾

The L40 has 48 GB of GDDR6 memory. The RTX 4070 has 12 to 16 GB of GDDR6X memory.

Can I find L40 and RTX 4070 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the L40 and the RTX 4070?▾

The L40 uses the Ada Lovelace architecture (2023) while the RTX 4070 uses Ada Lovelace (2023). The L40 delivers 3.1x the dense FP16 throughput (181.05 vs 58.3 TFLOPS, both without sparsity) and 1.7x the memory bandwidth of the RTX 4070.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the L40 and the RTX 4070. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps