GPU comparison

L40 vs RTX 2070

Specifications and current cloud pricing, side by side.

Ada LovelacevsTuringUpdated 34 days ago

The L40 delivers the stronger choice for the most common use case of LLM inference. Its 48 GB GDDR6 memory and 181.05 TFLOPS FP16 dense rating accommodate larger models and higher throughput than the 8 GB and 29.9 TFLOPS FP16 dense rating of the RTX 2070.

L40 listed from $0.79/GPU/hr

Right now, from live stock

  • Cheapest right now: L40 at $0.79/hr on ThunderCompute

    Deploy
  • Most providers in stock: L40 (4)

    See all offers

Specifications Compared

SpecL40RTX 2070
TDP300W175W
VRAM48 GB8 GB
CUDA Cores18,1762,304
FP8 (dense)362 TFLOPSNot published
Memory TypeGDDR6GDDR6
ArchitectureAda LovelaceTuring
FP16 (dense)181.05 TFLOPS29.9 TFLOPS
Form FactorsPCIePCIe
INT8 (dense)362 TOPS119.4 TOPS
InterconnectPCIe 4.0PCIe 3.0
Tensor Cores568288
FP32 Performance90.5 TFLOPS7.5 TFLOPS
Memory Bandwidth864 GB/s448 GB/s
FP8 (with sparsity)724 TFLOPSNot published
FP16 (with sparsity)362.1 TFLOPSNot published
INT8 (with sparsity)724 TOPSNot published

Performance Analysis

The FP16 dense figure of 181.05 TFLOPS on the L40 surpasses the FP16 dense figure of 29.9 TFLOPS on the RTX 2070. This ratio supports faster matrix operations in training and inference when both GPUs run dense FP16 workloads. The FP32 rating of 90.5 TFLOPS on the L40 likewise exceeds the 7.5 TFLOPS FP32 rating on the RTX 2070. Memory bandwidth of 864 GB/s on the L40 versus 448 GB/s on the RTX 2070 permits larger batch sizes before data movement becomes limiting. INT8 dense performance of 362 TOPS on the L40 exceeds the 119.4 TOPS INT8 dense rating on the RTX 2070.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

L40

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
ThunderComputeUSA2$0.79$1.58Deploy
Massed Computeus-central-32$0.86$1.72Deploy
QuantaCloudus-midwest-24$0.94$3.75Deploy
HyperstackCANADA-11$1.00—Deploy

4 providers in stock, 15 offers (cheapest per provider shown). All L40 offers, price history and alerts

RTX 2070

RTX 2070 is not offered on-demand by any provider we track right now. See the RTX 2070 rental page for last-seen listed prices and a price alert.

Which GPU to watchWatch the price of

Notify me when L40 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.79/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the L40

The L40 suits workloads that require the 48 GB GDDR6 capacity and the 864 GB/s bandwidth. Training or inference tasks that exceed 8 GB benefit directly from the larger memory pool on the L40. The 90.5 TFLOPS FP32 rating further accelerates scientific computing kernels compared with the 7.5 TFLOPS FP32 rating on the RTX 2070.

When to Choose the RTX 2070

The RTX 2070 fits lighter inference or fine tuning jobs that remain within the 8 GB GDDR6 limit. Its 175W TDP allows deployment in systems with tighter power budgets than the 300W TDP of the L40. The PCIe 3.0 interconnect remains adequate for modest batch sizes that do not saturate the 448 GB/s bandwidth.

Use Cases

LLM Training
L40

The 48 GB GDDR6 capacity and 181.05 TFLOPS FP16 dense rating on the L40 exceed the 8 GB and 29.9 TFLOPS FP16 dense rating on the RTX 2070.

LLM Inference
L40

The 864 GB/s bandwidth and 362 TOPS INT8 dense rating on the L40 support larger batches than the 448 GB/s and 119.4 TOPS INT8 dense rating on the RTX 2070.

Fine-tuning
L40

The 48 GB GDDR6 memory on the L40 accommodates model updates that exceed the 8 GB limit of the RTX 2070.

Stable Diffusion
L40

The 181.05 TFLOPS FP16 dense rating on the L40 processes higher resolution images faster than the 29.9 TFLOPS FP16 dense rating on the RTX 2070.

Scientific Computing
L40

The 90.5 TFLOPS FP32 rating on the L40 accelerates double precision workloads beyond the 7.5 TFLOPS FP32 rating on the RTX 2070.

Frequently Asked Questions

What is the FP32 performance difference between the L40 and the RTX 2070?▾

The L40 reaches 90.5 TFLOPS in FP32 while the RTX 2070 reaches 7.5 TFLOPS in FP32.

Which GPU has higher memory bandwidth?▾

The L40 provides 864 GB/s of memory bandwidth whereas the RTX 2070 provides 448 GB/s of memory bandwidth.

What are the TDP ratings for the L40 and the RTX 2070?▾

The L40 lists a TDP of 300W and the RTX 2070 lists a TDP of 175W.

Does the L40 support FP8 operations?▾

The L40 lists FP8 dense performance at 362 TFLOPS while the RTX 2070 does not publish an FP8 figure.

What interconnect does each GPU use?▾

The L40 uses PCIe 4.0 and the RTX 2070 uses PCIe 3.0.

Which is cheaper to rent, the L40 or the RTX 2070?▾

Cloud rental prices for both the L40 and RTX 2070 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the L40 have compared to the RTX 2070?▾

The L40 has 48 GB of GDDR6 memory. The RTX 2070 has 8 GB of GDDR6 memory.

Can I find L40 and RTX 2070 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the L40 and the RTX 2070?▾

The L40 uses the Ada Lovelace architecture (2023) while the RTX 2070 uses Turing (2018). The L40 delivers 6.1x the dense FP16 throughput (181.05 vs 29.9 TFLOPS, both without sparsity) and 1.9x the memory bandwidth of the RTX 2070.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the L40 and the RTX 2070. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps