GPU comparison

L40 vs RTX 3060

Specifications and current cloud pricing, side by side.

Ada LovelacevsAmpereUpdated 34 days ago

The L40 wins for the most common use case of LLM training and inference. Its 48 GB memory, 181.05 TFLOPS dense FP16, and 864 GB/s bandwidth exceed the RTX 3060 specifications of 8 to 12 GB memory and 12.7 TFLOPS FP32.

L40 from $0.79/GPU/hrRTX 3060 from $0.13/GPU/hr

Right now, from live stock

Specifications Compared

SpecL40RTX 3060
TDP300W170W
VRAM48 GB8-12 GB
CUDA Cores18,1763,584
FP8 (dense)362 TFLOPSNot published
Memory TypeGDDR6GDDR6
ArchitectureAda LovelaceAmpere
FP16 (dense)181.05 TFLOPSNot published
Form FactorsPCIePCIe
INT8 (dense)362 TOPSNot published
InterconnectPCIe 4.0PCIe 4.0
Tensor Cores568112
FP32 Performance90.5 TFLOPS12.7 TFLOPS
Memory Bandwidth864 GB/s360 GB/s
FP8 (with sparsity)724 TFLOPSNot published
FP16 (with sparsity)362.1 TFLOPSNot published
INT8 (with sparsity)724 TOPSNot published

Performance Analysis

The L40 supplies 181.05 TFLOPS in dense FP16 while the RTX 3060 figure for FP16 remains not published by vendor. The L40 supplies 90.5 TFLOPS in FP32 which equals a ratio of 90.5 to 12.7 against the RTX 3060 FP32 value. Memory bandwidth of 864 GB/s on the L40 versus 360 GB/s on the RTX 3060 influences achievable batch sizes during operations. The L40 also lists 362.1 TFLOPS in FP16 with sparsity for workloads that exploit sparsity. TDP values of 300W for the L40 and 170W for the RTX 3060 affect sustained performance in dense FP16 and FP32 calculations.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

L40

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
ThunderComputeUSA1$0.79—Deploy
Massed Computeus-central-31$0.86—Deploy
QuantaCloudus-midwest-24$0.94$3.75Deploy
HyperstackCANADA-11$1.00—Deploy

4 providers in stock, 12 offers (cheapest per provider shown). All L40 offers, price history and alerts

RTX 3060

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Vast.aiTexas, US1$0.13—Deploy

1 provider in stock, 2 offers (cheapest per provider shown). All RTX 3060 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when L40 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.79/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the L40

The L40 suits workloads that require 48 GB GDDR6 memory and 181.05 TFLOPS dense FP16. Training or inference tasks benefit from the 864 GB/s bandwidth and 90.5 TFLOPS FP32 rating when the RTX 3060 12.7 TFLOPS FP32 rating proves insufficient.

When to Choose the RTX 3060

The RTX 3060 suits lighter workloads that fit within 8 to 12 GB GDDR6 memory and operate under a 170W TDP limit. Scenarios with modest FP32 demands of 12.7 TFLOPS align with this GPU when the L40 300W TDP exceeds power constraints.

Use Cases

LLM Training
L40

The L40 supplies 48 GB memory and 181.05 TFLOPS dense FP16 which exceed RTX 3060 limits.

LLM Inference
L40

The L40 delivers 362.1 TFLOPS FP16 with sparsity and 864 GB/s bandwidth for larger models.

Fine-tuning
L40

The L40 90.5 TFLOPS FP32 rating supports fine-tuning at scales beyond the RTX 3060 12.7 TFLOPS FP32.

Stable Diffusion
Either

The RTX 3060 handles basic cases in 12 GB while the L40 manages larger batches with 48 GB.

Scientific Computing
L40

The L40 provides 90.5 TFLOPS FP32 and 300W TDP for sustained dense computations.

Frequently Asked Questions

What is the FP32 performance of each GPU?▾

The L40 reaches 90.5 TFLOPS in FP32. The RTX 3060 reaches 12.7 TFLOPS in FP32.

Which GPU has higher memory bandwidth?▾

The L40 has 864 GB/s memory bandwidth. The RTX 3060 has 360 GB/s memory bandwidth.

What are the TDP ratings for the L40 and RTX 3060?▾

The L40 TDP is 300W. The RTX 3060 TDP is 170W.

Can FP16 figures be compared directly between these GPUs?▾

The L40 lists 181.05 TFLOPS dense FP16 and 362.1 TFLOPS FP16 with sparsity. The RTX 3060 FP16 value is not published by vendor.

Do both GPUs support the same interconnect?▾

Both the L40 and RTX 3060 use PCIe 4.0 interconnect in PCIe form factors.

Which is cheaper to rent, the L40 or the RTX 3060?▾

Cloud rental prices for both the L40 and RTX 3060 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the L40 have compared to the RTX 3060?▾

The L40 has 48 GB of GDDR6 memory. The RTX 3060 has 8 to 12 GB of GDDR6 memory.

Can I find L40 and RTX 3060 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the L40 and the RTX 3060?▾

The L40 uses the Ada Lovelace architecture (2023) while the RTX 3060 uses Ampere (2021). The L40 has 48 GB of GDDR6 at 864 GB/s; the RTX 3060 has 8-12 GB of GDDR6 at 360 GB/s, so the L40 has 2.4x the memory bandwidth of the RTX 3060.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the L40 and the RTX 3060. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps