GPU comparison

L40S vs RTX 3090 Ti

Specifications and current cloud pricing, side by side.

Ada LovelacevsAmpereUpdated 32 days ago

This variant comparison is part of the L40S vs RTX 3090 family comparison.

The L40S variant wins for the most common use case of LLM inference because its 48 GB capacity and 362.05 TFLOPS dense FP16 throughput exceed the corresponding figures of the RTX 3090 Ti by substantial margins while both share identical 350 W TDP values.

L40S from $0.97/GPU/hrRTX 3090 Ti from $0.29/GPU/hr

Right now, from live stock

  • Cheapest right now: RTX 3090 Ti at $0.29/hr on LeaderGPU

    Deploy
  • Most providers in stock: L40S (6)

    See all offers

Specifications Compared

SpecL40SRTX 3090 Ti
TDP350W350W
VRAM48 GB24 GB
CUDA Cores18,17610,496
FP8 (dense)733 TFLOPSNot published
Memory TypeGDDR6GDDR6X
ArchitectureAda LovelaceAmpere
FP16 (dense)362.05 TFLOPSNot published
Form FactorsPCIePCIe
INT8 (dense)733 TOPSNot published
InterconnectPCIe 4.0NVLink
Tensor Cores568328
FP32 Performance91.6 TFLOPS35.6 TFLOPS
FP64 Performance1.4 TFLOPSNot published
Memory Bandwidth864 GB/s936 GB/s
FP8 (with sparsity)1,466 TFLOPSNot published
FP16 (with sparsity)733 TFLOPSNot published
INT8 (with sparsity)1,466 TOPSNot published
FP16 (vendor figure, sparsity not specified)Not published35.6 TFLOPS

Performance Analysis

The L40S delivers 362.05 TFLOPS dense FP16 performance compared with the 35.6 TFLOPS FP16 figure of the RTX 3090 Ti while the L40S also reaches 91.6 TFLOPS FP32 against the 35.6 TFLOPS FP32 of the RTX 3090 Ti. This dense FP16 advantage means the L40S can process larger matrix operations in training workloads at higher throughput than the RTX 3090 Ti. The RTX 3090 Ti memory bandwidth of 936 GB per second exceeds the 864 GB per second bandwidth of the L40S family which can support modestly larger batch sizes in memory bound inference tasks. The L40S further supplies 733 TFLOPS FP16 with sparsity and 1466 TFLOPS FP8 with sparsity figures that have no direct counterpart in the RTX 3090 Ti specifications.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

L40S

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Massed Computeus-central-34$0.97$3.88Deploy
QuantaCloudus-midwest-21$1.09—Deploy
RunPodglobal1$1.09—Deploy
Orilille-41$1.55—Deploy
VERDAFIN-HEL1$1.77—Deploy

6 providers in stock, 19 offers (cheapest per provider shown). All L40S offers, price history and alerts

RTX 3090 Ti

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
LeaderGPUThe Netherlands8$0.29$2.29Deploy
Vast.aiCzechia, CZ8$0.37$2.97Deploy

2 providers in stock, 11 offers (cheapest per provider shown). All RTX 3090 Ti offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when L40S drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.97/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the L40S

The L40S variant suits workloads that require the 48 GB GDDR6 capacity and 362.05 TFLOPS dense FP16 throughput for handling large models on a single card. Its Ada Lovelace architecture and 733 TOPS dense INT8 rating support efficient inference pipelines where the 24 GB limit of the RTX 3090 Ti would force model partitioning.

When to Choose the RTX 3090 Ti

The RTX 3090 Ti variant fits scenarios that benefit from its 936 GB per second memory bandwidth and NVLink interconnect when paired with compatible systems for multi GPU scaling. Its 35.6 TFLOPS FP32 performance remains adequate for smaller scale scientific simulations that do not demand the higher tensor rates of the L40S.

Use Cases

LLM Training
L40S

The L40S supplies 48 GB GDDR6 and 362.05 TFLOPS dense FP16 which accommodate larger models without splitting across cards unlike the 24 GB limit of the RTX 3090 Ti.

LLM Inference
L40S

The L40S achieves 733 TFLOPS FP8 dense performance and 48 GB capacity enabling higher throughput for quantized models than the 35.6 TFLOPS FP16 of the RTX 3090 Ti.

Fine-tuning
L40S

The L40S 362.05 TFLOPS dense FP16 rating combined with 48 GB memory supports full parameter updates on bigger datasets where the RTX 3090 Ti 24 GB capacity restricts batch sizes.

Stable Diffusion
Either

Both GPUs share 350 W TDP and PCIe form factor while the L40S higher tensor rates balance against the RTX 3090 Ti 936 GB per second bandwidth for image generation tasks.

Scientific Computing
RTX 3090 Ti

The RTX 3090 Ti provides 35.6 TFLOPS FP32 and NVLink interconnect that align with traditional HPC codes needing the 936 GB per second bandwidth over the L40S tensor focused design.

Frequently Asked Questions

What is the memory difference between L40S and RTX 3090 Ti?▾

The L40S variant holds 48 GB GDDR6 while the RTX 3090 Ti variant holds 24 GB GDDR6X. Both families share PCIe form factor construction and 350 W TDP ratings.

How does FP16 performance compare on these GPUs?▾

The L40S reaches 362.05 TFLOPS dense FP16 and 733 TFLOPS FP16 with sparsity. The RTX 3090 Ti lists 35.6 TFLOPS FP16 without a sparsity specification.

Which GPU has higher memory bandwidth?▾

The RTX 3090 family lists 936 GB per second bandwidth while the L40S family lists 864 GB per second. These figures apply across all variants within each family.

Do both GPUs use the same interconnect?▾

The L40S variant uses PCIe 4.0 interconnect while the RTX 3090 Ti variant uses NVLink. Both maintain PCIe form factor construction.

Which is cheaper to rent, the L40S or the RTX 3090 Ti?▾

Cloud rental prices for both the L40S and RTX 3090 Ti vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the L40S have compared to the RTX 3090 Ti?▾

The L40S has 48 GB of GDDR6 memory. The RTX 3090 Ti has 24 GB of GDDR6X memory.

Can I find L40S and RTX 3090 Ti GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the L40S and the RTX 3090 Ti?▾

The L40S uses the Ada Lovelace architecture (2023) while the RTX 3090 Ti uses Ampere (2020). The L40S delivers 5.1x the dense FP16 throughput (362.05 vs 71 TFLOPS, both without sparsity) while the RTX 3090 Ti has 1.1x the memory bandwidth of the L40S.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the L40S and the RTX 3090 Ti. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps