GPU comparison

L40S vs RTX 6000 Ada

Specifications and current cloud pricing, side by side.

Ada LovelacevsAda LovelaceUpdated 33 days ago

The RTX 6000 Ada represents the stronger choice for the most common professional workloads because its 960 GB/s bandwidth exceeds the 864 GB/s of the L40S while its 300W TDP remains lower than the 350W TDP of the L40S.

L40S from $0.97/GPU/hrRTX 6000 Ada from $0.79/GPU/hr

Right now, from live stock

  • Cheapest right now: RTX 6000 Ada at $0.79/hr on Massed Compute

    Deploy
  • Most providers in stock: L40S (4)

    See all offers
  • Best $ per TFLOPS FP16 dense right now: RTX 6000 Ada ($0.0022 per TFLOPS-hour at 364 TFLOPS)

    Deploy

Specifications Compared

SpecL40SRTX 6000 Ada
TDP350W300W
VRAM48 GB48 GB
CUDA Cores18,17618,176
FP8 (dense)733 TFLOPS728.5 TFLOPS
Memory TypeGDDR6GDDR6
ArchitectureAda LovelaceAda Lovelace
FP16 (dense)362.05 TFLOPS364 TFLOPS
Form FactorsPCIePCIe
INT8 (dense)733 TOPS728.5 TOPS
InterconnectPCIe 4.0PCIe 4.0
Tensor Cores568568
FP32 Performance91.6 TFLOPS91.1 TFLOPS
FP64 Performance1.4 TFLOPSNot published
Memory Bandwidth864 GB/s960 GB/s
FP8 (with sparsity)1,466 TFLOPS1,457 TFLOPS
FP16 (with sparsity)733 TFLOPS728 TFLOPS
INT8 (with sparsity)1,466 TOPS1,457 TOPS

Performance Analysis

FP16 dense performance measures 362.05 TFLOPS on the L40S against 364 TFLOPS on the RTX 6000 Ada which produces nearly equivalent throughput for mixed precision training. The FP32 figures of 91.6 TFLOPS and 91.1 TFLOPS likewise indicate comparable results for single precision scientific computing. Memory bandwidth of 864 GB/s versus 960 GB/s directly limits sustainable batch sizes because the higher figure on the RTX 6000 Ada moves more data per second during large tensor operations.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

L40S

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Massed Computeus-central-31$0.97—Deploy
QuantaCloudus-midwest-18$1.09$8.72Deploy
Orilille-41$1.55—Deploy
LyceumEurope1$1.99—Deploy

4 providers in stock, 13 offers (cheapest per provider shown). All L40S offers, price history and alerts

RTX 6000 Ada

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Massed Computeus-central-31$0.79—Deploy
QuantaCloudus-midwest-21$0.79—Deploy
LeaderGPUThe Netherlands8$0.91$7.29Deploy

3 providers in stock, 6 offers (cheapest per provider shown). All RTX 6000 Ada offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when L40S drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.97/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the L40S

The L40S serves workloads that utilize sparse FP16 performance of 733 TFLOPS for accelerated inference with structured sparsity. Its FP8 dense rating of 733 TFLOPS also benefits quantization pipelines that require the extra compute margin over the RTX 6000 Ada.

When to Choose the RTX 6000 Ada

The RTX 6000 Ada suits installations that value 960 GB/s memory bandwidth for data heavy batch processing. Its 300W TDP lowers cooling demands relative to the 350W TDP of the L40S inside densely packed server environments.

Use Cases

LLM Training
RTX 6000 Ada

The RTX 6000 Ada supplies 960 GB/s bandwidth that sustains larger batch sizes during training compared with the 864 GB/s on the L40S.

LLM Inference
L40S

The L40S delivers sparse FP16 performance of 733 TFLOPS that exceeds the 728 TFLOPS of the RTX 6000 Ada for sparsity enabled inference.

Fine-tuning
Either

Both GPUs provide 48 GB GDDR6 memory and FP32 ratings near 91 TFLOPS which support fine tuning at comparable scales.

Stable Diffusion
RTX 6000 Ada

The RTX 6000 Ada offers 960 GB/s bandwidth that improves image generation throughput over the 864 GB/s available on the L40S.

Scientific Computing
L40S

The L40S supplies an FP32 rating of 91.6 TFLOPS that edges out the 91.1 TFLOPS of the RTX 6000 Ada for precision sensitive calculations.

Frequently Asked Questions

What are the TDP ratings of the L40S and RTX 6000 Ada?▾

The L40S carries a 350W TDP. The RTX 6000 Ada carries a 300W TDP.

How does FP16 dense performance compare between these GPUs?▾

The L40S lists FP16 dense performance of 362.05 TFLOPS. The RTX 6000 Ada lists FP16 dense performance of 364 TFLOPS.

Which GPU offers higher sparse FP16 performance?▾

The L40S reaches sparse FP16 performance of 733 TFLOPS. The RTX 6000 Ada reaches sparse FP16 performance of 728 TFLOPS.

What FP8 dense figures appear for each card?▾

The L40S lists FP8 dense performance of 733 TFLOPS. The RTX 6000 Ada lists FP8 dense performance of 728.5 TFLOPS.

Do both GPUs use the same interconnect?▾

Both the L40S and the RTX 6000 Ada employ PCIe 4.0 interconnect in PCIe form factor.

Which is cheaper to rent, the L40S or the RTX 6000 Ada?▾

Cloud rental prices for both the L40S and RTX 6000 Ada vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the L40S have compared to the RTX 6000 Ada?▾

The L40S has 48 GB of GDDR6 memory. The RTX 6000 Ada has 48 GB of GDDR6 memory.

Can I find L40S and RTX 6000 Ada GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the L40S and the RTX 6000 Ada?▾

The L40S uses the Ada Lovelace architecture (2023) while the RTX 6000 Ada uses Ada Lovelace (2022). Both deliver the same dense FP16 throughput (364 TFLOPS without sparsity), and the RTX 6000 Ada has 1.1x the memory bandwidth of the L40S.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the L40S and the RTX 6000 Ada. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps