GPU comparison

L40S vs RTX A4500

Specifications and current cloud pricing, side by side.

Ada LovelacevsAmpereUpdated 32 days ago

This variant comparison is part of the L40S vs RTX A4000 family comparison.

The L40S variant wins for the most common use case of LLM inference because its 48 GB memory and 362.05 TFLOPS dense FP16 rating exceed the RTX A4500 specifications by wide margins. The higher bandwidth of 864 GB/s further supports sustained throughput advantages in production deployments.

L40S from $0.97/GPU/hrRTX A4500 from $0.76/GPU/hr

Right now, from live stock

  • Cheapest right now: RTX A4500 at $0.76/hr on Paperspace

    Deploy
  • Most providers in stock: L40S (5)

    See all offers

Specifications Compared

SpecL40SRTX A4500
TDP350W140W
VRAM48 GB20 GB
CUDA Cores18,1766,144
FP8 (dense)733 TFLOPSNot published
Memory TypeGDDR6GDDR6
ArchitectureAda LovelaceAmpere
FP16 (dense)362.05 TFLOPSNot published
Form FactorsPCIePCIe
INT8 (dense)733 TOPSNot published
InterconnectPCIe 4.0Not published
Tensor Cores568192
FP32 Performance91.6 TFLOPS19.2 TFLOPS
FP64 Performance1.4 TFLOPSNot published
Memory Bandwidth864 GB/s448 GB/s
FP8 (with sparsity)1,466 TFLOPSNot published
FP16 (with sparsity)733 TFLOPSNot published
INT8 (with sparsity)1,466 TOPSNot published
FP16 (vendor figure, sparsity not specified)Not published19.2 TFLOPS

Performance Analysis

The L40S reports dense FP16 performance at 362.05 TFLOPS compared with the RTX A4500 FP16 figure of 19.2 TFLOPS. This gap means the L40S processes matrix operations more than eighteen times faster in dense mode during training or inference steps. The RTX A4500 FP32 rating stands at 19.2 TFLOPS against the L40S FP32 rating of 91.6 TFLOPS. Memory bandwidth of 864 GB/s on the L40S family supports larger batch sizes than the 448 GB/s available on the RTX A4500 family. The L40S also lists dense FP8 at 733 TFLOPS and dense INT8 at 733 TOPS while the RTX A4500 provides no equivalent sparsity labeled figures.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

L40S

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Massed Computeus-central-32$0.97$1.94Deploy
RunPodglobal1$1.09—Deploy
QuantaCloudus-midwest-11$1.09—Deploy
Orilille-41$1.55—Deploy
LyceumEurope1$1.99—Deploy

5 providers in stock, 16 offers (cheapest per provider shown). All L40S offers, price history and alerts

RTX A4500

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Paperspaceny22$0.76$1.52Deploy

1 provider in stock, 6 offers (cheapest per provider shown). All RTX A4500 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when L40S drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.97/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the L40S

Its 864 GB/s bandwidth enables larger batch processing than the RTX A4500 alternative. Workloads involving FP8 or INT8 operations gain from the 733 TFLOPS dense ratings shared across the L40S family.

When to Choose the RTX A4500

The RTX A4500 variant fits inference tasks where 140 W TDP keeps power draw lower than the 350 W TDP of the L40S family. Its 20 GB memory capacity handles moderate model sizes without excess overhead. Scientific computing jobs that rely on 19.2 TFLOPS FP32 performance operate efficiently within this power envelope.

Use Cases

LLM Training
L40S

The L40S supplies 48 GB memory and 362.05 TFLOPS dense FP16 that accommodate large models and batches.

LLM Inference
L40S

The L40S 864 GB/s bandwidth and 733 TFLOPS dense FP8 rating sustain higher token throughput than the RTX A4500.

Fine-tuning
L40S

The L40S 48 GB capacity and 91.6 TFLOPS FP32 rating handle gradient updates on sizable datasets.

Stable Diffusion
L40S

The L40S 362.05 TFLOPS dense FP16 performance accelerates image generation steps beyond the 19.2 TFLOPS of the RTX A4500.

Scientific Computing
RTX A4500

The RTX A4500 140 W TDP and 19.2 TFLOPS FP32 rating suit sustained simulations at lower power.

Frequently Asked Questions

What memory capacities distinguish the L40S from the RTX A4500?▾

The L40S variant holds 48 GB GDDR6 while the RTX A4500 variant holds 20 GB GDDR6. This 28 GB difference affects maximum model sizes that fit in memory during training or inference.

How do the FP16 figures compare between these GPUs?▾

The L40S lists 362.05 TFLOPS in dense FP16 mode. The RTX A4500 lists 19.2 TFLOPS for FP16 without a sparsity label. Direct comparison uses the dense value on the L40S against the provided figure on the RTX A4500.

What TDP values apply to each GPU family?▾

The L40S family TDP stands at 350 W. The RTX A4500 family TDP stands at 140 W. These figures remain consistent across variants within each family.

Which architecture powers the L40S versus the RTX A4500?▾

The L40S uses Ada Lovelace architecture released in 2023. The RTX A4500 uses Ampere architecture released in 2021. The generational gap contributes to the tensor performance differences observed in the specifications.

How does memory bandwidth affect batch sizes on these cards?▾

The L40S family bandwidth of 864 GB/s supports larger batches than the 448 GB/s bandwidth of the RTX A4500 family. Higher bandwidth reduces data movement stalls during matrix multiplications in training loops.

Which is cheaper to rent, the L40S or the RTX A4500?▾

Cloud rental prices for both the L40S and RTX A4500 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the L40S have compared to the RTX A4500?▾

The L40S has 48 GB of GDDR6 memory. The RTX A4500 has 20 GB of GDDR6 memory.

Can I find L40S and RTX A4500 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the L40S and the RTX A4500?▾

The L40S uses the Ada Lovelace architecture (2023) while the RTX A4500 uses Ampere (2021). The L40S has 48 GB of GDDR6 at 864 GB/s; the RTX A4500 has 20 GB of GDDR6 at 448 GB/s, so the L40S has 1.9x the memory bandwidth of the RTX A4500.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the L40S and the RTX A4500. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps