GPU comparison

A100 SXM4 40GB vs L4

Specifications and current cloud pricing, side by side.

AmperevsAda LovelaceUpdated 34 days ago

This variant comparison is part of the A100 vs L4 family comparison.

The A100 SXM4 40GB wins for the most common use case of LLM training because its 40 GB memory and 2039 GB/s bandwidth exceed the L4 specifications while supporting dense FP16 throughput at 312 TFLOPS.

A100 SXM4 40GB from $0.68/GPU/hrL4 from $0.89/GPU/hr

Right now, from live stock

  • Cheapest right now: A100 SXM4 40GB at $0.68/hr on LeaderGPU

    Deploy
  • Most providers in stock: A100 SXM4 40GB (11)

    See all offers
  • Best $ per TFLOPS FP16 dense right now: A100 SXM4 40GB ($0.0022 per TFLOPS-hour at 312 TFLOPS)

    Deploy

Specifications Compared

SpecA100 SXM4 40GBL4
TDP400W72W
VRAM40 GB24 GB
CUDA Cores6,9127,424
FP8 (dense)Not published242 TFLOPS
Memory TypeHBM2eGDDR6
ArchitectureAmpereAda Lovelace
FP16 (dense)312 TFLOPS121 TFLOPS
Form FactorsSXM4PCIe
INT8 (dense)624 TOPS242 TOPS
InterconnectNVLink, PCIe 4.0, InfiniBandPCIe 4.0
Tensor Cores432232
FP32 Performance19.5 TFLOPS30.3 TFLOPS
FP64 Performance9.7 TFLOPS0.5 TFLOPS
Memory Bandwidth2,039 GB/s300 GB/s
FP8 (with sparsity)Not published485 TFLOPS
FP16 (with sparsity)624 TFLOPS242 TFLOPS
INT8 (with sparsity)1,248 TOPS485 TOPS

Performance Analysis

The A100 family delivers FP16 dense performance at 312 TFLOPS compared to the L4 family at 121 TFLOPS while FP16 with sparsity reaches 624 TFLOPS on the A100 family versus 242 TFLOPS on the L4 family. FP32 performance stands at 19.5 TFLOPS for the A100 family and 30.3 TFLOPS for the L4 family. Memory bandwidth of 2039 GB/s on the A100 family supports larger batch sizes than the 300 GB/s bandwidth on the L4 family during both training and inference workloads.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

A100 SXM4 40GB

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
LeaderGPUThe Netherlands8$0.68$5.42Deploy
Vast.aiCzechia, CZ1$0.73—Deploy
ThunderComputeUSA1$1.09—Deploy
HyperstackCANADA-12$1.35$2.70Deploy
Massed Computeus-east-11$1.38—Deploy

11 providers in stock, 34 offers (cheapest per provider shown). All A100 SXM4 40GB offers, price history and alerts

L4

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
ScalewayWarsaw, Poland (WAW2)1$0.89—Deploy
Orilille-41$0.93—Deploy

2 providers in stock, 2 offers. All L4 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when A100 SXM4 40GB drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.68/GPU-hr.

QuantaCloud

Comparing A100 providers? We broker across all of them.

Need 16+ A100s reserved for fine-tuning, simulation, or production inference? We quote volume pricing across multiple data center partners: one quote at partner rates, 24h turnaround.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the A100 SXM4 40GB

The A100 SXM4 40GB suits workloads that require 40 GB HBM2e capacity and 2039 GB/s bandwidth such as large model training. Its 400W TDP and NVLink interconnect enable scaling across multiple GPUs for memory intensive tasks.

When to Choose the L4

The L4 fits deployments that prioritize 72W TDP and 24 GB GDDR6 capacity in PCIe form factor. Its higher FP32 figure of 30.3 TFLOPS benefits certain inference scenarios with lower power constraints.

Use Cases

LLM Training
A100 SXM4 40GB

The A100 SXM4 40GB supplies 40 GB HBM2e and 2039 GB/s bandwidth that exceed L4 figures for large model training.

LLM Inference
L4

The L4 operates at 72W TDP with FP32 performance at 30.3 TFLOPS that suits power constrained inference.

Fine-tuning
A100 SXM4 40GB

The A100 SXM4 40GB offers 40 GB memory capacity and NVLink interconnect for fine tuning large models.

Stable Diffusion
Either

Both GPUs handle Stable Diffusion yet the L4 provides lower 72W TDP while the A100 SXM4 40GB supplies higher memory bandwidth.

Scientific Computing
A100 SXM4 40GB

The A100 SXM4 40GB delivers 2039 GB/s bandwidth and 312 TFLOPS dense FP16 that accelerate scientific workloads.

Frequently Asked Questions

How does FP16 dense performance compare between these GPUs?▾

The A100 family achieves 312 TFLOPS dense FP16 and the L4 family achieves 121 TFLOPS dense FP16.

What TDP values apply to the A100 SXM4 40GB and L4?▾

The A100 family operates at 400W TDP and the L4 family operates at 72W TDP.

Which interconnect does the A100 SXM4 40GB variant support?▾

The A100 SXM4 40GB variant supports NVLink while the L4 variant supports only PCIe 4.0.

What memory bandwidth figures apply to each GPU family?▾

The A100 family provides 2039 GB/s bandwidth and the L4 family provides 300 GB/s bandwidth.

How do FP32 figures differ between the A100 and L4 families?▾

The A100 family reaches 19.5 TFLOPS FP32 while the L4 family reaches 30.3 TFLOPS FP32.

Which is cheaper to rent, the A100 SXM4 40GB or the L4?▾

Cloud rental prices for both the A100 SXM4 40GB and L4 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the A100 SXM4 40GB have compared to the L4?▾

The A100 SXM4 40GB has 40 GB of HBM2e memory. The L4 has 24 GB of GDDR6 memory.

Can I find A100 SXM4 40GB and L4 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the A100 SXM4 40GB and the L4?▾

The A100 SXM4 40GB uses the Ampere architecture (2020) while the L4 uses Ada Lovelace (2023). The A100 SXM4 40GB delivers 2.6x the dense FP16 throughput (312 vs 121 TFLOPS, both without sparsity) and 6.8x the memory bandwidth of the L4.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the A100 SXM4 40GB and the L4. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps