Specifications Compared
| Spec | Gaudi 2 | L40S |
|---|---|---|
| TDP | 600W | 350W |
| VRAM | 96 GB | 48 GB |
| CUDA Cores | Not published | 18,176 |
| FP8 (dense) | Not published | 733 TFLOPS |
| Memory Type | HBM2e | GDDR6 |
| Architecture | Gaudi | Ada Lovelace |
| FP16 (dense) | Not published | 362.05 TFLOPS |
| Form Factors | OAM | PCIe |
| INT8 (dense) | Not published | 733 TOPS |
| Interconnect | RoCE Ethernet, PCIe 4.0 | PCIe 4.0 |
| Tensor Cores | Not published | 568 |
| FP32 Performance | Not published | 91.6 TFLOPS |
| FP64 Performance | Not published | 1.4 TFLOPS |
| Memory Bandwidth | 2,450 GB/s | 864 GB/s |
| FP8 (with sparsity) | Not published | 1,466 TFLOPS |
| FP16 (with sparsity) | Not published | 733 TFLOPS |
| INT8 (with sparsity) | Not published | 1,466 TOPS |
Performance Analysis
The L40S delivers dense FP16 performance at 362.05 TFLOPS and dense FP8 performance at 733 TFLOPS. The Gaudi 2 does not publish equivalent tensor figures so direct compute ratios remain unavailable. Memory bandwidth differences affect batch sizes because the Gaudi 2 provides 2450 GB/s while the L40S provides 864 GB/s. Higher TDP on the Gaudi 2 at 600 W compared with 350 W on the L40S influences sustained operation in dense versus sparse modes where the L40S lists sparse FP16 at 733 TFLOPS.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
Gaudi 2
Gaudi 2 is not offered on-demand by any provider we track right now. See the Gaudi 2 rental page for last-seen listed prices and a price alert.
L40S
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| Massed Compute | us-central-3 | 4 | $0.97 | $3.88 | Deploy |
| QuantaCloud | us-midwest-1 | 8 | $1.09 | $8.72 | Deploy |
| Ori | lille-4 | 1 | $1.55 | — | Deploy |
| Lyceum | Europe | 1 | $1.99 | — | Deploy |
4 providers in stock, 17 offers (cheapest per provider shown). All L40S offers, price history and alerts
Notify me when Gaudi 2 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold.
QuantaCloud
Comparing providers? We broker across all of them.
Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.
When to Choose the Gaudi 2
The Gaudi 2 suits workloads that require 96 GB memory capacity together with 2450 GB/s bandwidth. Its OAM form factor and RoCE Ethernet interconnect support large scale deployments where memory volume exceeds 48 GB.
When to Choose the L40S
The L40S suits workloads that require published dense FP16 at 362.05 TFLOPS or dense FP8 at 733 TFLOPS. Its 350 W TDP and PCIe form factor fit environments that prioritize lower power draw over maximum memory capacity.
Use Cases
The Gaudi 2 supplies 96 GB memory which exceeds the 48 GB on the L40S.
The L40S provides dense FP16 at 362.05 TFLOPS and dense FP8 at 733 TFLOPS.
The L40S lists dense FP16 at 362.05 TFLOPS within a 350 W TDP.
Both cards support FP32 workloads though the L40S publishes 91.6 TFLOPS while the Gaudi 2 does not.
Frequently Asked Questions
What is the TDP of the L40S?▾
The L40S TDP is 350 W. The Gaudi 2 TDP is 600 W.
Does the Gaudi 2 publish FP16 figures?▾
The Gaudi 2 does not publish FP16 figures. The L40S lists dense FP16 at 362.05 TFLOPS and sparse FP16 at 733 TFLOPS.
What interconnect does the Gaudi 2 support?▾
The Gaudi 2 supports RoCE Ethernet in addition to PCIe 4.0. The L40S supports only PCIe 4.0.
Which GPU has higher memory bandwidth?▾
The Gaudi 2 has 2450 GB/s bandwidth. The L40S has 864 GB/s bandwidth.
Which is cheaper to rent, the Gaudi 2 or the L40S?▾
Cloud rental prices for both the Gaudi 2 and L40S vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the Gaudi 2 have compared to the L40S?▾
The Gaudi 2 has 96 GB of HBM2e memory. The L40S has 48 GB of GDDR6 memory.
Can I find Gaudi 2 and L40S GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the Gaudi 2 and the L40S?▾
The Gaudi 2 uses the Gaudi architecture (2022) while the L40S uses Ada Lovelace (2023). The Gaudi 2 has 96 GB of HBM2e at 2,450 GB/s; the L40S has 48 GB of GDDR6 at 864 GB/s, so the Gaudi 2 has 2.8x the memory bandwidth of the L40S.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the Gaudi 2 and the L40S. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent GAUDI2Every current offer by provider, daily price history and a price alert.
- Rent L40SEvery current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.