Specifications Compared
| Spec | GH200 | L40S |
|---|---|---|
| TDP | 900W | 350W |
| VRAM | 96 GB | 48 GB |
| CUDA Cores | 16,896 | 18,176 |
| FP8 (dense) | 1,979 TFLOPS | 733 TFLOPS |
| Memory Type | HBM3 | GDDR6 |
| Architecture | Hopper | Ada Lovelace |
| FP16 (dense) | 989 TFLOPS | 362.05 TFLOPS |
| Form Factors | SXM | PCIe |
| INT8 (dense) | 1,979 TOPS | 733 TOPS |
| Interconnect | NVLink-C2C, PCIe 5.0 | PCIe 4.0 |
| Tensor Cores | 528 | 568 |
| FP32 Performance | 67 TFLOPS | 91.6 TFLOPS |
| FP64 Performance | 34 TFLOPS | 1.4 TFLOPS |
| Memory Bandwidth | 4,000 GB/s | 864 GB/s |
| FP8 (with sparsity) | 3,958 TFLOPS | 1,466 TFLOPS |
| FP16 (with sparsity) | 1,979 TFLOPS | 733 TFLOPS |
| INT8 (with sparsity) | 3,958 TOPS | 1,466 TOPS |
Performance Analysis
The GH200 records 2.73 times the dense FP16 throughput of the L40S at 989 TFLOPS dense FP16 versus 362.05 TFLOPS dense FP16. The same ratio holds for sparse figures where the GH200 reaches 1979 TFLOPS with sparsity against the L40S at 733 TFLOPS with sparsity. Higher memory bandwidth on the GH200 at 4000 GB/s compared with 864 GB/s on the L40S permits larger batch sizes during tensor operations. The L40S instead records higher FP32 throughput at 91.6 TFLOPS than the GH200 at 67 TFLOPS.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
GH200
1 provider in stock, 2 offers (cheapest per provider shown). All GH200 offers, price history and alerts
L40S
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| Massed Compute | us-central-3 | 4 | $0.97 | $3.88 | Deploy |
| QuantaCloud | us-midwest-2 | 1 | $1.09 | — | Deploy |
| RunPod | global | 1 | $1.09 | — | Deploy |
| Ori | lille-4 | 1 | $1.55 | — | Deploy |
| VERDA | FIN-HEL | 1 | $1.74 | — | Deploy |
6 providers in stock, 19 offers (cheapest per provider shown). All L40S offers, price history and alerts
Notify me when GH200 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $1.99/GPU-hr.
QuantaCloud
Comparing H-series providers? We broker across all of them.
Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.
When to Choose the GH200
The GH200 suits LLM training workloads that require 96 GB HBM3 capacity and 4000 GB/s bandwidth to sustain large models. Its 1979 TFLOPS with sparsity in FP16 also accelerates inference steps that benefit from the higher dense FP8 rating of 1979 TFLOPS.
When to Choose the L40S
The L40S fits scientific computing tasks that value its 91.6 TFLOPS FP32 rating over the GH200 67 TFLOPS FP32 rating. Its 350W TDP further supports deployments where power limits constrain the 900W TDP of the GH200.
Use Cases
The GH200 provides 96 GB HBM3 memory and 4000 GB/s bandwidth that exceed L40S values by a factor of two.
The GH200 delivers 1979 TFLOPS with sparsity in FP16 that exceed the L40S value of 733 TFLOPS with sparsity.
The GH200 supplies 1979 TFLOPS dense FP8 that exceed the L40S value of 733 TFLOPS dense FP8.
The L40S operates at 350W TDP that remains lower than the GH200 TDP of 900W.
The L40S records 91.6 TFLOPS FP32 that exceed the GH200 value of 67 TFLOPS FP32.
Frequently Asked Questions
What is the memory bandwidth difference between the two GPUs?▾
The GH200 reaches 4000 GB/s bandwidth while the L40S reaches 864 GB/s bandwidth.
Which GPU offers higher dense FP16 performance?▾
The GH200 offers 989 TFLOPS dense FP16 while the L40S offers 362.05 TFLOPS dense FP16.
How do the TDP ratings compare?▾
The GH200 lists a 900W TDP while the L40S lists a 350W TDP.
What interconnect does each GPU use?▾
The GH200 uses NVLink-C2C and PCIe 5.0 while the L40S uses PCIe 4.0.
Which GPU records higher FP32 throughput?▾
The L40S records 91.6 TFLOPS FP32 while the GH200 records 67 TFLOPS FP32.
Which is cheaper to rent, the GH200 or the L40S?▾
Cloud rental prices for both the GH200 and L40S vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the GH200 have compared to the L40S?▾
The GH200 has 96 GB of HBM3 memory. The L40S has 48 GB of GDDR6 memory.
Can I find GH200 and L40S GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the GH200 and the L40S?▾
The GH200 uses the Hopper architecture (2023) while the L40S uses Ada Lovelace (2023). The GH200 delivers 2.7x the dense FP16 throughput (989 vs 362.05 TFLOPS, both without sparsity) and 4.6x the memory bandwidth of the L40S.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the GH200 and the L40S. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent GH200 Grace HopperEvery current offer by provider, daily price history and a price alert.
- Rent L40SEvery current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.