Specifications Compared
| Spec | GH200 | L4 |
|---|---|---|
| TDP | 900W | 72W |
| VRAM | 96 GB | 24 GB |
| CUDA Cores | 16,896 | 7,424 |
| FP8 (dense) | 1,979 TFLOPS | 242 TFLOPS |
| Memory Type | HBM3 | GDDR6 |
| Architecture | Hopper | Ada Lovelace |
| FP16 (dense) | 989 TFLOPS | 121 TFLOPS |
| Form Factors | SXM | PCIe |
| INT8 (dense) | 1,979 TOPS | 242 TOPS |
| Interconnect | NVLink-C2C, PCIe 5.0 | PCIe 4.0 |
| Tensor Cores | 528 | 232 |
| FP32 Performance | 67 TFLOPS | 30.3 TFLOPS |
| FP64 Performance | 34 TFLOPS | 0.5 TFLOPS |
| Memory Bandwidth | 4,000 GB/s | 300 GB/s |
| FP8 (with sparsity) | 3,958 TFLOPS | 485 TFLOPS |
| FP16 (with sparsity) | 1,979 TFLOPS | 242 TFLOPS |
| INT8 (with sparsity) | 3,958 TOPS | 485 TOPS |
Performance Analysis
The FP16 dense figure of 989 TFLOPS on the GH200 exceeds the 121 TFLOPS dense figure on the L4 by a factor of eight. This ratio implies the GH200 sustains larger model computations during training or inference when both operate in dense FP16 mode. The same pattern holds for sparse FP16 where the GH200 reaches 1979 TFLOPS against 242 TFLOPS on the L4. Memory bandwidth of 4000 GB/s on the GH200 compared with 300 GB/s on the L4 permits substantially larger batch sizes before memory stalls occur. FP32 throughput at 67 TFLOPS on the GH200 versus 30.3 TFLOPS on the L4 further widens the advantage for precision-sensitive workloads on the GH200.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
GH200
GH200 is not offered on-demand by any provider we track right now. See the GH200 rental page for last-seen listed prices and a price alert.
L4
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| Scaleway | Warsaw, Poland (WAW2) | 2 | $0.89 | $1.77 | Deploy |
| Ori | lille-4 | 1 | $0.93 | — | Deploy |
2 providers in stock, 3 offers (cheapest per provider shown). All L4 offers, price history and alerts
Notify me when GH200 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold.
QuantaCloud
Comparing H-series providers? We broker across all of them.
Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.
When to Choose the GH200
The GH200 suits workloads that require 96 GB HBM3 capacity and 4000 GB/s bandwidth to accommodate large tensors. Its 989 TFLOPS dense FP16 rating supports accelerated training cycles compared with the 121 TFLOPS dense FP16 rating of alternatives. Organizations running scientific computing tasks benefit from the 67 TFLOPS FP32 performance available on this GPU.
When to Choose the L4
The L4 fits deployments constrained by a 72W TDP limit where the 900W TDP of the GH200 proves impractical. Its 24 GB GDDR6 memory and 300 GB/s bandwidth suffice for inference tasks that do not exceed these limits. The PCIe form factor simplifies integration in standard servers without SXM infrastructure.
Use Cases
The GH200 supplies 989 TFLOPS dense FP16 and 96 GB memory that exceed the 121 TFLOPS and 24 GB on the L4.
The GH200 provides 1979 TFLOPS sparse FP16 that surpass the 242 TFLOPS sparse FP16 on the L4 for larger models.
The GH200 delivers 1979 TFLOPS dense FP8 and 4000 GB/s bandwidth that support efficient parameter updates beyond L4 capabilities.
The L4 operates at 72W TDP with 242 TFLOPS dense FP16 sufficient for image generation workloads at lower power.
The GH200 lists 67 TFLOPS FP32 that double the 30.3 TFLOPS FP32 available on the L4.
Frequently Asked Questions
What are the FP16 dense performance numbers?▾
The GH200 reaches 989 TFLOPS dense FP16 and the L4 reaches 121 TFLOPS dense FP16.
Which GPU offers higher memory bandwidth?▾
The GH200 offers 4000 GB/s bandwidth compared with 300 GB/s on the L4.
What TDP values apply to these GPUs?▾
The GH200 carries a 900W TDP and the L4 carries a 72W TDP.
How do the FP32 ratings compare?▾
The GH200 provides 67 TFLOPS FP32 while the L4 provides 30.3 TFLOPS FP32.
Which interconnect does each GPU use?▾
The GH200 uses NVLink-C2C and the L4 uses PCIe 4.0.
Which is cheaper to rent, the GH200 or the L4?▾
Cloud rental prices for both the GH200 and L4 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the GH200 have compared to the L4?▾
The GH200 has 96 GB of HBM3 memory. The L4 has 24 GB of GDDR6 memory.
Can I find GH200 and L4 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the GH200 and the L4?▾
The GH200 uses the Hopper architecture (2023) while the L4 uses Ada Lovelace (2023). The GH200 delivers 8.2x the dense FP16 throughput (989 vs 121 TFLOPS, both without sparsity) and 13.3x the memory bandwidth of the L4.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the GH200 and the L4. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent GH200 Grace HopperEvery current offer by provider, daily price history and a price alert.
- Rent L4Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.