Specifications Compared
| Spec | A40 | GH200 |
|---|---|---|
| TDP | 300W | 900W |
| VRAM | 48 GB | 96 GB |
| CUDA Cores | 10,752 | 16,896 |
| FP8 (dense) | Not published | 1,979 TFLOPS |
| Memory Type | GDDR6 | HBM3 |
| Architecture | Ampere | Hopper |
| FP16 (dense) | 149.7 TFLOPS | 989 TFLOPS |
| Form Factors | PCIe | SXM |
| INT8 (dense) | 299.3 TOPS | 1,979 TOPS |
| Interconnect | NVLink, PCIe 4.0 | NVLink-C2C, PCIe 5.0 |
| Tensor Cores | 336 | 528 |
| FP32 Performance | 37.4 TFLOPS | 67 TFLOPS |
| FP64 Performance | Not published | 34 TFLOPS |
| Memory Bandwidth | 696 GB/s | 4,000 GB/s |
| FP8 (with sparsity) | Not published | 3,958 TFLOPS |
| FP16 (with sparsity) | 299.4 TFLOPS | 1,979 TFLOPS |
| INT8 (with sparsity) | 598.6 TOPS | 3,958 TOPS |
Performance Analysis
The FP16 dense figure of 149.7 TFLOPS on the A40 contrasts with 989 TFLOPS dense on the GH200. The FP16 with sparsity figure of 299.4 TFLOPS on the A40 contrasts with 1979 TFLOPS with sparsity on the GH200. Such deltas indicate the GH200 processes larger batches during training or inference at higher throughput. Memory bandwidth of 696 GB/s on the A40 versus 4000 GB/s on the GH200 affects the feasible batch sizes for memory intensive operations. The FP32 value of 37.4 TFLOPS on the A40 versus 67 TFLOPS on the GH200 further separates their suitability for precision sensitive tasks. INT8 dense performance of 299.3 TOPS on the A40 versus 1979 TOPS on the GH200 follows similar patterns.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A40
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.52 | $4.13 | Deploy |
| RunPod | global | 1 | $0.59 | — | Deploy |
2 providers in stock, 2 offers. All A40 offers, price history and alerts
GH200
GH200 is not offered on-demand by any provider we track right now. See the GH200 rental page for last-seen listed prices and a price alert.
Notify me when A40 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.52/GPU-hr.
QuantaCloud
Comparing H-series providers? We broker across all of them.
Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.
When to Choose the A40
The A40 suits deployments where TDP must remain at 300W. Its PCIe form factor fits standard server slots without SXM requirements. The 48 GB GDDR6 configuration handles moderate scale inference workloads effectively.
When to Choose the GH200
The GH200 suits deployments where 96 GB HBM3 and 4000 GB/s bandwidth enable larger models. Its 900W TDP supports sustained high throughput in dense FP16 at 989 TFLOPS. NVLink C2C interconnect aids multi GPU scaling.
Use Cases
The GH200 supplies 989 TFLOPS dense FP16 and 96 GB HBM3 memory.
The GH200 supplies 1979 TFLOPS with sparsity FP16 and 4000 GB/s bandwidth.
The GH200 supplies 1979 TOPS dense INT8 and 67 TFLOPS FP32.
The A40 supplies 48 GB GDDR6 at 300W TDP for moderate workloads.
The GH200 supplies 67 TFLOPS FP32 and 96 GB HBM3 memory.
Frequently Asked Questions
What is the memory difference between A40 and GH200?▾
The A40 contains 48 GB GDDR6 while the GH200 contains 96 GB HBM3.
How does FP16 performance compare between A40 and GH200?▾
The A40 reaches 149.7 TFLOPS dense FP16 and the GH200 reaches 989 TFLOPS dense FP16.
What TDP values apply to A40 and GH200?▾
The A40 TDP is 300W while the GH200 TDP is 900W.
Which GPU offers higher memory bandwidth?▾
The GH200 offers 4000 GB/s while the A40 offers 696 GB/s.
What form factors distinguish A40 from GH200?▾
The A40 uses PCIe form factor while the GH200 uses SXM form factor.
How do FP32 figures differ for A40 and GH200?▾
The A40 reaches 37.4 TFLOPS FP32 while the GH200 reaches 67 TFLOPS FP32.
Which is cheaper to rent, the A40 or the GH200?▾
Cloud rental prices for both the A40 and GH200 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A40 have compared to the GH200?▾
The A40 has 48 GB of GDDR6 memory. The GH200 has 96 GB of HBM3 memory.
Can I find A40 and GH200 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A40 and the GH200?▾
The A40 uses the Ampere architecture (2020) while the GH200 uses Hopper (2023). The GH200 delivers 6.6x the dense FP16 throughput (989 vs 149.7 TFLOPS, both without sparsity) and 5.7x the memory bandwidth of the A40.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A40 and the GH200. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A40Every current offer by provider, daily price history and a price alert.
- Rent GH200 Grace HopperEvery current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.