Specifications Compared
| Spec | A40 | MI300X |
|---|---|---|
| TDP | 300W | 750W |
| VRAM | 48 GB | 192 GB |
| CUDA Cores | 10,752 | Not published |
| FP8 (dense) | Not published | 2,614.9 TFLOPS |
| Memory Type | GDDR6 | HBM3 |
| Architecture | Ampere | CDNA 3 |
| FP16 (dense) | 149.7 TFLOPS | 1,307.4 TFLOPS |
| Form Factors | PCIe | OAM |
| INT8 (dense) | 299.3 TOPS | 2,614.9 TOPS |
| Interconnect | NVLink, PCIe 4.0 | Infinity Fabric, PCIe 5.0 |
| Tensor Cores | 336 | Not published |
| FP32 Performance | 37.4 TFLOPS | 163.4 TFLOPS |
| FP64 Performance | Not published | 81.7 TFLOPS |
| Memory Bandwidth | 696 GB/s | 5,300 GB/s |
| FP8 (with sparsity) | Not published | 5,229.8 TFLOPS |
| FP16 (with sparsity) | 299.4 TFLOPS | 2,614.9 TFLOPS |
| INT8 (with sparsity) | 598.6 TOPS | 5,229.8 TOPS |
Performance Analysis
The FP16 dense figure of 149.7 TFLOPS on the A40 versus 1307.4 TFLOPS on the MI300X indicates the MI300X can process larger matrix operations per second during training or inference passes. FP32 performance follows the same pattern at 37.4 TFLOPS for the A40 and 163.4 TFLOPS for the MI300X. Memory bandwidth of 696 GB/s on the A40 compared with 5300 GB/s on the MI300X allows the MI300X to sustain larger batch sizes before memory stalls occur. When sparsity is enabled the A40 reaches 299.4 TFLOPS in FP16 with sparsity while the MI300X reaches 2614.9 TFLOPS in FP16 with sparsity. These ratios show the MI300X maintains an order of magnitude advantage whether dense or with sparsity modes are compared directly.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
A40
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| LeaderGPU | The Netherlands | 8 | $0.52 | $4.13 | Deploy |
| RunPod | global | 1 | $0.59 | — | Deploy |
2 providers in stock, 2 offers. All A40 offers, price history and alerts
MI300X
MI300X is not offered on-demand by any provider we track right now. See the MI300X rental page for last-seen listed prices and a price alert.
Notify me when A40 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.52/GPU-hr.
QuantaCloud
Comparing providers? We broker across all of them.
Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.
When to Choose the A40
The A40 fits workloads that operate within 48 GB of memory and require a 300W TDP limit. Its PCIe form factor and NVLink interconnect suit existing server deployments that cannot accommodate OAM modules. Applications that need only 149.7 TFLOPS FP16 dense or 299.3 TOPS INT8 dense can run without excess power draw.
When to Choose the MI300X
The MI300X suits workloads that scale with 192 GB of memory and 5300 GB/s bandwidth. Its 1307.4 TFLOPS FP16 dense rating supports larger models or higher throughput inference. Infinity Fabric interconnect and PCIe 5.0 interface match systems built for CDNA 3 scale out clusters.
Use Cases
The MI300X supplies 1307.4 TFLOPS FP16 dense and 192 GB memory that exceed the A40 values of 149.7 TFLOPS FP16 dense and 48 GB.
The MI300X provides 2614.9 TFLOPS FP8 dense and 5300 GB/s bandwidth that exceed the A40 specifications.
The MI300X 192 GB HBM3 capacity supports larger fine tuning batches than the A40 48 GB GDDR6 capacity.
The A40 300W TDP and 48 GB memory suffice for typical diffusion workloads while consuming less power than the MI300X 750W TDP.
Both GPUs deliver FP32 performance with the A40 at 37.4 TFLOPS and the MI300X at 163.4 TFLOPS so selection depends on required scale.
Frequently Asked Questions
What is the FP16 dense performance of the A40 versus the MI300X?▾
The A40 reaches 149.7 TFLOPS FP16 dense and the MI300X reaches 1307.4 TFLOPS FP16 dense.
Which GPU has higher memory bandwidth?▾
The MI300X lists 5300 GB/s bandwidth compared with 696 GB/s on the A40.
What TDP values apply to these GPUs?▾
The A40 operates at 300W TDP and the MI300X operates at 750W TDP.
Do both GPUs support sparsity modes?▾
Yes. The A40 reaches 299.4 TFLOPS FP16 with sparsity and the MI300X reaches 2614.9 TFLOPS FP16 with sparsity.
Which is cheaper to rent, the A40 or the MI300X?▾
Cloud rental prices for both the A40 and MI300X vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the A40 have compared to the MI300X?▾
The A40 has 48 GB of GDDR6 memory. The MI300X has 192 GB of HBM3 memory.
Can I find A40 and MI300X GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the A40 and the MI300X?▾
The A40 uses the Ampere architecture (2020) while the MI300X uses CDNA 3 (2023). The MI300X delivers 8.7x the dense FP16 throughput (1,307.4 vs 149.7 TFLOPS, both without sparsity) and 7.6x the memory bandwidth of the A40.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the A40 and the MI300X. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent A40Every current offer by provider, daily price history and a price alert.
- Rent MI300XEvery current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.