GPU comparison

A10 vs GH200

Specifications and current cloud pricing, side by side.

AmperevsHopperUpdated 30 days ago

The GH200 wins for the most common use case of LLM inference because its 989 TFLOPS dense FP16 and 4000 GB/s bandwidth exceed the A10 figures by substantial margins while the 96 GB memory supports larger deployments.

A10 from $0.37/GPU/hrGH200 from $1.99/GPU/hr

Right now, from live stock

  • Cheapest right now: A10 at $0.37/hr on LeaderGPU

    Deploy
  • Most providers in stock: A10 (2)

    See all offers
  • Best $ per TFLOPS FP16 dense right now: GH200 ($0.0020 per TFLOPS-hour at 989 TFLOPS)

    Deploy

Specifications Compared

SpecA10GH200
TDP150W900W
VRAM24 GB96 GB
CUDA Cores9,21616,896
FP8 (dense)Not published1,979 TFLOPS
Memory TypeGDDR6HBM3
ArchitectureAmpereHopper
FP16 (dense)125 TFLOPS989 TFLOPS
Form FactorsPCIeSXM
INT8 (dense)250 TOPS1,979 TOPS
InterconnectPCIe 4.0NVLink-C2C, PCIe 5.0
Tensor Cores288528
FP32 Performance31.2 TFLOPS67 TFLOPS
FP64 PerformanceNot published34 TFLOPS
Memory Bandwidth600 GB/s4,000 GB/s
FP8 (with sparsity)Not published3,958 TFLOPS
FP16 (with sparsity)250 TFLOPS1,979 TFLOPS
INT8 (with sparsity)500 TOPS3,958 TOPS

Performance Analysis

The FP16 dense performance of 125 TFLOPS on the A10 versus 989 TFLOPS on the GH200 indicates the GH200 handles larger scale computations in training scenarios. Memory bandwidth of 600 GB/s versus 4000 GB/s affects how large batch sizes can be processed without bottlenecks on each device. The A10 INT8 dense rating of 250 TOPS stands against the GH200 INT8 dense rating of 1979 TOPS for inference throughput comparisons. FP16 with sparsity reaches 250 TFLOPS on the A10 and 1979 TFLOPS on the GH200 so ratios remain consistent when sparsity applies to both. The 24 GB memory on the A10 limits model sizes relative to the 96 GB on the GH200 in memory intensive tasks.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

A10

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
LeaderGPUThe Netherlands10$0.37$3.71Deploy
Lambda Labsus-east-11$1.29—Deploy

2 providers in stock, 3 offers (cheapest per provider shown). All A10 offers, price history and alerts

GH200

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
VultrFrankfurt, DE1$1.99—Deploy

1 provider in stock, 2 offers (cheapest per provider shown). All GH200 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when A10 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.37/GPU-hr.

QuantaCloud

Comparing H-series providers? We broker across all of them.

Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the A10

The A10 suits power constrained deployments that operate within a 150W TDP limit and require a PCIe form factor. Its 24 GB memory capacity and 600 GB/s bandwidth support moderate workloads without exceeding efficiency thresholds. Users select the A10 when FP32 performance at 31.2 TFLOPS meets application demands at lower overall power draw.

When to Choose the GH200

Its 96 GB memory enables larger models and batch processing compared to lower capacity alternatives. The 900W TDP supports sustained operation in dense FP16 or FP8 dense modes rated at 1979 TFLOPS each.

Use Cases

LLM Training
GH200

The GH200 provides 989 TFLOPS dense FP16 compared to 125 TFLOPS on the A10.

LLM Inference
GH200

The GH200 delivers 1979 TFLOPS dense FP8 while the A10 lacks a published FP8 figure.

Fine-tuning
GH200

The GH200 memory of 96 GB exceeds the A10 memory of 24 GB for larger fine tuning batches.

Stable Diffusion
Either

The A10 125 TFLOPS dense FP16 or GH200 989 TFLOPS dense FP16 both support the workload depending on scale.

Scientific Computing
GH200

The GH200 FP32 rating of 67 TFLOPS exceeds the A10 rating of 31.2 TFLOPS.

Frequently Asked Questions

What are the FP16 dense ratings?▾

The A10 achieves 125 TFLOPS in dense FP16 and the GH200 achieves 989 TFLOPS in dense FP16.

Which GPU has higher memory bandwidth?▾

The GH200 reaches 4000 GB/s bandwidth compared to 600 GB/s on the A10.

What TDP values apply to these GPUs?▾

The A10 operates at 150W TDP and the GH200 operates at 900W TDP.

Do both GPUs support sparsity in FP16?▾

The A10 reaches 250 TFLOPS with sparsity in FP16 and the GH200 reaches 1979 TFLOPS with sparsity in FP16.

What interconnect options exist?▾

The A10 uses PCIe 4.0 while the GH200 uses NVLink-C2C and PCIe 5.0.

Which is cheaper to rent, the A10 or the GH200?▾

Cloud rental prices for both the A10 and GH200 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the A10 have compared to the GH200?▾

The A10 has 24 GB of GDDR6 memory. The GH200 has 96 GB of HBM3 memory.

Can I find A10 and GH200 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the A10 and the GH200?▾

The A10 uses the Ampere architecture (2021) while the GH200 uses Hopper (2023). The GH200 delivers 7.9x the dense FP16 throughput (989 vs 125 TFLOPS, both without sparsity) and 6.7x the memory bandwidth of the A10.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the A10 and the GH200. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps