GPU comparison

A100 vs P100

Specifications and current cloud pricing, side by side.

AmperevsPascalUpdated 34 days ago

The A100 wins for the most common training and inference workloads because its dense FP16 rating of 312 TFLOPS exceeds the P100 dense FP16 rating of 18.7 TFLOPS by a wide margin and its memory capacity reaches 40 to 80 GB against 16 GB.

A100 from $0.68/GPU/hrP100 from $0.09/GPU/hr

Right now, from live stock

  • Cheapest right now: P100 at $0.09/hr on Vast.ai

    Deploy
  • Most providers in stock: A100 (11)

    See all offers
  • Best $ per TFLOPS FP16 dense right now: A100 ($0.0022 per TFLOPS-hour at 312 TFLOPS)

    Deploy

Specifications Compared

SpecA100P100
TDP400W250W
VRAM40-80 GB16 GB
CUDA Cores6,9123,584
Memory TypeHBM2eHBM2
ArchitectureAmperePascal
FP16 (dense)312 TFLOPS18.7 TFLOPS
Form FactorsSXM4, PCIeSXM2, PCIe
INT8 (dense)624 TOPSNot published
InterconnectNVLink, PCIe 4.0, InfiniBandNVLink, PCIe 3.0
Tensor Cores432Not published
FP32 Performance19.5 TFLOPS9.3 TFLOPS
FP64 Performance9.7 TFLOPS4.7 TFLOPS
Memory Bandwidth2,039 GB/s732 GB/s
FP16 (with sparsity)624 TFLOPSNot published
INT8 (with sparsity)1,248 TOPSNot published

Performance Analysis

The A100 dense FP16 rating of 312 TFLOPS stands against the P100 dense FP16 rating of 18.7 TFLOPS for a ratio that favors the newer card in matrix heavy workloads. Training and inference routines that rely on dense FP16 therefore complete more operations per second on the A100 while the same routines on the P100 remain limited by its lower dense FP16 figure. Memory bandwidth of 2039 GB per second on the A100 versus 732 GB per second on the P100 permits larger batch sizes before data movement becomes the bottleneck. When sparsity is enabled the A100 FP16 figure with sparsity reaches 624 TFLOPS whereas the P100 offers no sparsity rating in the published specifications.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

A100

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
LeaderGPUThe Netherlands8$0.68$5.42Deploy
Vast.aiSlovenia, SI1$0.73—Deploy
ThunderComputeUSA2$1.09$2.18Deploy
HyperstackCANADA-11$1.35—Deploy
Massed Computeus-central-38$1.38$11.04Deploy

11 providers in stock, 34 offers (cheapest per provider shown). All A100 offers, price history and alerts

P100

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Vast.aiTexas, US1$0.09—Deploy

1 provider in stock, 2 offers (cheapest per provider shown). All P100 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when A100 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.68/GPU-hr.

QuantaCloud

Comparing A100 providers? We broker across all of them.

Need 16+ A100s reserved for fine-tuning, simulation, or production inference? We quote volume pricing across multiple data center partners: one quote at partner rates, 24h turnaround.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the A100

Workloads that require the A100 dense FP16 rating of 312 TFLOPS or the A100 FP32 rating of 19.5 TFLOPS benefit from the higher throughput and the 40 to 80 GB memory capacity. The 2039 GB per second bandwidth further supports sustained large tensor operations that exceed the 16 GB limit of the P100.

When to Choose the P100

Tasks that fit within the P100 16 GB HBM2 memory and that operate at the P100 FP32 rating of 9.3 TFLOPS can proceed on hardware with a TDP of 250 W. The P100 therefore remains viable when power draw and memory footprint stay below the thresholds set by the A100 specifications.

Use Cases

LLM Training
A100

The A100 dense FP16 rating of 312 TFLOPS and memory capacity of 40 to 80 GB support larger models than the P100 16 GB limit.

LLM Inference
A100

The A100 INT8 dense rating of 624 TOPS enables higher throughput than any published figure for the P100.

Fine-tuning
A100

The A100 memory bandwidth of 2039 GB per second sustains the data movement required for fine tuning runs that exceed P100 capacity.

Stable Diffusion
A100

The A100 FP32 rating of 19.5 TFLOPS combined with 40 to 80 GB memory accommodates the tensor sizes typical of diffusion workloads.

Scientific Computing
Either

The P100 FP32 rating of 9.3 TFLOPS suffices for smaller scientific codes while the A100 FP32 rating of 19.5 TFLOPS accelerates larger codes.

Frequently Asked Questions

What is the memory difference between A100 and P100?▾

The A100 provides 40 to 80 GB HBM2e while the P100 provides 16 GB HBM2. The A100 memory bandwidth reaches 2039 GB per second against 732 GB per second on the P100.

How does FP16 performance compare on A100 versus P100?▾

The A100 lists dense FP16 performance of 312 TFLOPS while the P100 lists dense FP16 performance of 18.7 TFLOPS. The A100 also lists FP16 performance with sparsity of 624 TFLOPS.

What TDP values are specified for each GPU?▾

The A100 TDP is listed at 400 W and the P100 TDP is listed at 250 W. These figures appear directly in the published specifications for each card.

Which GPU offers higher FP32 throughput?▾

The A100 FP32 rating stands at 19.5 TFLOPS while the P100 FP32 rating stands at 9.3 TFLOPS. The difference follows directly from the two specification blocks.

Does the P100 publish an INT8 rating?▾

No INT8 rating appears in the P100 specifications. The A100 publishes an INT8 dense rating of 624 TOPS and an INT8 rating with sparsity of 1,248 TOPS.

Which is cheaper to rent, the A100 or the P100?▾

Cloud rental prices for both the A100 and P100 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the A100 have compared to the P100?▾

The A100 has 40 to 80 GB of HBM2e memory. The P100 has 16 GB of HBM2 memory.

Can I find A100 and P100 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the A100 and the P100?▾

The A100 uses the Ampere architecture (2020) while the P100 uses Pascal (2016). The A100 delivers 16.7x the dense FP16 throughput (312 vs 18.7 TFLOPS, both without sparsity) and 2.8x the memory bandwidth of the P100.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the A100 and the P100. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps