GPU comparison

A16 vs B200

Specifications and current cloud pricing, side by side.

AmperevsBlackwellUpdated 34 days ago

The B200 wins for the most common use case of LLM training because its FP16 dense performance of 2250 TFLOPS exceeds the A16 value of 17.9 TFLOPS while its memory bandwidth of 8000 GB/s exceeds the A16 value of 200 GB/s.

A16 listed from $0.06/GPU/hrB200 listed from $8.23/GPU/hr

Right now, from live stock

Specifications Compared

SpecA16B200
TDP250W1000W
VRAM16 GB180-192 GB
CUDA Cores1,28018,432
FP4 (dense)Not published9,000 TFLOPS
FP8 (dense)Not published4,500 TFLOPS
Memory TypeGDDR6HBM3e
ArchitectureAmpereBlackwell
FP16 (dense)17.9 TFLOPS2,250 TFLOPS
Form FactorsPCIeSXM, NVL
INT8 (dense)35.9 TOPS4,500 TOPS
InterconnectPCIe 4.0NVLink, PCIe 6.0, InfiniBand
Tensor Cores40576
FP32 Performance4.5 TFLOPS75 TFLOPS
FP64 PerformanceNot published37 TFLOPS
Memory Bandwidth200 GB/s8,000 GB/s
FP4 (with sparsity)Not published18,000 TFLOPS
FP8 (with sparsity)Not published9,000 TFLOPS
FP16 (with sparsity)35.9 TFLOPS4,500 TFLOPS
INT8 (with sparsity)71.8 TOPS9,000 TOPS

Performance Analysis

FP16 dense performance reaches 17.9 TFLOPS on the A16 compared with 2250 TFLOPS on the B200. FP16 performance with sparsity reaches 35.9 TFLOPS on the A16 compared with 4500 TFLOPS on the B200. The FP16 dense to FP32 ratio equals 17.9 divided by 4.5 on the A16 and equals 2250 divided by 75 on the B200. Memory bandwidth of 8000 GB/s on the B200 versus 200 GB/s on the A16 permits substantially larger batch sizes during both training and inference workloads. INT8 dense performance equals 35.9 TOPS on the A16 versus 4500 TOPS on the B200.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

A16

A16 is not offered on-demand by any provider we track right now. See the A16 rental page for last-seen listed prices and a price alert.

B200

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
VERDAFIN-HEL8$8.23$65.84Deploy
LyceumEurope1$8.79—Deploy
Vast.ai, US4$9.00$36.00Deploy

3 providers in stock, 3 offers. All B200 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when A16 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold.

QuantaCloud

Comparing B-series options? Get one quote for all of them.

Skip the per-provider sales calls. Reserved and cluster B-series configurations from 16 to 1024+ GPUs with InfiniBand fabric, 3 to 12 month terms. One quote at partner rates, 24h turnaround.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the A16

The A16 suits deployments constrained to 250W TDP and PCIe interconnect where FP16 dense performance of 17.9 TFLOPS meets requirements. Scenarios limited to 16 GB GDDR6 VRAM and 200 GB/s bandwidth favor the A16 for inference tasks that do not demand higher memory capacity.

When to Choose the B200

The B200 suits workloads that require FP16 dense performance of 2250 TFLOPS together with 180-192 GB HBM3e VRAM and 8000 GB/s bandwidth. Training or inference at 1000W TDP with NVLink or InfiniBand interconnect selects the B200 when scale exceeds A16 limits.

Use Cases

LLM Training
B200

The B200 supplies FP16 dense performance of 2250 TFLOPS against 17.9 TFLOPS on the A16.

LLM Inference
B200

The B200 supplies 8000 GB/s memory bandwidth and 180-192 GB VRAM against 200 GB/s and 16 GB on the A16.

Fine-tuning
B200

The B200 supplies FP16 performance with sparsity of 4500 TFLOPS against 35.9 TFLOPS on the A16.

Stable Diffusion
A16

The A16 operates at 250W TDP with PCIe form factor against 1000W TDP on the B200.

Scientific Computing
B200

The B200 supplies FP32 performance of 75 TFLOPS against 4.5 TFLOPS on the A16.

Frequently Asked Questions

What is the FP16 dense performance difference between A16 and B200?▾

The A16 lists FP16 dense performance of 17.9 TFLOPS. The B200 lists FP16 dense performance of 2250 TFLOPS.

What TDP values apply to the A16 and B200?▾

The A16 lists 250W TDP. The B200 lists 1000W TDP.

Which interconnect options exist for each card?▾

The A16 uses PCIe 4.0. The B200 uses NVLink, PCIe 6.0, and InfiniBand.

What memory bandwidth figures appear in the specifications?▾

The A16 lists 200 GB/s memory bandwidth. The B200 lists 8000 GB/s memory bandwidth.

How do INT8 dense figures compare?▾

The A16 lists INT8 dense performance of 35.9 TOPS. The B200 lists INT8 dense performance of 4500 TOPS.

Which is cheaper to rent, the A16 or the B200?▾

Cloud rental prices for both the A16 and B200 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the A16 have compared to the B200?▾

The A16 has 16 GB of GDDR6 memory. The B200 has 180 to 192 GB of HBM3e memory.

Can I find A16 and B200 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the A16 and the B200?▾

The A16 uses the Ampere architecture (2021) while the B200 uses Blackwell (2024). The B200 delivers 125.7x the dense FP16 throughput (2,250 vs 17.9 TFLOPS, both without sparsity) and 40.0x the memory bandwidth of the A16.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the A16 and the B200. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps