GPU comparison

B200 vs RTX A5000

Specifications and current cloud pricing, side by side.

BlackwellvsAmpereUpdated 34 days ago

The B200 wins for the most common use case of LLM training because its 2250 TFLOPS FP16 dense rating and 180 to 192 GB VRAM exceed the corresponding capabilities of the RTX A5000 by wide margins.

B200 from $8.23/GPU/hrRTX A5000 from $1.38/GPU/hr

Right now, from live stock

  • Cheapest right now: RTX A5000 at $1.38/hr on Paperspace

    Deploy
  • Most providers in stock: B200 (3)

    See all offers

Specifications Compared

SpecB200RTX A5000
TDP1000W230W
VRAM180-192 GB24 GB
CUDA Cores18,4328,192
FP4 (dense)9,000 TFLOPSNot published
FP8 (dense)4,500 TFLOPSNot published
Memory TypeHBM3eGDDR6
ArchitectureBlackwellAmpere
FP16 (dense)2,250 TFLOPSNot published
Form FactorsSXM, NVLPCIe
INT8 (dense)4,500 TOPSNot published
InterconnectNVLink, PCIe 6.0, InfiniBandNVLink, PCIe 4.0
Tensor Cores576256
FP32 Performance75 TFLOPS27.8 TFLOPS
FP64 Performance37 TFLOPSNot published
Memory Bandwidth8,000 GB/s768 GB/s
FP4 (with sparsity)18,000 TFLOPSNot published
FP8 (with sparsity)9,000 TFLOPSNot published
FP16 (with sparsity)4,500 TFLOPS222.2 TFLOPS
INT8 (with sparsity)9,000 TOPSNot published

Performance Analysis

The FP16 dense figure of 2250 TFLOPS on the B200 stands in contrast to the FP16 with sparsity figure of 222.2 TFLOPS on the RTX A5000. This gap means the B200 supports faster processing for training and inference tasks that rely on dense operations. The FP32 rating of 75 TFLOPS on the B200 exceeds the 27.8 TFLOPS on the RTX A5000. Memory bandwidth of 8000 GB/s versus 768 GB/s allows the B200 to handle larger batch sizes through greater data movement capacity. The B200 also lists FP8 dense at 4500 TFLOPS and FP4 dense at 9000 TFLOPS while the RTX A5000 provides no figures for those precisions.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

B200

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
VERDAFIN-HEL8$8.23$65.84Deploy
LyceumEurope1$8.79—Deploy
Vast.ai, US4$9.00$36.00Deploy

3 providers in stock, 4 offers (cheapest per provider shown). All B200 offers, price history and alerts

RTX A5000

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Paperspaceams11$1.38—Deploy

1 provider in stock, 6 offers (cheapest per provider shown). All RTX A5000 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when B200 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $8.23/GPU-hr.

QuantaCloud

Comparing B-series options? Get one quote for all of them.

Skip the per-provider sales calls. Reserved and cluster B-series configurations from 16 to 1024+ GPUs with InfiniBand fabric, 3 to 12 month terms. One quote at partner rates, 24h turnaround.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the B200

The B200 suits scenarios that require 180 to 192 GB of VRAM and 8000 GB/s bandwidth for large model handling. Its FP16 dense performance of 2250 TFLOPS and 1000W TDP align with sustained high intensity operations in data center settings.

When to Choose the RTX A5000

The RTX A5000 fits deployments where 24 GB of VRAM and 230W TDP provide adequate capacity without exceeding power limits. Its PCIe form factor and 768 GB/s bandwidth support standard workstation configurations effectively.

Use Cases

LLM Training
B200

The B200 supplies 2250 TFLOPS FP16 dense along with 180 to 192 GB VRAM.

LLM Inference
B200

The B200 provides 4500 TFLOPS FP8 dense and 8000 GB/s bandwidth for efficient operation.

Fine-tuning
B200

The B200 offers 2250 TFLOPS FP16 dense and 180 to 192 GB memory capacity.

Stable Diffusion
RTX A5000

The RTX A5000 delivers 27.8 TFLOPS FP32 within a 230W TDP limit.

Scientific Computing
Either

The B200 lists 75 TFLOPS FP32 while the RTX A5000 lists 27.8 TFLOPS FP32.

Frequently Asked Questions

What is the memory bandwidth of the B200 and the RTX A5000?▾

The B200 reaches 8000 GB/s. The RTX A5000 reaches 768 GB/s.

What FP16 performance does each GPU provide?▾

The B200 provides 2250 TFLOPS FP16 dense. The RTX A5000 provides 222.2 TFLOPS FP16 with sparsity.

What TDP ratings apply to the B200 and RTX A5000?▾

The B200 has a TDP of 1000W. The RTX A5000 has a TDP of 230W.

Which interconnects does each GPU support?▾

The B200 supports NVLink, PCIe 6.0, and InfiniBand. The RTX A5000 supports NVLink and PCIe 4.0.

What FP32 performance is listed for both GPUs?▾

The B200 lists 75 TFLOPS FP32. The RTX A5000 lists 27.8 TFLOPS FP32.

Which is cheaper to rent, the B200 or the RTX A5000?▾

Cloud rental prices for both the B200 and RTX A5000 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the B200 have compared to the RTX A5000?▾

The B200 has 180 to 192 GB of HBM3e memory. The RTX A5000 has 24 GB of GDDR6 memory.

Can I find B200 and RTX A5000 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the B200 and the RTX A5000?▾

The B200 uses the Blackwell architecture (2024) while the RTX A5000 uses Ampere (2021). The B200 has 180-192 GB of HBM3e at 8,000 GB/s; the RTX A5000 has 24 GB of GDDR6 at 768 GB/s, so the B200 has 10.4x the memory bandwidth of the RTX A5000.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the B200 and the RTX A5000. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps