GPU comparison

B200 NVL vs RTX 3090

Specifications and current cloud pricing, side by side.

BlackwellvsAmpereUpdated 31 days ago

This variant comparison is part of the B200 vs RTX 3090 family comparison.

The B200 NVL wins for the most common large model training use case because its 192 GB capacity and 2250 TFLOPS FP16 dense throughput exceed the RTX 3090 limits by wide margins on every shared family metric.

B200 NVL from $7.99/GPU/hrRTX 3090 from $0.29/GPU/hr

Right now, from live stock

  • Cheapest right now: RTX 3090 at $0.29/hr on LeaderGPU

    Deploy
  • Most providers in stock: B200 NVL (4)

    See all offers

Specifications Compared

SpecB200 NVLRTX 3090
TDP1000W350W
VRAM192 GB24 GB
CUDA Cores18,43210,496
FP4 (dense)9,000 TFLOPSNot published
FP8 (dense)4,500 TFLOPSNot published
Memory TypeHBM3eGDDR6X
ArchitectureBlackwellAmpere
FP16 (dense)2,250 TFLOPSNot published
Form FactorsNVL (PCIe card, NVLink bridged)PCIe
INT8 (dense)4,500 TOPSNot published
InterconnectNVLink bridge, PCIe 6.0NVLink
Tensor Cores576328
FP32 Performance75 TFLOPS35.6 TFLOPS
FP64 Performance37 TFLOPSNot published
Memory Bandwidth8,000 GB/s936 GB/s
FP4 (with sparsity)18,000 TFLOPSNot published
FP8 (with sparsity)9,000 TFLOPSNot published
FP16 (with sparsity)4,500 TFLOPSNot published
INT8 (with sparsity)9,000 TOPSNot published
FP16 (vendor figure, sparsity not specified)Not published35.6 TFLOPS

Performance Analysis

The B200 NVL delivers FP16 dense throughput of 2250 TFLOPS compared with the RTX 3090 FP16 figure of 35.6 TFLOPS while the B200 NVL also lists FP16 with sparsity at 4500 TFLOPS. This dense FP16 difference means the B200 NVL can process larger matrix operations in training runs that fit within its 192 GB capacity whereas the RTX 3090 remains limited to smaller batches that fit in 24 GB. Memory bandwidth of 8000 GB/s versus 936 GB/s allows the B200 NVL family to sustain higher data movement rates during inference steps that require frequent weight loading. FP32 performance stands at 75 TFLOPS for the B200 NVL family against 35.6 TFLOPS for the RTX 3090 so scientific kernels that rely on single precision see a substantial gap when model sizes exceed 24 GB.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

B200 NVL

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
RunPodglobal1$7.99—Deploy
VERDAFIN-HEL1$8.03—Deploy
LyceumEurope1$8.79—Deploy
Vast.ai, US4$9.00$36.00Deploy

4 providers in stock, 5 offers (cheapest per provider shown). All B200 NVL offers, price history and alerts

RTX 3090

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
LeaderGPUThe Netherlands8$0.29$2.29Deploy
Vast.aiCzechia, CZ2$0.37$0.74Deploy
RunPodglobal1$0.50—Deploy

3 providers in stock, 12 offers (cheapest per provider shown). All RTX 3090 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when B200 NVL drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $7.99/GPU-hr.

QuantaCloud

Comparing B-series options? Get one quote for all of them.

Skip the per-provider sales calls. Reserved and cluster B-series configurations from 16 to 1024+ GPUs with InfiniBand fabric, 3 to 12 month terms. One quote at partner rates, 24h turnaround.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the B200 NVL

The B200 NVL suits large scale LLM training jobs that require the full 192 GB HBM3e capacity and 2250 TFLOPS FP16 dense throughput. Workloads involving models that cannot fit in 24 GB benefit from the NVL form factor and PCIe 6.0 interconnect for multi GPU scaling.

When to Choose the RTX 3090

The RTX 3090 handles smaller inference tasks or fine tuning runs that stay within the 24 GB GDDR6X limit and 35.6 TFLOPS FP16 performance. Its 350 W TDP makes it practical for single node setups where power limits constrain deployment of 1000 W cards.

Use Cases

LLM Training
B200 NVL

The 192 GB capacity supports models that exceed the 24 GB limit of the RTX 3090 while 2250 TFLOPS FP16 dense throughput accelerates large batch training.

LLM Inference
B200 NVL

Higher memory bandwidth of 8000 GB/s sustains larger batch inference that the 936 GB/s of the RTX 3090 cannot match at scale.

Fine-tuning
Either

Smaller fine tuning jobs fit on the RTX 3090 24 GB while larger ones require the B200 NVL 192 GB capacity.

Stable Diffusion
RTX 3090

The 24 GB GDDR6X and 35.6 TFLOPS FP16 handle typical image generation workloads without needing the higher TDP of 1000 W.

Scientific Computing
B200 NVL

FP32 throughput of 75 TFLOPS combined with 192 GB memory enables larger simulations than the 35.6 TFLOPS and 24 GB of the RTX 3090.

Frequently Asked Questions

What memory difference exists between the B200 NVL and RTX 3090 variants?▾

The B200 NVL variant holds 192 GB HBM3e while the RTX 3090 variant holds 24 GB GDDR6X so the capacity ratio reaches eight times.

How do FP16 figures compare between these GPUs?▾

The B200 NVL lists 2250 TFLOPS FP16 dense and 4500 TFLOPS with sparsity while the RTX 3090 lists 35.6 TFLOPS FP16 without a sparsity specification.

Which GPU uses more power according to family TDP values?▾

The B200 NVL family TDP reaches 1000 W compared with the RTX 3090 family TDP of 350 W so power draw differs by nearly three times.

Do these variants share the same interconnect technology?▾

Both support NVLink yet the B200 NVL adds PCIe 6.0 and an NVLink bridge while the RTX 3090 uses standard NVLink on PCIe.

What architecture separates the B200 NVL from the RTX 3090?▾

The B200 NVL uses Blackwell architecture released in 2024 while the RTX 3090 uses Ampere architecture released in 2020.

Which variant offers higher memory bandwidth as a family figure?▾

The B200 NVL family provides 8000 GB/s bandwidth against the RTX 3090 family figure of 936 GB/s.

Which is cheaper to rent, the B200 NVL or the RTX 3090?▾

Cloud rental prices for both the B200 NVL and RTX 3090 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the B200 NVL have compared to the RTX 3090?▾

The B200 NVL has 192 GB of HBM3e memory. The RTX 3090 has 24 GB of GDDR6X memory.

Can I find B200 NVL and RTX 3090 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the B200 NVL and the RTX 3090?▾

The B200 NVL uses the Blackwell architecture (2024) while the RTX 3090 uses Ampere (2020). The B200 NVL delivers 31.7x the dense FP16 throughput (2,250 vs 71 TFLOPS, both without sparsity) and 8.5x the memory bandwidth of the RTX 3090.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the B200 NVL and the RTX 3090. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps