GPU comparison

P100 vs RTX 3090

Specifications and current cloud pricing, side by side.

PascalvsAmpereUpdated 33 days ago

The RTX 3090 wins for the most common use case of LLM inference. It supplies 71 TFLOPS dense FP16 against 18.7 TFLOPS on the P100 while providing 24 GB memory and 936 GB/s bandwidth.

P100 from $0.09/GPU/hrRTX 3090 from $0.29/GPU/hr

Right now, from live stock

  • Cheapest right now: P100 at $0.09/hr on Vast.ai

    Deploy
  • Most providers in stock: RTX 3090 (2)

    See all offers
  • Best $ per TFLOPS FP16 dense right now: RTX 3090 ($0.0040 per TFLOPS-hour at 71 TFLOPS)

    Deploy

Specifications Compared

SpecP100RTX 3090
TDP250W350W
VRAM16 GB24 GB
CUDA Cores3,58410,496
Memory TypeHBM2GDDR6X
ArchitecturePascalAmpere
FP16 (dense)18.7 TFLOPS71 TFLOPS
Form FactorsSXM2, PCIePCIe
INT8 (dense)Not published284 TOPS
InterconnectNVLink, PCIe 3.0NVLink, PCIe 4.0
Tensor CoresNot published328
FP32 Performance9.3 TFLOPS35.6 TFLOPS
FP64 Performance4.7 TFLOPSNot published
Memory Bandwidth732 GB/s936 GB/s
FP16 (with sparsity)Not published142 TFLOPS
INT8 (with sparsity)Not published568 TOPS

Performance Analysis

Dense FP16 performance reaches 18.7 TFLOPS on the P100 and 71 TFLOPS on the RTX 3090. This gap indicates that training and inference steps complete faster on the RTX 3090 when models fit within memory limits. FP32 performance follows the same pattern at 9.3 TFLOPS for the P100 and 35.6 TFLOPS for the RTX 3090. Memory bandwidth of 732 GB/s on the P100 versus 936 GB/s on the RTX 3090 influences maximum batch sizes during large tensor operations. The RTX 3090 also lists dense INT8 at 284 TOPS. Higher bandwidth on the RTX 3090 supports larger batches before memory capacity of 24 GB becomes the limit compared with 16 GB on the P100.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

P100

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Vast.aiTexas, US1$0.09—Deploy

1 provider in stock, 1 offer. All P100 offers, price history and alerts

RTX 3090

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
LeaderGPUThe Netherlands8$0.29$2.29Deploy
Vast.aiCzechia, CZ4$0.37$1.48Deploy

2 providers in stock, 10 offers (cheapest per provider shown). All RTX 3090 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when P100 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.09/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the P100

The P100 suits scientific computing workloads that operate within 16 GB HBM2 and require 18.7 TFLOPS dense FP16. Its 250W TDP reduces power draw in sustained runs. NVLink interconnect remains available for multi GPU scaling where PCIe 3.0 suffices.

When to Choose the RTX 3090

Its 936 GB/s bandwidth allows larger batches than the P100 in memory bound scenarios. PCIe 4.0 interconnect supports newer host systems.

Use Cases

LLM Training
RTX 3090

The RTX 3090 supplies 71 TFLOPS dense FP16 and 24 GB memory for larger models.

LLM Inference
RTX 3090

Dense FP16 at 71 TFLOPS and 936 GB/s bandwidth support higher throughput than the P100.

Fine-tuning
RTX 3090

24 GB GDDR6X and 35.6 TFLOPS FP32 allow bigger batch sizes than 16 GB on the P100.

Stable Diffusion
RTX 3090

The RTX 3090 provides 71 TFLOPS dense FP16 and 936 GB/s bandwidth for image generation workloads.

Scientific Computing
P100

The P100 delivers 9.3 TFLOPS FP32 at 250W TDP with NVLink for multi node scaling.

Frequently Asked Questions

What is the FP32 performance difference between P100 and RTX 3090?▾

The P100 reaches 9.3 TFLOPS FP32. The RTX 3090 reaches 35.6 TFLOPS FP32.

Which GPU offers higher memory bandwidth?▾

The RTX 3090 reaches 936 GB/s. The P100 reaches 732 GB/s.

What dense FP16 performance does the P100 deliver?▾

The P100 delivers 18.7 TFLOPS dense FP16.

Does the RTX 3090 support sparsity in FP16?▾

The RTX 3090 lists 142 TFLOPS FP16 with sparsity.

What TDP values apply to these GPUs?▾

The P100 lists 250W TDP. The RTX 3090 lists 350W TDP.

Which is cheaper to rent, the P100 or the RTX 3090?▾

Cloud rental prices for both the P100 and RTX 3090 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the P100 have compared to the RTX 3090?▾

The P100 has 16 GB of HBM2 memory. The RTX 3090 has 24 GB of GDDR6X memory.

Can I find P100 and RTX 3090 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the P100 and the RTX 3090?▾

The P100 uses the Pascal architecture (2016) while the RTX 3090 uses Ampere (2020). The RTX 3090 delivers 3.8x the dense FP16 throughput (71 vs 18.7 TFLOPS, both without sparsity) and 1.3x the memory bandwidth of the P100.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the P100 and the RTX 3090. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps