GPU comparison

P100 vs RTX 4090

Specifications and current cloud pricing, side by side.

PascalvsAda LovelaceUpdated 33 days ago

The RTX 4090 wins for the most common use case of LLM inference and fine tuning because it supplies 165.2 TFLOPS dense FP16 and 24 GB memory against the P100 at 18.7 TFLOPS dense FP16 and 16 GB memory.

P100 from $0.09/GPU/hrRTX 4090 from $0.45/GPU/hr

Right now, from live stock

  • Cheapest right now: P100 at $0.09/hr on Vast.ai

    Deploy
  • Most providers in stock: RTX 4090 (3)

    See all offers
  • Best $ per TFLOPS FP16 dense right now: RTX 4090 ($0.0027 per TFLOPS-hour at 165.2 TFLOPS)

    Deploy

Specifications Compared

SpecP100RTX 4090
TDP250W450W
VRAM16 GB24 GB
CUDA Cores3,58416,384
FP8 (dense)Not published330.3 TFLOPS
Memory TypeHBM2GDDR6X
ArchitecturePascalAda Lovelace
FP16 (dense)18.7 TFLOPS165.2 TFLOPS
Form FactorsSXM2, PCIePCIe
INT8 (dense)Not published660.6 TOPS
InterconnectNVLink, PCIe 3.0PCIe 4.0
Tensor CoresNot published512
FP32 Performance9.3 TFLOPS82.6 TFLOPS
FP64 Performance4.7 TFLOPS1.3 TFLOPS
Memory Bandwidth732 GB/s1,008 GB/s
FP8 (with sparsity)Not published660.6 TFLOPS
FP16 (with sparsity)Not published330.4 TFLOPS
INT8 (with sparsity)Not published1,321.2 TOPS

Performance Analysis

The RTX 4090 delivers 165.2 TFLOPS dense FP16 compared with the P100 at 18.7 TFLOPS dense FP16 for an 8.8 times advantage in dense FP16 throughput. The same ratio appears in FP32 where the RTX 4090 reaches 82.6 TFLOPS against the P100 at 9.3 TFLOPS. Higher dense FP16 throughput on the RTX 4090 allows larger batch sizes during training or faster token generation during inference when memory capacity permits. The RTX 4090 also supplies 1008 GB/s memory bandwidth against 732 GB/s on the P100 which supports 1.4 times greater data movement per second and therefore sustains larger batches before memory bandwidth saturates.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

P100

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Vast.aiTexas, US1$0.09—Deploy

1 provider in stock, 2 offers (cheapest per provider shown). All P100 offers, price history and alerts

RTX 4090

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
Vast.aiUnited Kingdom, GB2$0.45$0.91Deploy
RunPodglobal1$0.89—Deploy
LeaderGPUThe Netherlands1$1.66—Deploy

3 providers in stock, 11 offers (cheapest per provider shown). All RTX 4090 offers, price history and alerts

Which GPU to watchWatch the price of

Notify me when P100 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.09/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the P100

The P100 suits scientific computing jobs that run on existing NVLink equipped systems and require only 16 GB memory. Its 250 W TDP fits power constrained servers where the 450 W TDP of the RTX 4090 would exceed limits. Workloads that already achieve acceptable throughput at 18.7 TFLOPS dense FP16 gain no benefit from migration.

When to Choose the RTX 4090

Its 1008 GB/s bandwidth supports larger batch sizes than the 732 GB/s available on the P100. New deployments without legacy NVLink requirements favor the RTX 4090 for its higher dense FP16 and FP32 throughput.

Use Cases

LLM Training
RTX 4090

The RTX 4090 supplies 165.2 TFLOPS dense FP16 and 24 GB memory which exceed the 18.7 TFLOPS dense FP16 and 16 GB memory of the P100.

LLM Inference
RTX 4090

The RTX 4090 reaches 165.2 TFLOPS dense FP16 allowing higher throughput than the P100 at 18.7 TFLOPS dense FP16.

Fine-tuning
RTX 4090

The RTX 4090 provides 24 GB memory and 165.2 TFLOPS dense FP16 which accommodate larger models than the P100 configuration.

Stable Diffusion
RTX 4090

Scientific Computing
P100

The P100 operates at 250 W TDP and supports NVLink interconnects that match existing scientific computing clusters.

Frequently Asked Questions

What is the FP32 performance difference?▾

The P100 delivers 9.3 TFLOPS FP32. The RTX 4090 delivers 82.6 TFLOPS FP32.

Which GPU has higher memory bandwidth?▾

The RTX 4090 provides 1008 GB/s bandwidth. The P100 provides 732 GB/s bandwidth.

Can the P100 run modern LLM inference?▾

The P100 supports 18.7 TFLOPS dense FP16 which limits batch size and speed relative to the RTX 4090 at 165.2 TFLOPS dense FP16.

What interconnect does each card use?▾

The P100 supports NVLink and PCIe 3.0. The RTX 4090 supports PCIe 4.0.

How does TDP affect deployment?▾

The P100 lists a 250 W TDP. The RTX 4090 lists a 450 W TDP which requires more power delivery and cooling capacity.

Which is cheaper to rent, the P100 or the RTX 4090?▾

Cloud rental prices for both the P100 and RTX 4090 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the P100 have compared to the RTX 4090?▾

The P100 has 16 GB of HBM2 memory. The RTX 4090 has 24 GB of GDDR6X memory.

Can I find P100 and RTX 4090 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the P100 and the RTX 4090?▾

The P100 uses the Pascal architecture (2016) while the RTX 4090 uses Ada Lovelace (2022). The RTX 4090 delivers 8.8x the dense FP16 throughput (165.2 vs 18.7 TFLOPS, both without sparsity) and 1.4x the memory bandwidth of the P100.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the P100 and the RTX 4090. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps