Specifications Compared
| Spec | Gaudi 2 | V100 |
|---|---|---|
| TDP | 600W | 300W |
| VRAM | 96 GB | 16-32 GB |
| CUDA Cores | Not published | 5,120 |
| Memory Type | HBM2e | HBM2 |
| Architecture | Gaudi | Volta |
| FP16 (dense) | Not published | 125 TFLOPS |
| Form Factors | OAM | SXM2, PCIe |
| Interconnect | RoCE Ethernet, PCIe 4.0 | NVLink, PCIe 3.0 |
| Tensor Cores | Not published | 640 |
| FP32 Performance | Not published | 15.7 TFLOPS |
| FP64 Performance | Not published | 7.8 TFLOPS |
| Memory Bandwidth | 2,450 GB/s | 900 GB/s |
Performance Analysis
The V100 delivers 125 TFLOPS in dense FP16 which is eight times its 15.7 TFLOPS in dense FP32 and this ratio indicates that dense FP16 workloads complete in substantially less time than dense FP32 workloads on the V100. Memory bandwidth of 2450 GB/s on the Gaudi 2 supports larger batch sizes than the 900 GB/s bandwidth on the V100 during both training and inference. The absence of published dense FP16 figures for the Gaudi 2 prevents direct ratio comparisons of dense FP16 performance between the two GPUs.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
Gaudi 2
Gaudi 2 is not offered on-demand by any provider we track right now. See the Gaudi 2 rental page for last-seen listed prices and a price alert.
V100
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| Ori | beauharnois | 1 | $0.83 | — | Deploy |
| Paperspace | ca1 | 1 | $2.30 | — | Deploy |
2 providers in stock, 71 offers (cheapest per provider shown). All V100 offers, price history and alerts
Notify me when Gaudi 2 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold.
QuantaCloud
Comparing providers? We broker across all of them.
Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.
When to Choose the Gaudi 2
Gaudi 2 suits workloads that require 96 GB of VRAM to hold large models that exceed the 16 to 32 GB limit of the V100. Its 2450 GB/s memory bandwidth further enables higher throughput in memory bound operations compared with the 900 GB/s of the V100.
When to Choose the V100
V100 suits workloads that require published dense FP16 performance of 125 TFLOPS or dense FP32 performance of 15.7 TFLOPS. Its 300W TDP also fits deployments where power consumption must remain at half the 600W TDP of the Gaudi 2.
Use Cases
The 96 GB VRAM on Gaudi 2 holds larger models than the 16 to 32 GB VRAM on the V100.
The 2450 GB/s bandwidth on Gaudi 2 sustains larger batches than the 900 GB/s bandwidth on the V100.
The 96 GB VRAM on Gaudi 2 supports fine tuning of models that exceed the 16 to 32 GB capacity of the V100.
Both GPUs handle the workload yet the V100 provides published dense FP16 performance of 125 TFLOPS.
The V100 supplies published dense FP32 performance of 15.7 TFLOPS at a 300W TDP.
Frequently Asked Questions
What is the memory bandwidth difference between Gaudi 2 and V100?▾
Gaudi 2 reaches 2450 GB/s while the V100 reaches 900 GB/s.
What dense FP16 performance does the V100 provide?▾
The V100 provides 125 TFLOPS in dense FP16.
What is the TDP of Gaudi 2 versus V100?▾
Gaudi 2 has a TDP of 600W while the V100 has a TDP of 300W.
Which interconnect does each GPU use?▾
Gaudi 2 uses RoCE Ethernet while the V100 uses NVLink.
What dense FP32 performance does the V100 provide?▾
The V100 provides 15.7 TFLOPS in dense FP32.
Which is cheaper to rent, the Gaudi 2 or the V100?▾
Cloud rental prices for both the Gaudi 2 and V100 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the Gaudi 2 have compared to the V100?▾
The Gaudi 2 has 96 GB of HBM2e memory. The V100 has 16 to 32 GB of HBM2 memory.
Can I find Gaudi 2 and V100 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the Gaudi 2 and the V100?▾
The Gaudi 2 uses the Gaudi architecture (2022) while the V100 uses Volta (2017). The Gaudi 2 has 96 GB of HBM2e at 2,450 GB/s; the V100 has 16-32 GB of HBM2 at 900 GB/s, so the Gaudi 2 has 2.7x the memory bandwidth of the V100.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the Gaudi 2 and the V100. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent GAUDI2Every current offer by provider, daily price history and a price alert.
- Rent V100Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.