Specifications Compared
| Spec | H200 | RTX 3060 |
|---|---|---|
| TDP | 700W | 170W |
| VRAM | 141 GB | 8-12 GB |
| CUDA Cores | 16,896 | 3,584 |
| FP8 (dense) | 1,979 TFLOPS | Not published |
| Memory Type | HBM3e | GDDR6 |
| Architecture | Hopper | Ampere |
| FP16 (dense) | 989 TFLOPS | Not published |
| Form Factors | SXM, NVL | PCIe |
| INT8 (dense) | 1,979 TOPS | Not published |
| Interconnect | NVLink, PCIe 5.0, InfiniBand | PCIe 4.0 |
| Tensor Cores | 528 | 112 |
| FP32 Performance | 67 TFLOPS | 12.7 TFLOPS |
| FP64 Performance | 34 TFLOPS | Not published |
| Memory Bandwidth | 4,800 GB/s | 360 GB/s |
| FP8 (with sparsity) | 3,958 TFLOPS | Not published |
| FP16 (with sparsity) | 1,979 TFLOPS | Not published |
| INT8 (with sparsity) | 3,958 TOPS | Not published |
Performance Analysis
FP32 performance shows the H200 at 67 TFLOPS against the RTX 3060 at 12.7 TFLOPS. This ratio indicates the H200 can process roughly five times more single precision operations per second. For training and inference the H200 supplies dense FP16 at 989 TFLOPS and FP16 with sparsity at 1979 TFLOPS. The RTX 3060 does not publish FP16 figures so direct comparison stays limited to FP32. Memory bandwidth of 4800 GB/s on the H200 versus 360 GB/s on the RTX 3060 allows the H200 to sustain larger batch sizes during model execution. TDP values of 700 W for the H200 and 170 W for the RTX 3060 further separate power requirements and thermal design considerations.
Current On-Demand Offers
Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.
H200
| Provider | Region | GPUs | Per GPU / hr | Instance / hr | Deploy |
|---|---|---|---|---|---|
| RunPod | global | 1 | $5.29 | — | Deploy |
| VERDA | FIN-HEL | 2 | $5.66 | $11.32 | Deploy |
| Lyceum | Europe | 2 | $6.19 | $12.38 | Deploy |
| LeaderGPU | The Netherlands | 1 | $6.22 | — | Deploy |
4 providers in stock, 6 offers (cheapest per provider shown). All H200 offers, price history and alerts
RTX 3060
1 provider in stock, 1 offer. All RTX 3060 offers, price history and alerts
Notify me when H200 drops below a price
One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $5.29/GPU-hr.
QuantaCloud
Comparing H-series providers? We broker across all of them.
Hopper stock changes by the hour and prices differ by provider. If you need 16+ GPUs reserved or a cluster in the next 90 days, we quote H-series or B300 inventory at partner rates: one quote, 24h turnaround.
When to Choose the H200
The H200 suits workloads that require 141 GB HBM3e memory and 4800 GB/s bandwidth. Large model training benefits from the 989 TFLOPS dense FP16 rating. Inference tasks that need high throughput also align with the 1979 TFLOPS FP16 with sparsity rating. Organizations running scientific computing at scale select the H200 for its 67 TFLOPS FP32 capacity.
When to Choose the RTX 3060
The RTX 3060 fits smaller projects that operate within 12 GB GDDR6 memory limits. Its 12.7 TFLOPS FP32 rating supports entry level inference and fine tuning. Power constrained environments favor the 170 W TDP over the 700 W TDP of the H200. Users who need only PCIe form factor cards choose the RTX 3060.
Use Cases
The H200 supplies 141 GB memory and 989 TFLOPS dense FP16.
The H200 delivers 1979 TFLOPS FP16 with sparsity and 4800 GB/s bandwidth.
The H200 provides 67 TFLOPS FP32 and 141 GB memory for model updates.
The RTX 3060 meets requirements with 12 GB memory and 12.7 TFLOPS FP32.
The H200 offers 67 TFLOPS FP32 and 4800 GB/s bandwidth for large datasets.
Frequently Asked Questions
What is the memory difference between H200 and RTX 3060?▾
The H200 contains 141 GB HBM3e memory. The RTX 3060 contains 8 to 12 GB GDDR6 memory.
How does FP32 performance compare?▾
The H200 reaches 67 TFLOPS FP32. The RTX 3060 reaches 12.7 TFLOPS FP32.
Which GPU has higher memory bandwidth?▾
The H200 lists 4800 GB/s bandwidth. The RTX 3060 lists 360 GB/s bandwidth.
What are the TDP ratings?▾
The H200 has a 700 W TDP. The RTX 3060 has a 170 W TDP.
Can the RTX 3060 run FP16 workloads?▾
The RTX 3060 does not publish FP16 figures. The H200 publishes 989 TFLOPS dense FP16.
Which interconnects are supported?▾
The H200 supports NVLink and InfiniBand. The RTX 3060 supports PCIe 4.0.
Which is cheaper to rent, the H200 or the RTX 3060?▾
Cloud rental prices for both the H200 and RTX 3060 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.
How much VRAM does the H200 have compared to the RTX 3060?▾
The H200 has 141 GB of HBM3e memory. The RTX 3060 has 8 to 12 GB of GDDR6 memory.
Can I find H200 and RTX 3060 GPUs available to rent right now?▾
Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.
What is the main difference between the H200 and the RTX 3060?▾
The H200 uses the Hopper architecture (2024) while the RTX 3060 uses Ampere (2021). The H200 has 141 GB of HBM3e at 4,800 GB/s; the RTX 3060 has 8-12 GB of GDDR6 at 360 GB/s, so the H200 has 13.3x the memory bandwidth of the RTX 3060.
Rent these GPUs
Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.
Related comparisons
How this page is made
- Specifications come from the NVIDIA, AMD and Intel datasheets for the H200 and the RTX 3060. Dense and sparse throughput are listed separately.
- Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
- The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
- Read how we collect the data, or report an error on this page.
Next steps
- Rent H200Every current offer by provider, daily price history and a price alert.
- Rent RTX 3060Every current offer by provider, daily price history and a price alert.
- GPU price indexHow on-demand prices for the major GPUs have moved, updated daily.
- All GPUsEvery GPU we track, with current lows and provider counts.