NVIDIAUnknown Architecture

Rent NVIDIA H200 SXM Cloud Instances

The NVIDIA H200 SXM is a high-performance data center GPU designed for demanding AI, HPC, and data analytics workloads. Building upon the Hopper architecture, the H200 offers enhanced memory capacity and bandwidth compared to its predecessors, enabling faster processing of large datasets and more co...

📊 Pricing at a Glance

Cheapest Provider
Nebius
$2.45/GPU/hr
Most Expensive
LeaderGPU
$6.22/GPU/hr
Median Price
$3.39/GPU/hr
Total Instances
96
Providers
14
Last Updated
July 21, 2026

NVIDIA H200 SXM rental pricing ranges from $2.45/GPU/hr to $6.22/GPU/hr across 96 instances from 14 providers (updated July 2026).

Looking for a specific provider? See Nebius NVIDIA H200 SXM, RunPod NVIDIA H200 SXM, or Crusoe NVIDIA H200 SXM.

Available Offers

Compare the top 5 cheapest offers from 14 providers.

12 instances available
NVIDIA H200 SXM
141GB VRAM
16 vCPU
200GB RAM
$2.45/GPU/hr
NVIDIA H200 SXM
141GB VRAM
24 vCPU
276GB RAM
$4.39/GPU/hr
NVIDIA H200 SXM
141GB VRAM
24 vCPU
276GB RAM
$4.39/GPU/hr
NVIDIA H200 SXM
141GB VRAM
24 vCPU
276GB RAM
$4.39/GPU/hr
NVIDIA H200 SXM
141GB VRAM
24 vCPU
276GB RAM
$4.39/GPU/hr

QuantaCloud

H-series supply is constrained.

Most providers are sold out through Q3 2026. If you need 16+ GPU reserved or cluster capacity in the next 90 days, we can quote B300 or remaining Hopper inventory within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Technical Specifications

CUDA cores
Architecture Dependent (Hopper)
Memory type
HBM3e
Tensor cores
4th Generation
FP8 performance
Varies with configuration and software
Memory bandwidth
4.8 TB/s

Strengths & Limitations

Advantages
  • Exceptional memory bandwidth with HBM3e, enabling faster data processing.
  • High compute performance for AI training and inference.
  • SXM form factor allows for high-speed GPU-to-GPU communication.
  • Optimized for large language models and generative AI workloads.
  • Supports NVIDIA's comprehensive software stack, including CUDA and TensorRT.
Limitations
  • High cost compared to other GPUs.
  • SXM form factor limits deployment options to compatible servers.
  • High power consumption requires robust cooling solutions.
  • May be overkill for smaller or less demanding workloads.

Top Use Cases

Large Language Model (LLM) Training

The H200's massive memory capacity and bandwidth are crucial for training large language models with billions of parameters. It enables faster iteration and improved model accuracy.

High-Performance Computing (HPC)

Scientific simulations, weather forecasting, and computational fluid dynamics benefit from the H200's high compute performance and memory bandwidth, accelerating complex calculations.

Data Analytics and Machine Learning

The H200 accelerates data processing and model training for various machine learning tasks, including image recognition, natural language processing, and fraud detection.

Real-World Benchmark

AI Training Performance
The NVIDIA H200 SXM significantly outperforms previous generation GPUs in AI training benchmarks, particularly for large models. Specific performance gains depend on the model architecture, dataset size, and software optimization.
Est. Cost$1.90/hr

Market Analysis

The NVIDIA H200 SXM is positioned as a premium GPU for the most demanding AI and HPC workloads. Its high price reflects its advanced capabilities and target market. It competes with other high-end GPUs, such as the NVIDIA H100 and AMD Instinct MI300X, as well as future generation GPUs. The market for these high-performance GPUs is driven by the increasing demand for AI and data analytics, particularly in cloud computing and enterprise data centers.

Frequently Asked Questions

What is the difference between the H200 SXM and H100 SXM?

The H200 SXM features increased memory capacity and bandwidth compared to the H100 SXM, using HBM3e memory. This allows it to handle larger datasets and more complex models more efficiently.

What kind of power supply is required for a server with H200 SXM GPUs?

Servers with H200 SXM GPUs require high-wattage power supplies and robust cooling solutions due to the GPU's high power consumption. Consult the server manufacturer's specifications for detailed requirements.

What software frameworks are compatible with the H200 SXM?

The H200 SXM is compatible with NVIDIA's CUDA toolkit, TensorRT, and other popular machine learning frameworks such as TensorFlow, PyTorch, and MXNet.

Alternative GPUs

NVIDIA H100 SXM5
$0.74/hr

A previous generation high-performance GPU that may be suitable for less memory-intensive workloads. Offers a lower cost alternative, but with reduced memory capacity and bandwidth.

AMD Instinct MI300X
$0.50/hr

A competing high-performance GPU from AMD, offering similar capabilities for AI and HPC workloads. Consider for vendor diversity or if AMD's software ecosystem aligns better with your needs. Significantly cheaper.

NVIDIA A100 SXM4 80GB
$0.78/hr

An older generation, but still powerful GPU. If your workload fits within its 80GB memory capacity, it can be a cost-effective alternative. Less performant, but significantly cheaper.

Cite This Data
This pricing data is updated daily and free to cite with attribution.
Source: GPUPerHour.com — NVIDIA H200 SXM GPU Rental Pricing Comparison (July 2026)

Journalists, bloggers, and researchers: You're welcome to cite our data in your articles with attribution. Our pricing database is updated in real-time from 14+ cloud providers.

H200 SXM Pricing: What It Costs in 2026

H200 SXM cloud GPU pricing ranges from $2.45/hr on Nebius to $6.22/hr on LeaderGPU, based on 96 offers tracked by GPUPerHour across 14 providers. 12 instances are currently in stock across 24 regions.

Running a H200 SXM continuously for one month at the cheapest available rate costs approximately $1764. Most providers bill per second or per minute, so shorter jobs cost proportionally less. Prices on GPUPerHour update every 60 seconds, reflecting real-time changes in provider pricing and availability.

Renting H200 SXM: Which Provider to Choose

GPUPerHour tracks H200 SXM offers from 14 providers. The cheapest option is Nebius at $2.45/hr, followed by RunPod at $4.39/hr and Crusoe at $6.00/hr.

Price is not the only factor when choosing a provider. Availability matters: 12 of 96 instances are in stock right now. Billing increments, region coverage, and security certifications also vary between providers. Use the pricing tool to filter by region, availability, and provider features.

How H200 SXM Compares

Compared to alternatives, the NVIDIA H100 SXM5 is available from $0.74/hr. A previous generation high-performance GPU that may be suitable for less memory-intensive workloads. Offers a lower cost alternative, but with reduced memory capacity and bandwidth. The AMD Instinct MI300X is available from $0.50/hr. A competing high-performance GPU from AMD, offering similar capabilities for AI and HPC workloads. Consider for vendor diversity or if AMD's software ecosystem aligns better with your needs. Significantly cheaper. The NVIDIA A100 SXM4 80GB is available from $0.78/hr. An older generation, but still powerful GPU. If your workload fits within its 80GB memory capacity, it can be a cost-effective alternative. Less performant, but significantly cheaper.

For detailed head-to-head analysis, see: a10 vs h200 sxm, a100 pcie 40gb vs h200 sxm, a100 pcie 80gb vs h200 sxm.

H200 SXM Pricing FAQ

How much does H200 SXM cost per hour?

H200 SXM cloud rental pricing starts at $2.45/hr on Nebius and goes up to $6.22/hr. Running a H200 SXM continuously for one month at the cheapest rate costs approximately $1764. GPUPerHour tracks pricing from 14 providers with prices updated every 60 seconds.

Which is the cheapest provider for H200 SXM?

The cheapest H200 SXM is available on Nebius at $2.45/hr, RunPod at $4.39/hr, Crusoe at $6.00/hr. 12 instances are currently in stock across 14 providers.

What are the alternatives to H200 SXM?

Alternatives to the H200 SXM include NVIDIA H100 SXM5 ($0.74/hr), AMD Instinct MI300X ($0.50/hr), NVIDIA A100 SXM4 80GB ($0.78/hr). A previous generation high-performance GPU that may be suitable for less memory-intensive workloads. Offers a lower cost alternative, but with reduced memory capacity and bandwidth.

H200 SXM Price: $1.99/hr on Vast.ai | GPUPerHour