14 articles with this tag
Decode AWS, Google Cloud, Azure and Oracle GPU names, check GPU counts and memory, then compare live AWS rates and dated Oracle rates with other providers.
hardware / guidesCompare HBM4 with HBM3E, separate JEDEC limits from maker claims, and check Rubin and AMD memory plans against the HBM3E GPUs in live rental tables.
guides / analysisCompare LoRA, QLoRA and full fine-tuning with worked 7B and 70B memory budgets, published quality results, GPU choices and live prices to estimate run costs.
guides / hardwareChoose how to split a model across rented GPUs, calculate training memory, and match tensor, pipeline and data parallelism to NVLink and cluster networks.
guides / analysisChoose an inference engine for your rented GPU using dated feature support, published benchmark setups, deployment options and practical workload rules.
hardware / guidesUnderstand AI inference, size training and serving memory, and choose a GPU using dense compute, memory bandwidth, workload limits and live rental prices.
hardware / guidesCompare HBM memory and GDDR7 by capacity, bandwidth and live GPU rental prices. Learn when faster memory helps LLM decode and when a GDDR card is enough.
hardware / guidesInfiniBand and RoCE Ethernet both move GPU traffic between servers. See the generations, provider fabrics, and when a single GPU or node needs neither.
hardware / pricingNVIDIA's DGX lineup and sourced system prices, compared with HGX servers from Dell, Supermicro and Lenovo, plus live rental rates for the same GPUs.
hardware / guidesVRAM, memory bandwidth and dense throughput decide an AI workload. How to find them on a datasheet, and why the headline TFLOPS figure is usually doubled.
pricing / hardwareVerified purchase listings for NVIDIA H200, B200, B300, GB200 NVL72 and A100 with seller and date, the misquoted figures corrected, and live rental prices.
pricing / hardwareWhat an H100 card, an 8-GPU server and a DGX H100 last listed for, with sellers and dates, next to live rental prices and a break-even method you can run.
hardware / guidesNVLink, PCIe and SXM explained for people renting multi-GPU servers: bandwidth per generation, what the H100 NVL is, and when the SXM premium pays off.
hardware / guidesMIG splits one NVIDIA data centre GPU into isolated instances with their own memory. See which GPUs support it and when a slice beats a whole cheap GPU.