NVIDIA DGX H200 AI Server

Components Inside DGX H200 System

Delivering AI Factories to Every Enterprise, NVIDIA DGX SuperPOD™ is a turnkey AI data center infrastructure solution that delivers uncompromising performance for every user and workload. Configurable with any DGX system, DGX SuperPOD provides leadership-class accelerated infrastructure with scalable performance for the most demanding AI training and inference workloads, with industry-proven results, allowing IT to deliver performance without compromise.

NVIDIA DGX SuperPOD

NVIDIA DGX SuperPOD is a turnkey AI data center infrastructure solution that delivers uncompromising performance for every user and workload. Configurable with any NVIDIA DGX system, DGX SuperPOD provides leadership-class accelerated infrastructure with scalable performance for the most demanding AI training and inference workloads, with industry-proven results, allowing it to deliver performance without compromise.

GPU	8x NVIDIA H200 Tensor Core GPUs
GPU Memory	1,128GB total
Performance	32petaFLOPS FP8
NVIDIA NVSwitch	4x
System Power Usage	~10.2kW max
CPU	Dual Intel® Xeon® Platinum 8480C Processors 112 cores total, 2.00GHz (Base), 3.80GHz (max boost)
System Memory	2TB
Networking	4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 VPI Up to 400Gb/s NVIDIA InfiniBand/Ethernet
Management Network	10Gb/s onboard NIC with RJ45 100Gb/s Ethernet optional NIC Host baseboard management controller (BMC) with RJ45
Storage	OS: 2x 1.9TB NVMe M.2 Internal storage: 8x 3.84TB NVMe U.2
Software	NVIDIA AI Enterprise – Optimized AI software NVIDIA Base Command – Orchestration, scheduling, and cluster management NVIDIA DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky – Operating system
System Weight	287.6lb (130.45kgs)
System Dimensions	Height: 14.0in (356mm) Width: 19.0in (482.2mm) Length: 35.3in (897.1mm)
Operating Temperature	5–30°C (41–86°F)