✓ 256x NVIDIA Grace Hopper Superchips
✓ 18,432 Arm® Neoverse V2 Cores
✓ 144TB GPU Memory
✓ 1 exaFLOPS Performance
✓ Comprehensive Networking Suite
✓ NVIDIA NVLink Switch System
✓ Host baseboard management controller
✓ Includes NVIDIA AI Enterprise, NVIDIA Base Command, and various OS options
✓ Three-year standard support
✓ Super power-efficient computing
✓ Fully integrated and ready-to-run solution
✓ Three-year return to base repair and servicing warranty
Deliveries will begin at the end of Q1, 2025. End-user agreement, export conrol and usage terms required. All sales final. No returns or cancellations. For bulk inquiries, consult a live chat agent or call our toll-free number.
Unlike existing AI supercomputers that are designed to support workloads that fit within the memory of a single system, NVIDIA DGX GH200 is the only AI supercomputer that offers a shared memory space of up to 144TB across 256 Grace Hopper Superchips, providing developers with nearly 500X more fast-access memory to build massive models. DGX GH200 is the first supercomputer to pair Grace Hopper Superchips with the NVIDIA NVLink Switch System, which allows up to 256 GPUs to be united as one data-center-size GPU. This architecture provides 48X more bandwidth than the previous generation, delivering the power of a massive AI supercomputer with the simplicity of programming a single GPU.
| Specification | Details |
|---|---|
| Processor | NVIDIA GH200 Grace™ Hopper™ Superchip |
| Processor Family | NVIDIA Grace™ 72 Arm® Neoverse V2 cores |
| Max. TDP Support | 1000W |
| Number of Processors | 1 Processor |
| Internal Interconnect | NVIDIA® NVLink®-C2C 900GB/s |
| Form Factor | 2U Rackmount |
| Dimensions (W x H x D) | 17.24″ x 3.44″ x 35.43″ (inches) / 438 x 87.5 x 900 (mm) |
| Storage | 4 E1.S NVMe SSDs |
| Memory | Up to 480GB LPDDRX embedded, 96GB HBM3 GPU memory |
| Expansion Slot | 3 PCIe 5.0 x16 FHFL Dual Width slots (includes PCIE CX7 ADP NIC 2P 200G QSFP112) |
| Front I/O | Power/ID/Reset Buttons, Power/ID/Status LEDs, 2 USB 3.0 ports, 1 VGA port |
| Storage Controller | Broadcom HBA 9500 Series Storage Adaptor (includes 9500-16i HBA) |
| Power Supply | 1+1 High efficiency hot-plug 2000W PSU, 80 Plus Titanium |
| Onboard Storage | 2 22110/2280 PCIe M.2 (includes E1.S 1.92TB + M.2 960GB SSD) |
| Fan | 5 6056 dual rotor fans (N+1 redundant) |
| Rear I/O | 1 USB 3.0, 1 Mini display port, 1 ID LED, 1 PWR Button/PWR LED, 1 COM Port (micro USB type-B), 1 RJ45 mgmt port |
| Operating Environment | Operating temperature: 5°C to 35°C (41°F to 95°F), Non-operating temperature: -40°C to 70°C, Operating relative humidity: 20% to 85%RH, Non-operating relative humidity: 10% to 95%RH |
| TPM | TPM 2.0 SPI module (optional) |
| CPU and GPU | 256x NVIDIA Grace Hopper Superchips |
| CPU Cores | 18,432 Arm® Neoverse V2 Cores with SVE2 4X 128b |
| GPU Memory | 144TB |
| Performance | 1 exaFLOPS |
| Networking | 256x OSFP single-port NVIDIA ConnectX®-7 VPI with 400Gb/s InfiniBand, 256x dual-port NVIDIA BlueField®-3 VPI with 200Gb/s InfiniBand and Ethernet, 24x NVIDIA Quantum-2 QM9700 InfiniBand Switches, 20x NVIDIA Spectrum™ SN2201 Ethernet Switches, 22x NVIDIA Spectrum SN3700 Ethernet Switches |
| NVIDIA NVLink Switch System | 96x L1 NVIDIA NVLink Switches, 36x L2 NVIDIA NVLink Switches |
| Management Network | Host baseboard management controller (BMC) with RJ45 |
| Software | NVIDIA AI Enterprise (optimized AI software), NVIDIA Base Command (orchestration, scheduling, and cluster management), DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky (operating system) |
| Support | Three-year business-standard hardware and software support |
| Power Efficiency | Uses NVIDIA Grace Hopper architecture for super power-efficient computing. Each NVIDIA Grace Hopper Superchip is both a CPU and GPU in one unit, connected with superfast NVIDIA NVLink-C2C. The Grace™ CPU uses LPDDR5X memory, which consumes one-eighth the power of traditional DDR5 system memory while providing 50 percent more bandwidth than eight-channel DDR5. |
| Integration | Fully tested and integrated solution with software, compute, and networking, that includes white-glove services spanning installation and infrastructure management to expert advice on optimizing workloads. |
No reviews available.