Vipera Tech

Lenovo NVIDIA HGX H200 141GB 700W 8-GPU

0 out of 5 (0)

✔ Form Factor: 8U rack
✔ Form Factor: 8U rack
✔ Processor: Two 5th Gen Intel Xeon Scalable processors (8568Y+ 48C 350W 2.3GHz)
✔ Memory: Up to 2TB with 32x 64GB RDIMMs, TruDDR5 5600MHz (2Rx4)
✔ GPUs: Option for eight NVIDIA H100 or H200 GPUs (141GB HBM3 GPU memory per GPU)
✔ Storage: Up to 16x 2.5-inch hot-swap PCIe 5.0 NVMe drives; ThinkSystem 2.5″ U.3 PM1745 3.2TB Mixed Use NVMe PCIe 5.0 x4 HS SSD; ThinkSystem M.2 PM9A3 960GB Read Intensive NVMe PCIe 4.0 x4 NHS SSD
✔ Network Interfaces: Supports up to 400 Gb/s connectivity; Mellanox ConnectX-6 Lx 10/25GbE SFP28 2-Port PCIe Ethernet Adapter; NVIDIA ConnectX 7 400Gb/s NDR 1xOSFP, No Crypto
✔ Cooling: 15x hot-swap redundant fans, N+1 redundant
✔ Power Supply: Eight 2600W hot-swap redundant AC power supplies, 80 PLUS Titanium certified
✔ Additional Components: ThinkSystem SR680a V3 H200 GPU Base, 2.0m, 16A/100-250V, C19 to IEC 320-C20 Rack Power Cable
✔ Warranty: 3 Year Warranty

Unmatched Performance

The Lenovo ThinkSystem SR680a V3 Server is built to deliver top-tier performance. With dual 5th Gen Intel Xeon Scalable processors, each supporting up to 48 cores at 2.3 GHz, and a TDP rating of 350W, this server ensures powerful processing capabilities. The option to include up to eight NVIDIA H100 or H200 GPUs, each with substantial HBM3 memory, makes it a formidable choice for compute-intensive tasks.

High Scalability

The ThinkSystem SR680a V3 is engineered for scalability. It supports up to 2TB of memory with 32 DIMM slots, allowing extensive multitasking and high-speed data processing. The server’s PCIe 5.0 capabilities provide high-bandwidth connectivity, supporting up to 16x 2.5-inch hot-swap NVMe SSDs and multiple high-performance network adapters. This scalability ensures that the SR680a V3 can grow with your business needs.

The SR680a V3 offers robust management and security features. The XClarity Controller 2 provides advanced service-processor control, monitoring, and alerting, consolidating key management functions into a single interface. Security is enhanced with TPM 2.0, ECC memory, and additional protection features such as SDDC and ADDDC for reliable data integrity. The integrated diagnostics panel and XClarity Administrator ensure streamlined and efficient management.

Components	Specification
Machine types	7DHE – 3 year warranty
Form factor	8U rack.
Processor	Two 5th Gen Intel Xeon Scalable processors (formerly codenamed “Emerald Rapids”). Supports a processor with 48 cores, core speed of 2.3 GHz, and TDP rating of 350W. Supports PCIe 5.0 for high performance I/O.
Chipset	Intel C741 “Emmitsburg” chipset, part of the platform codenamed “Eagle Stream”
GPUs	Choice of: Eight NVIDIA H100 700W SXM5 GPUs with 80GB HBM3 GPU memory per GPU Eight NVIDIA H200 700W SXM5 GPUs with 141GB HBM3 GPU memory per GPU
Memory	32 DIMM slots with two processors (16 DIMM slots per processor). Each processor has 8 memory channels, with 2 DIMMs per channel (DPC). Lenovo TruDDR5 RDIMMs are supported. DIMMs operate at up to 5600 MHz at 1 DPC and up to 4400 MHz at 2 DPC.
Memory maximum	Up to 2TB with 32x 64GB RDIMMs
Persistent memory	Not supported.
Memory protection	ECC, SDDC (for x4-based memory DIMMs), ADDDC (for x4-based memory DIMMs excluding 9×4 RDIMMs, requires Platinum or Gold processors), and memory mirroring.
Disk drive bays	Up to 16x 2.5-inch hot-swap drive bays, supporting PCIe 5.0 NVMe drives.
OS boot drives	Support for two M.2 drives with optional Intel VROC NVMe RAID support for OS boot and data storage functions
Maximum internal storage	51.2 TB using 16x 3.2TB 2.5-inch NVMe SSDs
Storage controller	Onboard NVMe (Non-RAID)
Network interfaces	Supports 8x high-performance network adapters up to 400 Gb/s connectivity with GPU Direct support. Supports a NVIDIA BlueField-3 2-port 200Gb adapter for the User/Control Plane and a Mellanox ConnectX-6 Lx 2-port 10/25GbE adapter for management.
PCI Expansion slots	10x PCIe 5.0 x16 slots: Front: 8x PCIe 5.0 x16 FHHL slots with GPU Direct support Rear: 2x PCIe 5.0 x16 FHHL slots
Ports	Front: 1x USB 3.2 G1 (5 Gb/s) port, 1x USB 2.0 port (also for XCC local management), 1x Mini DisplayPort video port. Rear: 2x USB 3.2 G1 (5 Gb/s) ports, 1x VGA video port, 1x RJ-45 1GbE systems management port for XCC remote management.
Cooling	5x front-mounted dual-rotor fans for the CPU and storage subsystem, N+1 redundant. 10x rear-mounted dual-rotor fans for the GPU subsystem, N+1 redundant. One fan integrated in each power supply. Front-to-rear airflow.
Power supply	Eight hot-swap redundant AC power supplies with up to N+N redundancy. 80 PLUS Titanium certification. 2600 W AC power supplies requiring 220 V AC supply.
Video	Embedded graphics with 16 MB memory with 2D hardware accelerator, integrated into the XClarity Controller 2 management controller. Two video ports (front Mini DisplayPort and rear VGA); both can be used simultaneously if desired. Maximum resolution of both ports is 1920×1200 at 60Hz.
Hot-swap parts	Drives, power supplies, and fans.
Systems management	Integrated Diagnostics Panel with status LEDs and pull-out LCD display. XClarity Controller 2 (XCC2) embedded management based on the ASPEED AST2600 baseboard management controller (BMC). Dedicated rear Ethernet port for XCC2 remote access for management. XClarity Administrator for centralized infrastructure management, XClarity Integrator plugins, and XClarity Energy Manager centralized server power management. Optional XCC Platinum to enable remote control functions and other features.
Security features	Power-on password, administrator’s password, Root of Trust module supporting TPM 2.0 and Platform Firmware Resiliency (PFR).
Operating systems supported	Ubuntu Server. See the Operating system support section for specifics.
Limited warranty	Three-year or one-year (model dependent) customer-replaceable unit and onsite limited warranty with 9×5 next business day (NBD).
Service and support	Optional service upgrades are available through Lenovo Services: 4-hour or 2-hour response time, 6-hour fix time, 1-year or 2-year warranty extension, software support for Lenovo hardware and some third-party applications.
Dimensions	Width: 447 mm (17.6 in.), height: 351 mm (13.8 in.), depth: 924 mm (36.3 in.). See Physical and electrical specifications for details.
Weight	Maximum: 102.9 kg (226.8 lbs)

Components

Specification

Machine types

7DHE – 3 year warranty

Form factor

8U rack.

Processor

Two 5th Gen Intel Xeon Scalable processors (formerly codenamed “Emerald Rapids”). Supports a processor with 48 cores, core speed of 2.3 GHz, and TDP rating of 350W. Supports PCIe 5.0 for high performance I/O.

Chipset

Intel C741 “Emmitsburg” chipset, part of the platform codenamed “Eagle Stream”

GPUs

Choice of:

Eight NVIDIA H100 700W SXM5 GPUs with 80GB HBM3 GPU memory per GPU
Eight NVIDIA H200 700W SXM5 GPUs with 141GB HBM3 GPU memory per GPU

Memory

32 DIMM slots with two processors (16 DIMM slots per processor). Each processor has 8 memory channels, with 2 DIMMs per channel (DPC). Lenovo TruDDR5 RDIMMs are supported. DIMMs operate at up to 5600 MHz at 1 DPC and up to 4400 MHz at 2 DPC.

Memory maximum

Up to 2TB with 32x 64GB RDIMMs

Persistent memory

Not supported.

Memory protection

ECC, SDDC (for x4-based memory DIMMs), ADDDC (for x4-based memory DIMMs excluding 9×4 RDIMMs, requires Platinum or Gold processors), and memory mirroring.

Disk drive bays

Up to 16x 2.5-inch hot-swap drive bays, supporting PCIe 5.0 NVMe drives.

OS boot drives

Support for two M.2 drives with optional Intel VROC NVMe RAID support for OS boot and data storage functions

Maximum internal storage

51.2 TB using 16x 3.2TB 2.5-inch NVMe SSDs

Storage controller

Onboard NVMe (Non-RAID)

Network interfaces

Supports 8x high-performance network adapters up to 400 Gb/s connectivity with GPU Direct support. Supports a NVIDIA BlueField-3 2-port 200Gb adapter for the User/Control Plane and a Mellanox ConnectX-6 Lx 2-port 10/25GbE adapter for management.

PCI Expansion slots

10x PCIe 5.0 x16 slots:

Front: 8x PCIe 5.0 x16 FHHL slots with GPU Direct support
Rear: 2x PCIe 5.0 x16 FHHL slots

Ports

Front: 1x USB 3.2 G1 (5 Gb/s) port, 1x USB 2.0 port (also for XCC local management), 1x Mini DisplayPort video port.
Rear: 2x USB 3.2 G1 (5 Gb/s) ports, 1x VGA video port, 1x RJ-45 1GbE systems management port for XCC remote management.

Cooling

5x front-mounted dual-rotor fans for the CPU and storage subsystem, N+1 redundant. 10x rear-mounted dual-rotor fans for the GPU subsystem, N+1 redundant. One fan integrated in each power supply. Front-to-rear airflow.

Power supply

Eight hot-swap redundant AC power supplies with up to N+N redundancy. 80 PLUS Titanium certification. 2600 W AC power supplies requiring 220 V AC supply.

Video

Embedded graphics with 16 MB memory with 2D hardware accelerator, integrated into the XClarity Controller 2 management controller. Two video ports (front Mini DisplayPort and rear VGA); both can be used simultaneously if desired. Maximum resolution of both ports is 1920×1200 at 60Hz.

Hot-swap parts

Drives, power supplies, and fans.

Systems management

Integrated Diagnostics Panel with status LEDs and pull-out LCD display. XClarity Controller 2 (XCC2) embedded management based on the ASPEED AST2600 baseboard management controller (BMC). Dedicated rear Ethernet port for XCC2 remote access for management. XClarity Administrator for centralized infrastructure management, XClarity Integrator plugins, and XClarity Energy Manager centralized server power management. Optional XCC Platinum to enable remote control functions and other features.

Security features

Power-on password, administrator’s password, Root of Trust module supporting TPM 2.0 and Platform Firmware Resiliency (PFR).

Operating systems supported

Ubuntu Server. See the Operating system support section for specifics.

Limited warranty

Three-year or one-year (model dependent) customer-replaceable unit and onsite limited warranty with 9×5 next business day (NBD).

Service and support

Optional service upgrades are available through Lenovo Services: 4-hour or 2-hour response time, 6-hour fix time, 1-year or 2-year warranty extension, software support for Lenovo hardware and some third-party applications.

Dimensions

Width: 447 mm (17.6 in.), height: 351 mm (13.8 in.), depth: 924 mm (36.3 in.). See Physical and electrical specifications for details.

Weight

Maximum: 102.9 kg (226.8 lbs)