NVIDIA DGX H100

SKU DGX H100 Category Brand:

  • 8X NvidiaH100 Gpus With 640 Gigabytes of total gpu memory
  • 4x Nvidia Nvswitches
  • 8X Nvidia Connect-7 and 2x Nvidia bluefield dpu 400 gigabits-per-second network interface
  • Dual x86 CPUs and 2 Terabytes of system memory
  • 30 Terabytes NVME SSD

About

Artificial intelligence has become the go-to approach for solving difficult business
challenges. Whether improving customer service, optimizing supply chains, extracting
business intelligence, or designing cutting-edge products and services across nearly
every industry, AI gives organizations the mechanism to realize innovation. And as a
pioneer in AI infrastructure, NVIDIA DGX™ systems provide the most powerful and
complete AI platform for bringing these essential ideas to fruition.
NVIDIA DGX H100 powers business innovation and optimization. The latest iteration of
NVIDIA’s legendary DGX systems and the foundation of NVIDIA DGX SuperPOD™, DGX
H100 is an AI powerhouse that features the groundbreaking NVIDIA H100 Tensor Core
GPU. The system is designed to maximize AI throughput, providing enterprises with a
highly refined, systemized, and scalable platform to help them achieve breakthroughs
in natural language processing, recommender systems, data analytics, and much
more. Available on-premises and through a wide variety of access and deployment
options, DGX H100 delivers the performance needed for enterprises to solve the
biggest challenges with AI.

Specification

Specification
GPUs
8x NVIDIA H100 Tensor Core GPUs
GPU memory
640GB total
Performance
32 petaFLOPS FP8
NVIDIA® NVSwitch™
4x
System power usage
~10.2kW max
CPU
Dual x86
System memory
2TB
Networking
4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 400Gb/s InfiniBand/Ethernet 2x dual-port NVIDIA BlueField-3 DPUs VPI 1x 400Gb/s InfiniBand/Ethernet 1x 200Gb/s InfiniBand/Ethernet
Management network
10Gb/s onboard NIC with RJ45 50Gb/s Ethernet optional NIC Host baseboard management controller (BMC) with RJ45 2x NVIDIA BlueField-3 DPU BMC (with RJ45 each)
Storage
OS: 2x 1.9TB NVMe M.2 Internal storage: 8x 3.84TB NVMe U.2
System software
DGX H100 systems come preinstalled with DGX OS, which is based on Ubuntu Linux and includes the DGX software stack (all necessary packages and drivers optimized for DGX). Optionally, customers can install Ubuntu Linux or Red Hat Enterprise Linux and the required DGX software stack separately.
Operating temperature range
5–30°C (41–86°F)

Our Partners

Sign up with our newsletter to follow the latest trends in server technology