NVIDIA DGX GH200
- 32x NVIDIA Grace Hopper Superchips, interconnected with NVIDIA NVLink
- Massive, shared GPU memory space of 19.5TB
- 900 gigabytes per second (GB/s) GPU-to-GPU bandwidth
- 128 petaFLOPS of FP8 AI performance
About
The NVIDIA DGX GH200’s massive shared memory space uses NVLink interconnect technology with the NVLink Switch System to combine 256 GH200 superchips, allowing them to perform as a single GPU. This provides 1 exaflop of performance and 144 terabytes of shared memory — nearly 500x more memory than the previous generation NVIDIA DGX A100, which was introduced in 2020.
Specification
Specification
CPU and GPU
32x NVIDIA Grace Hopper Superchips
CPU Cores
2,304 Arm® Neoverse V2 Cores with SVE2 4X 128b
Shared Memory
19.5 TB
Performance
128 petaFLOPS of FP8 AI performance
Networking
32x OSFP single-port NVIDIA ConnectX-7 VPI with 400Gb/s InfiniBand
16x dual-port NVIDIA BlueField®-3 VPI with 200Gb/s InfiniBand and Ethernet
NVIDIA NVLink Switch System
9x L1 NVIDIA NVLink Switches
Management Network
Host baseboard management controller
(BMC) with RJ45
Networking
4x OSFP ports serving 8x single-port
NVIDIA ConnectX-7
400Gb/s InfiniBand/Ethernet
2x dual-port NVIDIA BlueField-3
DPUs VPI
1x 400Gb/s InfiniBand/Ethernet
1x 200Gb/s InfiniBand/Ethernet
Software
NVIDIA AI Enterprise (optimized AI software)
NVIDIA Base Command (orchestration, scheduling, and cluster management)
DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky (operating system)
You May Also Like
Related products
-
NVIDIA DGX STATION A100 320GB/160GB
SKU: DGXS-2080C+P2CMI00More Information- 2.5 petaFLOPS of performance
- World-class AI platform, with no complicated installation or IT help needed
- Server-grade, plug-and-go, and doesn’t require data center power and cooling
- 4 fully interconnected NVIDIA A100 Tensor Core GPUs and up to 320 gigabytes (GB) of GPU memory
-
NVIDIA DGX-2
SKU: N/AMore Information- WORLD’s FIRST 2 PETAFLOPS SYSTEM
- ENTERPRISE GRADE AI INFRASTRUCTURE
- 12 TOTAL NVSWITCHES + 8 EDR INFINIBAND/100 GbE ETHERNET
- 2 INTEL PLATINUM CPUS + 1.5 TB SYSTEM MEMORY + DUAL 10/25 GbE ETHERNET
- 30 TB NVME SSDS INTERNAL STORAGE
-
NVIDIA DGX H200
SKU: 900-2G133-0010-000-1-1More Information- 8x NVIDIA H200 GPUs with 1,128GBs of Total GPU Memory
- 4x NVIDIA NVSwitches™
- 10x NVIDIA ConnectX®-7 400Gb/s Network Interface
- Dual Intel Xeon Platinum 8480C processors
- 30TB NVMe SSD
Our Partners
Previous
Next