NVIDIA HGX A100 (8-GPU)

Category Tags , , Brand:

  • 8X NVIDIA A100 GPUS WITH 320 GB TOTAL GPU MEMORY
  • 6X NVIDIA NVSWITCHES
  • 320 GB MEMORY
  • 4.8 TB/s TOTAL AGGREGATE BANDWIDTH

About

The Most Powerful Accelerated Server Platform for AI and High-Performance Computing

Massive datasets in machine learning, exploding model sizes in deep learning, and complex simulations in high-performance computing (HPC) require multiple GPUs with extremely fast interconnections. NVIDIA HGX A100 combines NVIDIA A100 Tensor Core GPUs with new NVIDIA® NVLink® and NVSwitch high-speed interconnects to create the world’s most powerful servers. A fully tested, easy-to-deploy baseboard, HGX A100 integrates into partner servers to provide guaranteed performance.

Specification

Specification
GPUs
8x NVIDIA A100
HPC and AI Compute FP64/TF32*/FP16*/INT8*
156TF/2.5PF*/5PF*/10POPS*
Memory
320 GB
NVIDIA NVLink
3rd generation
NVIDIA NVSwitch
2nd generation
NVIDIA NVSwitch GPU-to-GPU Bandwidth
600 GB/s
Total Aggregate Bandwidth
4.8 TB/s
Networking
8x Single-Port Mellanox ConnectX-6 VPI 200Gb/s HDR InfiniBand 1x Dual-Port Mellanox ConnectX-6 VPI 10/25/50/100/200Gb/s Ethernet
Storage
OS: 2x 1.92TB M.2 NVME drives Internal Storage: 15TB (4x 3.84TB) U.2 NVME drives
Software
Ubuntu Linux OS
System Weight
271 lbs (123 kgs)
Packaged System Weight
315 lbs (143kgs)
System Dimensions
Height: 10.4 in (264.0 mm) Width: 19.0 in (482.3 mm) MAX Length: 35.3 in (897.1 mm) MAX
Operating Temperature Range
5ºC to 30ºC (41ºF to 86ºF)

Our Partners

Sign up with our newsletter to follow the latest trends in server technology