NVIDIA HGX A100 (8-GPU)
- 8X NVIDIA A100 GPUS WITH 320 GB TOTAL GPU MEMORY
- 6X NVIDIA NVSWITCHES
- 320 GB MEMORY
- 4.8 TB/s TOTAL AGGREGATE BANDWIDTH
About
The Most Powerful Accelerated Server Platform for AI and High-Performance Computing
Massive datasets in machine learning, exploding model sizes in deep learning, and complex simulations in high-performance computing (HPC) require multiple GPUs with extremely fast interconnections. NVIDIA HGX A100 combines NVIDIA A100 Tensor Core GPUs with new NVIDIA® NVLink® and NVSwitch™ high-speed interconnects to create the world’s most powerful servers. A fully tested, easy-to-deploy baseboard, HGX A100 integrates into partner servers to provide guaranteed performance.
Specification
Specification
GPUs
8x NVIDIA A100
HPC and AI Compute FP64/TF32*/FP16*/INT8*
156TF/2.5PF*/5PF*/10POPS*
Memory
320 GB
NVIDIA NVLink
3rd generation
NVIDIA NVSwitch
2nd generation
NVIDIA NVSwitch GPU-to-GPU Bandwidth
600 GB/s
Total Aggregate Bandwidth
4.8 TB/s
Networking
8x Single-Port Mellanox
ConnectX-6 VPI
200Gb/s HDR InfiniBand
1x Dual-Port Mellanox
ConnectX-6 VPI
10/25/50/100/200Gb/s
Ethernet
Storage
OS: 2x 1.92TB M.2 NVME drives
Internal Storage: 15TB
(4x 3.84TB) U.2 NVME drives
Software
Ubuntu Linux OS
System Weight
271 lbs (123 kgs)
Packaged System Weight
315 lbs (143kgs)
System Dimensions
Height: 10.4 in (264.0 mm)
Width: 19.0 in (482.3 mm) MAX
Length: 35.3 in (897.1 mm) MAX
Operating Temperature Range
5ºC to 30ºC (41ºF to 86ºF)
You May Also Like
Related products
-
NVIDIA JETSON™ AGX XAVIER DEVELOPER KIT
SKU: N/A- GPU Memory: 32GB
- CUDA Core: 512-core Volta GPU with Tensor Cores
- CPU: 8-core ARM v8.2 64-bit
-
NVIDIA A100 TENSOR CORE GPU
SKU: N/A- GPU Memory: 40 GB
- Peak FP16 Tensor Core: 312 TF
- System Interface: 4/8 SXM on NVIDIA HGX A100
-
CUDA
SKU: N/ACUDA is a parallel computing platform and programming model developed by Nvidia for general computing on its own GPUs (graphics processing units). CUDA enables developers to speed up compute-intensive applications by harnessing the power of GPUs for the parallelizable part of the computation. This post is a super simple introduction to CUDA, the popular parallel computing ...More Information
Our Customers

























Previous
Next