NVIDIA HGX A100 (8-GPU)
- 8X NVIDIA A100 GPUS WITH 320 GB TOTAL GPU MEMORY
- 6X NVIDIA NVSWITCHES
- 320 GB MEMORY
- 4.8 TB/s TOTAL AGGREGATE BANDWIDTH
About
The Most Powerful Accelerated Server Platform for AI and High-Performance Computing
Massive datasets in machine learning, exploding model sizes in deep learning, and complex simulations in high-performance computing (HPC) require multiple GPUs with extremely fast interconnections. NVIDIA HGX A100 combines NVIDIA A100 Tensor Core GPUs with new NVIDIA® NVLink® and NVSwitch™ high-speed interconnects to create the world’s most powerful servers. A fully tested, easy-to-deploy baseboard, HGX A100 integrates into partner servers to provide guaranteed performance.
Specification
Specification
GPUs
8x NVIDIA A100
HPC and AI Compute FP64/TF32*/FP16*/INT8*
156TF/2.5PF*/5PF*/10POPS*
Memory
320 GB
NVIDIA NVLink
3rd generation
NVIDIA NVSwitch
2nd generation
NVIDIA NVSwitch GPU-to-GPU Bandwidth
600 GB/s
Total Aggregate Bandwidth
4.8 TB/s
Networking
8x Single-Port Mellanox
ConnectX-6 VPI
200Gb/s HDR InfiniBand
1x Dual-Port Mellanox
ConnectX-6 VPI
10/25/50/100/200Gb/s
Ethernet
Storage
OS: 2x 1.92TB M.2 NVME drives
Internal Storage: 15TB
(4x 3.84TB) U.2 NVME drives
Software
Ubuntu Linux OS
System Weight
271 lbs (123 kgs)
Packaged System Weight
315 lbs (143kgs)
System Dimensions
Height: 10.4 in (264.0 mm)
Width: 19.0 in (482.3 mm) MAX
Length: 35.3 in (897.1 mm) MAX
Operating Temperature Range
5ºC to 30ºC (41ºF to 86ºF)
You May Also Like
Related products
-
NVIDIA DGX GH200
SKU: DGX GH200-1- 32x NVIDIA Grace Hopper Superchips, interconnected with NVIDIA NVLink
- Massive, shared GPU memory space of 19.5TB
- 900 gigabytes per second (GB/s) GPU-to-GPU bandwidth
- 128 petaFLOPS of FP8 AI performance
-
NVIDIA DGX H200
SKU: 900-2G133-0010-000-1-1- 8x NVIDIA H200 GPUs with 1,128GBs of Total GPU Memory
- 4x NVIDIA NVSwitches™
- 10x NVIDIA ConnectX®-7 400Gb/s Network Interface
- Dual Intel Xeon Platinum 8480C processors
- 30TB NVMe SSD
-
NVIDIA TESLA P40
SKU: N/A- GPU Memory: 24 GB
- CUDA Cores: 3840
- Single-Precision Performance: 12 TeraFLOPS
- System Interface: x16 PCIe Gen3
Our Partners
Previous
Next