High Performance Computing Systems

For information on restricted systems, see the Restricted Systems page. (Authentication required.)

SCOUT SCOUT
SCOUT is an IBM Power9 system located at the ARL DSRC. It has 22 Training nodes, each with 6 nVidia V100 GPUs, 128 Inference nodes, each with 4 nVidia T4 GPUs, and 2 Visualization nodes, each with 2 nVidia GPUs (a total of 152 compute nodes or 6,080 cores). It has 45 TB of memory.

Node Configuration
Login Training Inference Visualization
Total Nodes 4 22 128 2
Processor IBM POWER9 IBM POWER9 IBM POWER9 IBM POWER9
Processor Speed 2.55 GHz 2.55 GHz 2.55 GHz 2.55 GHz
Sockets / Node 2 2 2 2
Cores / Node 40 40 40 40
Total CPU Cores 160 880 5,120 80
Useable Memory / Node 502 GB 690 GB 246 GB 502 GB
Accelerators / Node None 6 4 2
Accelerator n/a NVIDIA V100 PCIe NVIDIA T4 PCIe NVIDIA V100 PCIe
Memory / Accelerator n/a 32 GB 16 GB 16 GB
Storage on Node 1.5 TB PCIe 12 TB PCIe 3.3 TB PCIe 3.3 TB PCIe
Interconnect InfiniBand EDR InfiniBand EDR InfiniBand EDR InfiniBand EDR
OS RHEL RHEL RHEL RHEL

File Systems on SCOUT
Path Formatted Capacity File System Type Storage Type User Quota Minimum File Retention
/p/home ($HOME) 132 TB GPFS HDD None None
/p/work1 ($WORKDIR) 1.2 PB GPFS HDD None None
/p/cwfs ($CENTER) 3.3 PB GPFS HDD None 120 Days
/p/app ($PROJECTS_HOME) 90 TB GPFS HDD None None

Centennial Centennial
Centennial is an SGI ICE XA system located at the ARL DSRC. It has 1,784 standard compute nodes, 32 large-memory compute nodes, and 32 GPU compute nodes (a total of 1,848 compute nodes or 73,920 compute cores). It has 253 TB of memory and is rated at 2.6 peak PFLOPS.

Node Configuration
Login Standard Large-Memory GPU
Total Nodes 24 1,784 32 32
Processor Intel E5-2698v4 Broadwell Intel E5-2698v4 Broadwell Intel E5-2698v4 Broadwell Intel E5-2698v4 Broadwell
Processor Speed 2.2 GHz 2.2 GHz 2.6 GHz 2.2 GHz
Sockets / Node 2 2 2 2
Cores / Node 40 40 40 40
Total CPU Cores 960 71,360 1,280 1,280
Useable Memory / Node 252 GB 124 GB 508 GB 252 GB
Accelerators / Node None None None 1
Accelerator n/a n/a n/a NVIDIA K40P PCIe
Memory / Accelerator n/a n/a n/a 12 GB
Storage on Node None None None None
Interconnect InfiniBand EDR InfiniBand EDR InfiniBand EDR InfiniBand EDR
OS RHEL RHEL RHEL RHEL

File Systems on Centennial
Path Formatted Capacity File System Type Storage Type User Quota Minimum File Retention
/p/home ($HOME) 678 TB Lustre HDD 30 GB None
/p/work1 ($WORKDIR) 10.859 PB Lustre HDD None 30 Days
/p/work2 136 TB Lustre HDD None 21 Days
/p/cwfs ($CENTER) 3.3 PB GPFS HDD None 120 Days
/p/app ($PROJECTS_HOME) 203 TB Lustre HDD None None