Nodes in Discovery

Discovery consists of a login node, head node, and compute nodes. Some useful information about these nodes are as follows:

Login Node

Whenever you log in to the discovery, you are directed to the login node. You can use this login node to install software but don’t run any computations in it. In Discovery, discovery-l2 is the login node.

Remember not to run any programs in the login node because it could damage the node if improperly executed.

Head Node

A head node is a simply configured system that acts as an intermediate between the compute nodes and the login node. You can run the jobs on the compute nodes by using the Slurm scheduling system tools on the head node. discovery-h2 is the head node in the Discovery.

Compute Nodes

Discovery has 54 compute nodes which are categorized into 38 CPU nodes and 16 GPU nodes. The compute nodes are the nodes where your programs and jobs are/should be executed.

CPU Nodes

There are 38 CPU nodes available in Discovery and the table below shows the hardware configuration of the CPU nodes.

Compute Nodes CPU CPU Per Node Core Per CPU Cores/Threads Per Node RAM(GB/TB)

discovery-c[1–6]

Intel E5-2640 v3 2.6G

2

8

16/32

64 GB

discovery-c[7–13]

Intel E5-2650 v4 2.2G

2

12

24/48

128 GB

discovery-c[14–15]

Intel E5-2650 v4 2.2G

2

12

24/48

256 GB

discovery-c[16–25]

Intel Xeon Gold 5117 2.0G

2

14

28/56

192 GB

discovery-c[26–35]

Intel Xeon Gold 6226R 2.9G

2

16

32/64

384 GB

discovery-c36

Intel Xeon Gold 5218T 2.1G

2

16

32/64

384 GB

discovery-c[37–38]

Intel Xeon Gold 5218 2.3G

4

16

64/128

3 TB

discovery-c36 won’t be available in the Discovery cluster until May 2022.

Compute nodes are generally not accessed by the HPC user. Sometimes, you may need to check the data generated by a program on the compute nodes, which may not be clear from the head node. Under those circumstances, what you can do is that you can submit interactive jobs using Slurm to check the results of the compute nodes.

Please refer to the page → Interactive jobs in Slurm for more insights.

GPU Nodes

If your job needs GPU, Discovery has 16 GPU nodes and you are always welcome to use it as well. Configuration about the GPU nodes are listed in the following table:

GPU Nodes GPU GPU Per Node CPU CPU Per Node Core Per CPU Cores/Threads Per Node RAM(GB)

discovery-g1

Nvidia Tesla K40

2

Intel E5-2640 v3 2.6G

2

8

16/32

64

discovery-g[2–6]

Nvidia Tesla P100

2

Intel Xeon Gold 5117 2.0G

2

14

28/56

192

discovery-g[7]

Nvidia Tesla V100

2

Intel Xeon Gold 5120 2.2G

2

14

28/56

192

discovery-g[8–11]

Nvidia Tesla V100

2

Intel Xeon Gold 5218 2.3G

2

16

32/64

192

discovery-g[12–15]

Nvidia Tesla A100

2

AMD EPYC 7282 2.8G

2

16

32/64

512

discovery-g16

Nvidia Tesla T4

2

Intel Xeon Gold 5118 2.3G

2

12

24/48

192

Each Node in Discovery have feature tags assigned to them. Users can select nodes to run their jobs based on the feature tags using SBATCH or srun --constraint flag. For more information, visit the page Slurm Node Features