Tag: Discover
-
Discover Software
The Discover cluster also facilitate users by providing other licensed and open source softwares. Licensed software include MATLAB, IDL, etc.
-
Discover Interpreters
The Discover cluster is also equipped with Python, Ruby, Perl and other interpreted languages. Users can log on and start working with these languages as they come installed with default versions, or use the modules utility to use newer versions.
-
Discover Compilers
To accommodate the needs of a broad range of user groups, multiple versions of compilers, MPI, and math libraries available from different vendors are provided on the Discover cluster.
-
Monitoring Jobs on Discover using slurm
Query jobs using squeue To see the status of your job, “squeue” queries the current job queue and lists its contents. Useful options include: -a which lists all jobs -t R which lists all running jobs -t PD which lists all pending (non-running) jobs -p datamove which lists all jobs in the datamove partition -j…
-
Discover CSS Access through Slurm
CSS read-only access on Discover is provided to a subset of Discover’s Slurm-managed compute nodes. These are limited to Scalable Unit 16, which includes two different node types: 676 CPU-only nodes with Intel “Cascade Lake” CPU architecture, and twelve nodes with AMD “Rome” CPUs combined with NVIDIA A100 GPUs and Scalable Units 17 and 18,…
-
System Status
Discover Job Status Due to changes in Discover’s reporting processes, system hardware, and resource allocation, the information on the jobmon page is no longer accurate so we have removed it while we investigate a more scalable and flexible solution. In the interim, you may use the following command to get a rough idea of when…
-
Multiple Jobs per Node
Background The number of CPUs (aka “cores”) per node among Discover’s processor architectures has continued to increase over time, with current Milan processors having 128 cores. Skylake and Cascade Lake nodes offer 40 and 46 cores per node respectively. Many NCCS users have legitimate use cases for significantly lower core counts per job (particularly for…
-
File Transfer from User to the Discover Cluster
You must streamline your connections for direct SSH first before you can transfer files to the NCCS. For file transfers to ADAPT, please use the Transfer Nodes. For Command-Line Users In standard bastion configurations, you can run the following: If rsync is available on your client, it might be a better alternative to scp because you can resume…
-
File Transfer from NCCS to User Systems
You must streamline your connections for direct SSH first before you can transfer files from the NCCS. For file transfers from ADAPT, please use the Transfer Nodes. Command-Line Users In standard bastion configurations, you can run the following from your terminal: The ” . ” will place the file in your current working directory; you may specify a…
-
File System on Discover Cluster
The Discover cluster provides several different types of file systems: home, nobackup, and temporary/scratch. See the showquota documentation for information on how to monitor your storage usage. File System Type Variable on Discover cluster Default Quota Backup Cycles Home Directory IBM GPFS $HOME 1GB Daily Scratch IBM GPFS $NOBACKUP 5Tb/300k inodes No Backups Scratch local $LOCAL_TMPDIR node…