... | ... | @@ -14,5 +14,27 @@ ssh metis-login1.ornl.gov |
|
|
echo 'export MODULEPATH=${MODULEPATH}:/sw/user_tools/cades-cnms/modules' >> ~/.bash_profile
|
|
|
```
|
|
|
|
|
|
outside of a few details though the setup is exactly like titan, so these should be on your path to getting things to work:
|
|
|
## AMD Interlagos Architecture
|
|
|
Like Titan and OIC Phase 5, Metis uses the AMD interlagos chip. With these cpu there is only one floating point per 2 cores. From the perspective of most scientific computing this means a the number of cores is halved. If you don't correctly map your processes onto the nodes you'll waste significant computing time.
|
|
|
|
|
|
usually you'll want something like:
|
|
|
```shell
|
|
|
aprun -j1 -S4 -n (totalcores/2) -r1 $CODE
|
|
|
```
|
|
|
|
|
|
[Details of using aprun to map mpiprocessess](https://www.olcf.ornl.gov/kb_articles/using-the-aprun-command/)
|
|
|
|
|
|
## $HOME and /lustre/or-hydra/cades-cnms scratch area are shared with CASDES-CONDO
|
|
|
This means you need to be careful with paths, and your .bashrc and .bash_profile files.
|
|
|
|
|
|
You're going to need something like
|
|
|
```shell
|
|
|
if [[ $HOSTNAME =~ metis ]]
|
|
|
then
|
|
|
fi
|
|
|
```
|
|
|
We don't have best practices to suggest at this time. Consider having a script you manually source if you have trouble. The order in which the files are loaded is different on Cray XK and Centos.
|
|
|
|
|
|
|
|
|
Outside of the shared directories and actual modules installed Metis is basically a small chunk of Titan.
|
|
|
## [OLCF titan docs](https://www.olcf.ornl.gov/support/system-user-guides/titan-user-guide/) |
|
|
\ No newline at end of file |