## Differences from the standard Intel Linux Cluster
### AMD Interlagos based machine, like OIC phase 5.
The key is there are only one floating point unit per two cores. So from a science perspective there are only 8 cores per node, not the sixteen listed. Additionally your code needs to bind to just one core per pair. See [Cray XK7 CPU info](https://www.olcf.ornl.gov/support/system-user-guides/titan-user-guide/#333)
### Service nodes run mpimom processes and PBS scripts
this complicates what PBS scripts can do. You can only run 50 aprun's that is 50 independent mpi applications in one job script.
The key is there are only one floating point unit per two cores. So from a science perspective there are only 8 cores per node, not 16. Additionally your code needs to bind to just one core per pair. See [Cray XK7 CPU info](https://www.olcf.ornl.gov/support/system-user-guides/titan-user-guide/#333)
### Service nodes run the mpi mom processes and PBS scripts
this complicates what PBS scripts can do.
* Max 50 aprun's per job.
* Don't run processes that cause much load outside of aprun invocation.
### There is only one GPU per node, so 16 CPU, 8 FPU, 1 GPU.
It's generally on you to manage this.
# Qsub chaining jobs
```shell-session
qsub -W depend=afterok:JOBID fourth_1.sh
qsub -W depend=afterok:JOBID next_jobs_pbs.sh
```
* _afterok_ if you need previous job to be successful