Data Transfer From OIC
Files to your local machine on the ORNL network:
I'd suggest rsync. you probably don't want everything and the transfer is going to take a long time so it needs to tolerate interruption.
rsync -a --append-verify -f '- *dat*' -f '- *wfc*' -f '- *restart*' oicphase5.ornl.gov:~/projects/NiO ./
rsync -av -f '- CHG*' -f '- WAVECAR' or-condo-login.ornl.gov:/lustre/pfs1/cades-cnms/epd/abinitio_vdw ./
- -f ‘- CHG*’ statements exclude files that match. Chances are you don't actually want to archive every temporary file.
- -v will tell you every file that is copied, but this will slow down your transfer.
Files to your machine off the ORNL network:
You should get access to the new cluster resource CADES
rsync -a -f '- *dat*' -f '- *wfc*' -f '- *restart*' --append-verify YOUR-DIRECTORY cades-or-dtn-01.ornl.gov:/lustre/or-hydra/cades-cnms/uid/backups/
To NERSC HPSS:
If you previously copied you files to the data transfer node (cades-or-dtn-01.ornl.gov) on CADES you should use globus to transfer them to NERSC.
If not you can either transfer you files to your scratch directory on CADES as above or go directly from OIC to NERSC
Either way you need to know your scratch directory at NERSC. It is probably something like: /global/cscratch1/sd/user_name Your files need to go there temporarily since OIC/CADES can't connect directly to hpss.
Use the web gui, you'll need the OR-CADES endpoint and the NERSC DTN endpoint You'll need both your passwords. If you don't have a globus account you will have to make one.
To Go Direct:
rsync -a --append-verify YOUR-DIRECTORY firstname.lastname@example.org:/global/cscratch1/sd/pdoak/
If you’re moving many files, it’s quite possible you will need to restart rsync. Just run the command again. You'll be much happier if you set up an ssh key with NERSC so you don't have to keep typing your password. I had to run it twice for a 109G project directory. Transfer rates are ~30MB/s so you'll be checking in on this periodically over hours or days. Note you must add ssh public keys via nim and not to authorized_keys now.
NERSC Scratch to HPSS
htar or hsi from your scratch directory to hpss. See NERSC HPSS
- each file costs about 80mb of storage
- so archive on the fly with htar or with tar if your file count is high