Transferring files from Peregrine to the Mass Storage System (Gyrfalcon, mss)
The recommended process for transferring files from Peregrine to Gyrfalcon is to start from a Peregrine login node and use the rsync command. The cp or mv commands may also be used.
Because of the quota on individual files on the Gyrfalcon file systems (/mss), if you have a very large number of files, you must first gather these into a smaller number of container files. The tar command may be used for this purpose. For example,
$ cd /scratch/<username>/directory1 $ tar czf directory1.tgz * $ mv directory1.tgz ../tarfiles
Transfer the compressed tar file(s) to the /mss filesystem. If you have many files to transfer, the rsync command is convenient:
Example: transferring files from /scratch on Peregrine to /mss
$ rsync -aPv * /mss/users/<username>
$ rsync -aPv /scratch/<username>/tarfiles /mss/users/<username>/tarfiles/