FileTransfers

From OBSCOS Wiki, Department of Physics
Revision as of 12:44, 5 November 2020 by Heywood (talk | contribs) (How to copy large files via the ss2.physics gateway.)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

There is a second physics ssh gateway to physics that has unthrottled firewall settings. For transferring files from South Africa to the UK this gives an order of magnitude increase in transfer speeds.

Here is an example of using it to copy a Measurement Set from IDIA to ndidi inside a screen session:

$ ssh ianh@transfer.ilifu.ac.za

$ cd /scratch2/users/ianh/VelaX1/1600995961

$ screen -S rsync

$ rsync -avz --progress 1600995961_sdp_l0_1024ch.ms -e "ssh -p 22522 heywood@ssh2.physics.ox.ac.uk ssh" ianh@astropi1.physics.ox.ac.uk:/mnt/ndidi/ianh/

Then detach from the screen server with Ctrl+A-D. Using port 22522 is essential. The ssh2 gateway is known to the astropi1 machine, so there is no need to ping it with the secret handshake.