FileTransfers

From OBSCOS Wiki, Department of Physics
Revision as of 14:50, 15 September 2021 by Heywood (talk | contribs)
Jump to navigation Jump to search

Update, September 2021: The trick below doesn't work any more, try this syntax instead:

$ rsync -avz --progress * -e "ssh -J heywood@bastion.physics.ox.ac.uk" ianh@astropi1.physics.ox.ac.uk:/mnt/ndidi/ianh/MIGHTEE_CONTINUUM/


There is a second physics ssh gateway to physics that has unthrottled firewall settings. For transferring files from South Africa to the UK this gives an order of magnitude increase in transfer speeds.

Here is an example of using it to copy a Measurement Set from IDIA to ndidi inside a screen session:

$ ssh ianh@transfer.ilifu.ac.za

$ cd /scratch2/users/ianh/VelaX1/1600995961

$ screen -S rsync

$ rsync -avz --progress 1600995961_sdp_l0_1024ch.ms -e "ssh -p 22522 heywood@ssh2.physics.ox.ac.uk ssh" ianh@astropi1.physics.ox.ac.uk:/mnt/ndidi/ianh/

Then detach from the screen server with Ctrl+A-D. Using port 22522 is essential. The ssh2 gateway is known to the astropi1 machine, so there is no need to ping it with the secret handshake.