GridFTP
From ScientificComputing
Revision as of 16:00, 12 July 2017 by Sfux (talk | contribs) (Created page with "==Introduction== To allow the transfer of large amounts of data between the supercomputers at CSCS and the Euler cluster, we have setup a test installation of GridFTP includin...")
Introduction
To allow the transfer of large amounts of data between the supercomputers at CSCS and the Euler cluster, we have setup a test installation of GridFTP including two file transfer nodes (euler-ft-03.ethz.ch euler-ft-04.ethz.ch).
Examples
leonhard@ela3:~> ls -lh /scratch/shared/cscs/dd.test -rw-r--r-- 1 root root 4.0G Jun 15 10:50 /scratch/shared/cscs/dd.test leonhard@ela3:~> ssh-add Enter passphrase for /users/leonhard/.ssh/id_rsa: Identity added: /users/leonhard/.ssh/id_rsa (/users/leonhard/.ssh/id_rsa) leonhard@ela3:~> time globus-url-copy sshftp://leonhard@gridftp.cscs.ch/scratch/shared/cscs/dd.test sshftp://leonhard@euler-ft-03.ethz.ch/SSD/test.dd Connecting to sshftp://leonhard@gridftp.cscs.ch/scratch/shared/cscs/dd.test ... Connecting to sshftp://leonhard@euler-ft-03.ethz.ch/SSD/test.dd ... real 0m5.377s user 0m0.008s sys 0m0.008s leonhard@ela3:~> time globus-url-copy sshftp://leonhard@gridftp.cscs.ch/scratch/shared/cscs/dd.test sshftp://leonhard@euler-ft-04.ethz.ch/SSD/test.dd Connecting to sshftp://leonhard@gridftp.cscs.ch/scratch/shared/cscs/dd.test ... Connecting to sshftp://leonhard@euler-ft-04.ethz.ch/SSD/test.dd ... real 0m4.813s user 0m0.004s sys 0m0.008s leonhard@ela3:~> globus-url-copy -list sshftp://leonhard@euler-ft-03.ethz.ch/SSD/test.dd sshftp://leonhard@euler-ft-03.ethz.ch/SSD/test.dd test.dd leonhard@ela3:~> globus-url-copy -list sshftp://leonhard@euler-ft-04.ethz.ch/SSD/test.dd sshftp://leonhard@euler-ft-04.ethz.ch/SSD/test.dd test.dd