GridFTP

From ScientificComputing
Revision as of 16:00, 12 July 2017 by Sfux (talk | contribs) (Created page with "==Introduction== To allow the transfer of large amounts of data between the supercomputers at CSCS and the Euler cluster, we have setup a test installation of GridFTP includin...")

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Introduction

To allow the transfer of large amounts of data between the supercomputers at CSCS and the Euler cluster, we have setup a test installation of GridFTP including two file transfer nodes (euler-ft-03.ethz.ch euler-ft-04.ethz.ch).

Examples

leonhard@ela3:~> ls -lh /scratch/shared/cscs/dd.test
-rw-r--r-- 1 root root 4.0G Jun 15 10:50 /scratch/shared/cscs/dd.test

leonhard@ela3:~> ssh-add
Enter passphrase for /users/leonhard/.ssh/id_rsa:
Identity added: /users/leonhard/.ssh/id_rsa (/users/leonhard/.ssh/id_rsa)

leonhard@ela3:~> time globus-url-copy sshftp://leonhard@gridftp.cscs.ch/scratch/shared/cscs/dd.test sshftp://leonhard@euler-ft-03.ethz.ch/SSD/test.dd
Connecting to sshftp://leonhard@gridftp.cscs.ch/scratch/shared/cscs/dd.test ...
Connecting to sshftp://leonhard@euler-ft-03.ethz.ch/SSD/test.dd ...

real 0m5.377s
user 0m0.008s
sys 0m0.008s

leonhard@ela3:~> time globus-url-copy sshftp://leonhard@gridftp.cscs.ch/scratch/shared/cscs/dd.test sshftp://leonhard@euler-ft-04.ethz.ch/SSD/test.dd
Connecting to sshftp://leonhard@gridftp.cscs.ch/scratch/shared/cscs/dd.test ...
Connecting to sshftp://leonhard@euler-ft-04.ethz.ch/SSD/test.dd ...

real 0m4.813s
user 0m0.004s
sys 0m0.008s

leonhard@ela3:~> globus-url-copy -list sshftp://leonhard@euler-ft-03.ethz.ch/SSD/test.dd
sshftp://leonhard@euler-ft-03.ethz.ch/SSD/test.dd
   test.dd

leonhard@ela3:~> globus-url-copy -list sshftp://leonhard@euler-ft-04.ethz.ch/SSD/test.dd
sshftp://leonhard@euler-ft-04.ethz.ch/SSD/test.dd
   test.dd