Transfer¶
scp¶
The scp
tool is a standard secure copy command line application that can be used when transferring files to ScienceCluster filesystem directories.
You can find more information on scp
here.
rsync¶
The rscync
tool is powerful alternative to scp
the provides full file synchronization functionality in addition to transfer capabilities.
You can find more information on rsync
here.
Sharing data¶
Data sharing among cluster users is conducted using Active Directory (AD) groups. Each AD group corresponds with a matching project in ScienceCluster.
If you would like to share data with other users in your group, you'll need the name of the project in ScienceCluster to which your username belongs (and you'll need to use this name to construct the appropriate command for sharing data with the other members of this group; see below for more details).
For example, if user asmith
would like to share the project1
directory with the matrix.uzh
group, the group ownership could be changed recursively.
$ chgrp -R S3IT_T_hpc_matrix.uzh /scratch/asmith/project1
$ ls -ld /scratch/asmith/project1
drwxrwx--- 1 asmith S3IT_T_hpc_matrix.uzh 1 May 26 12:26 /scratch/asmith/project1
$ ls -l /scratch/asmith/project1/
-rw-rw---- 1 asmith S3IT_T_hpc_matrix.uzh 0 May 26 12:26 data.txt.xz
Note: the group argument used in the command is S3IT_T_hpc_matrix.uzh
. A group titled esheep.uzh
would use S3IT_T_hpc_esheep.uzh
. In other words, add S3IT_T_hpc_
before the project name to construct the correct argument for the command.
To continue, in this example only the members of matrix.uzh
will be able to access project1
and only if they know the exact path. Alternatively, asmith
can choose to share his whole scratch directory in a read-only manner with the matrix.uzh
group.
$ chgrp -R S3IT_T_hpc_matrix.uzh /scratch/asmith
$ chmod -R g+rX /scratch/asmith