Filestore (“Storage”)

Please see the University’s filestore guide for more information about accessing and using this service.

Tip

Please speak to your department if you need access to your department’s shared filestore.

Transferring data between the filestore and Viking

To move your data between Viking and the filestore (“Storage”), the base address you need to use is:

sftp.york.ac.uk:/shared/storage/<filestore>

You will need a command line interface to Viking and will be using commands such as rsync and scp, much like the examples on the Transferring Data page.

Tip

When transferring large amounts of data it can be a good idea to use terminal multiplexing such as tmux. This would allow you to leave the transfer running (inside a tmux session) and not have to stay logged in yourself.

Using `scp`

The examples below demonstrate how to move either individual files or full directories to a filestore, replacing the <filename>, <dirname> and <filestore> placeholders with: the name of a file on Viking to be moved, the name of a directory on Viking to be moved, and the path to your filestore on storage.its.york.ac.uk respectively. All examples assume you are running the command from an SSH session on Viking.

for an individual file

$ scp <filename> scp.york.ac.uk:/shared/storage/<filestore>

for a folder with multiple files

$ scp -r <dirname> scp.york.ac.uk:/shared/storage/<filestore>

To copy data from the filestore to Viking, simply reverse the order of the two locations in the command, e.g. the snippet below shows how to copy a directory from a filestore to your scratch space on Viking.

Copying a directory from storage to Viking

$ scp -r scp.york.ac.uk:/shared/storage/<filestore>/<dirname> ~/scratch/

Using `rsync`

The equivalent rsync commands are shown below, where options -a set up a number of options useful for archiving and -v activates verbose mode so you can monitor the process. Refer to the manual (man rsync) for a full list of all possible options.

for an individual file

$ rsync -av <filename> sftp.york.ac.uk:/shared/storage/<filestore>

for a folder with multiple files

$ rsync -av <dirname> sftp.york.ac.uk:/shared/storage/<filestore>

Personal filestore

The following is the path for your personal filestore:

scp.york.ac.uk:/home/userfs/a/abc123

Where a and abc123 are the first letter of your username followed by your username. This is your personal filestore. Use this with the examples above to send data to or retrieve data from your personal filestore.