Research Storage Update (xtmp)
On February 17th, 2025 the research storage will be moved to a new server.
Mount points
The mount points for the new and old xtmp are as follows:
- /usr/project/newxtmp/ new server mountpoint. Will remain active until mid-March.
- /usr/project/oldxtmp read-only mount for old xtmp server.
- /usr/project/xtmp will be updated to new server on February 17th at 6am
Syncing data
Considering the time to migrate such a large amount of data, it is impossible to make a smooth transition where data is synced and a swap is made. As a result, we have done a couple of initial passes at migrating the data from the old server to the new server. The most recent, and final, pass finished on February 11th.
If you would like to start using the new xtmp server before February 16th, please ensure that your data is up to date. If you need to sync some or all of your data, you can use rsync to update the data, like in the example below:
rsync -av /usr/project/oldxtmp/wjs/slurm-24-05-03/ /usr/project/newxtmp/wjs/slurm-24-05-03/
Note that the trailing ’/‘s are important. From the rsync man page:
This would recursively transfer all files from the directory src/bar on the machine foo into the /data/tmp/bar directory on the local machine. The files are transferred in archive mode, which en‐ sures that symbolic links, devices, attributes, permissions, ownerships, etc. are preserved in the transfer. Additionally, compression will be used to reduce the size of data portions of the transfer.
rsync -avz foo:src/bar/ /data/tmp
A trailing slash on the source changes this behavior to avoid creating an additional directory level at the destination. You can think of a trailing / on a source as meaning "copy the contents of this directory" as opposed to "copy the directory by name", but in both cases the attributes of the containing directory are transferred to the containing directory on the destination. In other words, each of the following commands copies the files in the same way, including their setting of the attributes of /dest/foo:
rsync -av /src/foo /dest rsync -av /src/foo/ /dest/foo
If you need assistance, please feel free to send a request to request@cs.duke.edu.