Globus (File Transfer)
Globus
Section titled “Globus”Globus is a data management service frequently used in the research community to transfer or share large scale research data. It is a non-profit service run by the University of Chicago that is available to all Duke users under a standard Globus subscription. Globus is the recommended method to transfer data to and from the Duke Compsci department. Duke Compsci provides the following Globus Collections (endpoints):
Compsci Data Transfer Node – This endpoint can support xtmp storage.
How do I use Globus?
Section titled “How do I use Globus?”If you already have access to a Globus node you can:
- Install and configure Globus Connect personal for Mac OS X, Windows, or Linux
- Log in and transfer files with Globus
- Share data with other collaborators
- Use the CLI to automate the data transfer from scientific instruments to lab storage
More About Globus
Section titled “More About Globus”Data repositories, such as your laptop, campus compute resources, scientific instruments, or archival storage, are connected to Globus as a node. Users and administrators are then able to configure permissions on the nodes so that transfers and/or sharing can be done by appropriate Globus users.
At Duke, you can use Globus to transfer or share public and restricted research data between approved endpoints. It is a common method used to move large data between:
- Scientific instruments and lab storage
- Lab storage and Duke computational resources
- Laptops and shared computing infrastructure
- Duke storage and collaborators at peer institutions like UNC or external computing labs
Why use Globus?
Section titled “Why use Globus?”Globus was specifically designed for transferring and sharing research data and offers several key benefits:
Reliability: Data is transferred directly between nodes and Globus automatically tunes performance, maintains security, validates correctness, and recovers from errors to restart the transfer
Unified Interface: All of your Globus nodes are visible in a single web interface that is easy to use
Remote Initiation: Transfers can be initiated from your laptop between any nodes directly without data transversing your laptop
External Collaboration: Globus is used by many research institutions and allows users to connect with their institutional credentials to transfer data intra and inter institution
Globus may be used with public and restricted data at Duke. It may not be used with sensitive data at this time.