Data Transfer Nodes


The NCCS provides two nodes dedicated to data transfer:

  • dtn01.ccs.ornl.gov
  • dtn02.ccs.ornl.gov

The nodes have been tuned specifically for wide area data transfers, and also perform well on the local area.

They are recommended for data transfers as they will, in most cases, improve transfer speed and help decrease load on computational systems’ login and service nodes.


Access

Members of allocated NCCS projects are automatically given access to the data transfer nodes.

Information on establishing a connection to dtn01.ccs.ornl.gov, dtn02.ccs.ornl.gov, and other NCCS systems may be found on the general access page.


Available Transfer Utilities

The following transfer utilities are available on the data transfer nodes:

BBCP
For larger files, the multistreaming transfer utility BBCP is recommended. The BBCP utility is capable of breaking up your transfer into multiple simultaneously transferring streams, thereby transferring data much faster than single-streaming utilities such as SCP and SFTP. More information can be found on the BBCP page
GridFTP
GridFTP is a high-performance data transfer protocol based on FTP and optimized for high-bandwidth wide-area networks. More information can be found on the GridFTP page.
SFTP and SCP
The SSH-based SFTP and SCP utilities can be used to transfer files to and from NCCS systems. Because these utilities can be slow, we recommend using them to transfer small numbers of smaller files. More information on these utilities can be found on the SFTP/SCP page.
HSI
Access to the HPSS is accomplished through the Hierarchical Storage Interface (HSI) utility. More information can be found on the HSI page.


Available Filesystems

Center wide lustre filesystems
The center wide shared lustre filesystems are available from the dtn through /tmp/work/$USER.

/ccs NFS filesystems
The shared NFS mounted filesystems under /ccs, such as home, project, and software directories are available from the dtn.