Transferring data: Difference between revisions

Please use ''data transfer nodes'', also called ''data mover nodes'', instead of login nodes whenever you are transferring data to and from Compute Canada clusters. If a data transfer node is available, its URL will be given near the top of the main page for each cluster: [[Béluga/en|Béluga]], [[Narval/en|Narval]], [[Cedar]], [[Graham]] and [[Niagara]].

You will need software that supports secure transfer of files between your computer and the Compute Canada machines. The commands <code>scp</code> and <code>sftp</code> can be used in a command-line environment on '''Linux''' or '''Mac''' OS X computers. On '''Microsoft Windows''' platforms, [https://docs.computecanada.ca/wiki/Connecting_with_MobaXTerm/en MobaXterm] offers both a graphical file transfer function and a [[Linux introduction|command-line]] interface via [[SSH]], while [http://winscp.net/eng/index.php WinSCP] is another free program that supports file transfer. Setting up a connection to a Compute Canada machine using SSH keys with WinSCP can be done by following the steps in this [https://www.exavault.com/blog/import-ssh-keys-winscp link]. [https://docs.computecanada.ca/wiki/Connecting_with_PuTTY/en PuTTY] comes with <code>pscp</code> and <code>psftp</code> which are essentially the same as the Linux and Mac command line programs.

If it takes more than one minute to move your files to or from Compute Canada servers, we recommend you install and try [[Globus#Personal_Computers|Globus Personal Connect]]. [[Globus]] transfers can be set up and will go on in the background without you.

==Between Compute Canada resources== <!--T:3-->

[[Globus]] is the preferred tool for transferring data between Compute Canada systems, and if it can be used, it should.

However, other common tools can also be found for transferring data both inside and outside of Compute Canada, including

Note: If you want to transfer files between other Compute Canada clusters and Niagara use the SSH agent forwarding flag, <code>-A</code> when logging into another cluster. For example, to copy files to Niagara from Cedar use: