Arbutus Migration Guide: Difference between revisions

Jump to navigation Jump to search
Line 140: Line 140:
== Methods to copy data ==
== Methods to copy data ==


There are a couple of recommended approaches for copying data between instances running in the two clouds. The most appropriate method would depend upon the size of the data volumes in your tenant. For very large volumes greater than 5TB, Globus is recommended. Please see here for configuration details: [https://computecanada.github.io/DHSI-cloud-course/globus/ https://computecanada.github.io/DHSI-cloud-course/globus/]
Here are two recommended approaches for copying data between instances running in the two clouds. The most appropriate method depends upon the size of the data volumes in your tenant. For very large volumes (e.g. greater than 5TB) Globus is recommended. Please see here for configuration details: [https://computecanada.github.io/DHSI-cloud-course/globus/ https://computecanada.github.io/DHSI-cloud-course/globus/]


If you have very large volumes, we recommend submitting a support ticket as well.
If you have very large volumes, we recommend you submit a support ticket as well.


For volumes in the several hundred GB to low TB range, rsync+ssh provides good transfer speeds and can also work in an incremental way. A typical use case would be:
For smaller volumes, rsync+ssh provides good transfer speeds and can (like Globus) work in an incremental way. A typical use case would be:


# SSH to the West Cloud instance which has the large volume attached and note the absolute path you want synced over to the instance on Arbutus Cloud.
# SSH to the West Cloud instance which has the large volume attached. Note the absolute path you want to copy to the instance on Arbutus Cloud.
# Execute rsync over SSH (the example below assumes that password-less login via keys has already been setup between the instances). Replace the placeholders above with real values:
# Execute rsync over SSH. The example below assumes that password-less login via [[SSH keys]] has already been setup between the instances. Replace the placeholders below with real values:
#: <code> rsync -avzP -e 'ssh -i ~/.ssh/key.pem' /local/path/ remoteuser@remotehost:/path/to/files/ </code>
#: <code> rsync -avzP -e 'ssh -i ~/.ssh/key.pem' /local/path/ remoteuser@remotehost:/path/to/files/ </code>
# Validate the data successfully copied over on the instance in Arbutus Cloud. Please delete any data from the legacy West Cloud once you have completed validation on Arbutus Cloud.
# Verify that the data has been successfully copied on the instance in Arbutus Cloud. Then delete the data from the legacy West Cloud.


You may also use any other method you are familiar with for transferring data.
You may also use any other method you are familiar with for transferring data.
Bureaucrats, cc_docs_admin, cc_staff
2,879

edits

Navigation menu