Bureaucrats, cc_docs_admin, cc_staff
2,879
edits
Transferring data: Difference between revisions
mention rclone
No edit summary |
(mention rclone) |
||
| Line 36: | Line 36: | ||
==From the World Wide Web== <!--T:5--> | ==From the World Wide Web== <!--T:5--> | ||
The standard tool for downloading data from websites is [https://en.wikipedia.org/wiki/Wget wget]. Also available is [https://curl.haxx.se/ curl]. The two are compared in this [https://unix.stackexchange.com/questions/47434/what-is-the-difference-between-curl-and-wget StackExchange article]. | The standard tool for downloading data from websites is [https://en.wikipedia.org/wiki/Wget wget]. Also available is [https://curl.haxx.se/ curl]. The two are compared in this [https://unix.stackexchange.com/questions/47434/what-is-the-difference-between-curl-and-wget StackExchange article]. | ||
For getting data from various cloud services such as Google cloud storage, Google Drive and Google Photos, consider [https://rclone.org/ rclone]. | |||
All three (wget, curl, rclone) are available on our clusters without loading a module. | |||
==Synchronizing files== <!--T:6--> | ==Synchronizing files== <!--T:6--> | ||