Transferring data: Difference between revisions

Jump to navigation Jump to search
Line 45: Line 45:


===Using checksums to check if files match===
===Using checksums to check if files match===
If Globus is unavailable between the two systems being synchronized and Rsync is taking too long, then you can use [https://en.wikipedia.org/wiki/Checksum checksums] on both systems to determine if the files match.
If Globus is unavailable between the two systems being synchronized and Rsync is taking too long, then you can use [https://en.wikipedia.org/wiki/Checksum checksum] utility on both systems to determine if the files match. In this example we use <code>sha1sum</code>.


{{Command
<source lang="console">
|find /home/username/ -type f -print0 | xargs -0 sha1sum | tee checksum-result.log
[name@server]$ find /home/username/ -type f -print0 | xargs -0 sha1sum | tee checksum-result.log
}}
</source>


This command will create a new file called checksum-result.log in the current directory that will contain all of the checksums for the files in /home/username/. It will also print out all of the checksums to the screen as it goes. If you have a lot of files or very large files you may want to run this command in the background, in a [https://en.wikipedia.org/wiki/GNU_Screen screen] or [https://en.wikipedia.org/wiki/Tmux tmux] session; anything that allows it to continue if your [[SSH]] connection times out.
This command will create a new file called checksum-result.log in the current directory that will contain all of the checksums for the files in /home/username/. It will also print out all of the checksums to the screen as it goes. If you have a lot of files or very large files you may want to run this command in the background, in a [https://en.wikipedia.org/wiki/GNU_Screen screen] or [https://en.wikipedia.org/wiki/Tmux tmux] session; anything that allows it to continue if your [[SSH]] connection times out.
Bureaucrats, cc_docs_admin, cc_staff
2,879

edits

Navigation menu