Bureaucrats, cc_docs_admin, cc_staff
2,306
edits
Using nearline storage: Difference between revisions
→How to use
| Line 10: | Line 10: | ||
== How to use == | == How to use == | ||
To use Nearline, just put files into your < | To use Nearline, just put files into your <tt>~/nearline/PROJECT</tt> directory. After a period of time (currently 24 hours), they'll be copied onto tape. If the file remains unchanged for another period (also 24h), the copy on disk will be removed, making the file virtualized on tape. | ||
Like most HPC storage, it's bad practice to have lots of small files. In fact, files smaller than a certain threshold size may not be moved to tape at all. So if you have large collections of small files, it's wise to bundle them using a tool like [[Archiving and compressing files|tar]]. | Like most HPC storage, it's bad practice to have lots of small files. In fact, files smaller than a certain threshold size may not be moved to tape at all. So if you have large collections of small files, it's wise to bundle them using a tool like [[Archiving and compressing files|tar]]. | ||
If you remove a file in < | If you remove a file in <tt>~/nearline</tt>, the tape copy will be retained for up to 60 days. To restore such a file, contact [[technical support]] with the full path for the file(s) and desired version (by date), just as you would for [[Storage and file management#Filesystem Quotas and Policies|backup]] restoration. Note that since you will need the full path for the file, it is important for you to retain a copy of the complete directory structure of your Nearline space. For example, you can run the command <tt>ls -R > ~/nearline_contents.txt</tt> from the <tt>~/nearline/PROJECT</tt> directory so that you have a copy of the location of all the files in your Nearline space. | ||