Diskusage Explorer

Revision as of 19:22, 25 May 2021 by Diane27 (talk | contribs)
Other languages:

Contenu des répertoires

Attention : Pour l'instant, cette fonction est seulement disponible sur Béluga.

Il est possible d'obtenir le détail de l'utilisation de l'espace dans vos répertoires /home, /scratch et /project. Cette information est mise à jour quotidiennement et est triée selon un format SQLite pour un accès rapide.

Dans notre exemple, nous verrons la consommation de l'espace disque du répertoire $GROUP dans /project.

Interface ncurses

Listez d'abord tous les projets auxquels vous avez accès.

 ls ~/projects/
    def-bourqueg  def-lathrop  def-poq-ab  rrg-bourqueg-ad  rrg-lathrop

Le projet def-poq-ab servira à notre exemple.

GROUP=def-poq-ab
duc ui -d /project/.duc_databases/${GROUP}.sqlite  /project/${GROUP}

Cette commande charge un navigateur qui montre les ressources consommées par tous les fichiers dans l'arborescence d'un répertoire.

 
Navigating you project space with duc ncurse tool


Type c to toggle between consumed disk space and the number of files, q or <esc> to quit and h for help.

If you are only interested in a sub-directory of this project space and do not want to navigate the whole tree in the ncurse user interface,

 
[name@server ~]$ diskusage_explorer /project/def-professor/subdirectory/

A complete manual page is available with the man duc command.

Graphical User Interface

Note that when the login node is especially busy or if you have an especially large amount of files in you project space, the graphical interface mode can be slow and choppy. For a better experience, you can read the section below to run diskusage_explorer on your own machine.

Note that Compute Canada recommends the use of the standard text-based ncurse mode on our cluster login nodes but diskusage_explorer does also include a nice graphical user interface (GUI).

First make sure that you are connected to the cluster in such a way that SSH is capable of correctly displaying GUI applications. You can then use a graphical interface by means of the command,

 
[name@server ~]$ duc gui -d /project/.duc_databases/def-professor.sqlite  /project/def-professor

You can navigate the folders with the mouse and still type c to toggle between the size of the files and the number of files.

 
Navigating you project space with duc GUI tool


Browse faster on your own machine

First install the diskusage_explorer software on your local machine and then, still on your local machine, download the SQLite file from your cluster and run duc.

rsync -v --progress username@beluga.calculcanada.ca:/project/.duc_databases/def-professor.sqlite  .
duc gui -d ./def-professor.sqlite  /project/def-professor

This immediately leads to a smoother and more satisfying browsing experience.