SubatomicPhysics: Difference between revisions

m
→‎Running in containers: The ATLAS repo contains only singularity format, while unpacked repo is both Docker and Singularity formats
(→‎Running in containers: describe unpacked repo)
m (→‎Running in containers: The ATLAS repo contains only singularity format, while unpacked repo is both Docker and Singularity formats)
Line 37: Line 37:
=== Running in containers ===
=== Running in containers ===


As of this writing there are two main repositories for singularity images that we are aware of for HEP-related software, both distributed via CVMFS repositories.  One from ATLAS and the other from WLCG.
As of this writing there are two main repositories for container images that we are aware of for HEP-related software, both distributed via CVMFS repositories.  One from ATLAS and the other from WLCG.
* ATLAS - The ATLAS distributions are documented well at https://twiki.cern.ch/twiki/bin/view/AtlasComputing/ADCContainersDeployment
* ATLAS - The ATLAS distributions of Singularity images are documented well at https://twiki.cern.ch/twiki/bin/view/AtlasComputing/ADCContainersDeployment
   - single file packed images:  /cvmfs/atlas.cern.ch/repo/containers/images/singularity/<br/>
   - single file packed images:  /cvmfs/atlas.cern.ch/repo/containers/images/singularity/<br/>
   - unpacked images: /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/<br/>
   - unpacked images: /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/<br/>


* WLCG unpacked repository - This is a development project that uses [https://cvmfs.readthedocs.io/en/stable/cpt-ducc.html DUCC] to automate publishing of container images from a Docker image registry to CVMFS. The images are published to CVMFS in a standard directory structure format that is used by Singularity, as well as the layered format which allows Docker to instantiate images directly from CVMFS using the [https://cvmfs.readthedocs.io/en/stable/cpt-graphdriver.html graph driver] plugin. There is additional documentation for this project at https://github.com/cvmfs/ducc. The list of images that are automatically published is [https://gitlab.cern.ch/unpacked/sync/blob/master/recipe.yaml here]. To add one to the list you can submit a merge request.
* WLCG unpacked repository - This is a development project that uses [https://cvmfs.readthedocs.io/en/stable/cpt-ducc.html DUCC] to automate publishing of container images from a Docker image registry to CVMFS. The images are published to CVMFS in a standard directory structure format that is used by Singularity, as well as the layered format used by Docker, allowing Docker to instantiate images directly from CVMFS using the [https://cvmfs.readthedocs.io/en/stable/cpt-graphdriver.html graph driver] plugin. There is additional documentation for this project at https://github.com/cvmfs/ducc. The list of images that are automatically published is [https://gitlab.cern.ch/unpacked/sync/blob/master/recipe.yaml here] and includes the atlas-grid-centos7 image. To add one to the list you can submit a merge request.
   - Images are under /cvmfs/unpacked.cern.ch/
   - Images are under /cvmfs/unpacked.cern.ch/


cc_staff
178

edits