ImageNet: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| (8 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
{{draft}} | {{draft}} | ||
Compute Canada makes available on [Graham] cluster a copy of the ImageNet dataset, stored in the <code>/datashare</code> space. For the time being, this dataset is available only on Graham and you must opt-in to access this dataset by agreeing that you have registered for an ImageNet license: | Compute Canada makes available on [[Graham]] cluster a copy of the ImageNet dataset, stored in the <code>/datashare</code> space. For the time being, this dataset is available only on Graham and you must opt-in to access this dataset by agreeing that you have registered for an ImageNet license: | ||
<pre> | <pre> | ||
By selecting this service you acknowledge that you have registered with the owner of the data (at | By selecting this service you acknowledge that you have registered with the owner of the data (at http://image-net.org/download) and have agreed to ImageNet’s terms of use (https://image-net.org/download.php). | ||
En sélectionnant ce service, vous reconnaissez que vous êtes inscrit auprès du propriétaire des données (à l'adresse | |||
En sélectionnant ce service, vous reconnaissez que vous êtes inscrit auprès du propriétaire des données (à l'adresse http://image-net.org/download) et que vous avez accepté les conditions d'utilisation d'ImageNet (https://image-net.org/download.php). | |||
</pre> | </pre> | ||
This dataset is provided as is, and will only be updated based on image-net.org releases. If data from other challenges than the ones provided are required, please | This dataset is provided as is, and will only be updated based on image-net.org releases. If data from other challenges than the ones provided are required, please contact our [[Technical support]] with the subject <code>ImageNet dataset</code> | ||
=== Request access through the opt-in service === | === Request access through the opt-in service === | ||
Please visit https://ccdb.computecanada.ca/services/ | Please visit [https://ccdb.computecanada.ca/services/opt_in this registration page] to request access by acknowledging that you have registered with the ImageNet providers and that you agree with their terms and conditions. | ||
=== Location and contents === | === Location and contents === | ||
| Line 92: | Line 92: | ||
</pre> | </pre> | ||
=== This is an NFS3 mount!!! === | |||
The ImageNet provided in Graham is a NFS3 mount, and therefore you might have issues accessing the files if you belong to more than 16 groups in CC | |||
Latest revision as of 19:56, 20 June 2022
This article is a draft
This is not a complete article: This is a draft, a work in progress that is intended to be published into an article, which may or may not be ready for inclusion in the main wiki. It should not necessarily be considered factual or authoritative.
Compute Canada makes available on Graham cluster a copy of the ImageNet dataset, stored in the /datashare space. For the time being, this dataset is available only on Graham and you must opt-in to access this dataset by agreeing that you have registered for an ImageNet license:
By selecting this service you acknowledge that you have registered with the owner of the data (at http://image-net.org/download) and have agreed to ImageNet’s terms of use (https://image-net.org/download.php). En sélectionnant ce service, vous reconnaissez que vous êtes inscrit auprès du propriétaire des données (à l'adresse http://image-net.org/download) et que vous avez accepté les conditions d'utilisation d'ImageNet (https://image-net.org/download.php).
This dataset is provided as is, and will only be updated based on image-net.org releases. If data from other challenges than the ones provided are required, please contact our Technical support with the subject ImageNet dataset
Request access through the opt-in service
Please visit this registration page to request access by acknowledging that you have registered with the ImageNet providers and that you agree with their terms and conditions.
Location and contents
The files can be accessed at /datashare/ImageNet/, and it contains:
├── DownSampled
│ ├── Imagenet16_train_npz
│ ├── Imagenet16_val_npz
│ ├── Imagenet32_train_npz
│ ├── Imagenet32_val_npz
│ ├── Imagenet64_train_part1_npz
│ ├── Imagenet64_train_part2_npz
│ ├── Imagenet64_val_npz
│ ├── Imagenet8_train_npz
│ └── Imagenet8_val_npz
├── fall11_whole
│ ├── n00004475
│ ├── n00005787
│ ├── n00006024
│ ├── n00006484
│ ├── n00007846
│ ├── n00015388
│ ├── n00017222
│ ├── n00021265
| .
| .
| .
│ ├── n15102359
│ ├── n15102455
│ ├── n15102894
│ └── tars.tar.bz2
├── ILSVRC2012
│ ├── ILSVRC2012_devkit_t12
│ ├── ILSVRC2012_devkit_t3
│ ├── ILSVRC2012_img_test_patch_v10102019.tar
│ ├── ILSVRC2012_img_test_v10102019.tar
│ ├── ILSVRC2012_img_train_t3.tar
│ ├── ILSVRC2012_img_train.tar
│ ├── ILSVRC2012_img_val.tar
│ ├── ILSVRC2012.md5
│ ├── test
│ ├── train
│ ├── train_T3
│ └── validation
├── ILSVRC2017
│ ├── Annotations
│ ├── Data
│ ├── devkit
│ ├── ILSVRC
│ ├── ILSVRC2017_DET.tar.gz
│ ├── ILSVRC2017_DET_test_new.tar.gz
│ ├── ILSVRC2017_devkit.tar.gz
│ └── ImageSets
├── tiny-imagenet-200
│ ├── test
│ ├── train
│ ├── val
│ ├── wnids.txt
│ └── words.txt
└── winter21_whole
├── n00004475
├── n00007846
├── n00017222
├── n00288384
├── n00324978
├── n00433458
├── n00433661
.
.
.
├── n15092751
├── n15102359
├── n15102894
└── tars
This is an NFS3 mount!!!
The ImageNet provided in Graham is a NFS3 mount, and therefore you might have issues accessing the files if you belong to more than 16 groups in CC