Alliance Doc

Arbutus object storage: Difference between revisions

Page Discussion

Arbutus object storage (view source)

Revision as of 19:56, 27 February 2023

851 bytes removed ,  1 year ago
Removed s3cmd details which are going to the new s3cmd page Sarah is creating except for the examples at the bottom where the s3cmd command is used to apply a policy.
(change header and order of information in setting up object storage section)
(Removed s3cmd details which are going to the new s3cmd page Sarah is creating except for the examples at the bottom where the s3cmd command is used to apply a policy.)
Line 43: Line 43:


<!--T:10-->
<!--T:10-->
You can also perform some management tasks for your object storage using the Object Store tab for your project at https://arbutus.cloud.computecanada.ca/. This interface refers to buckets as containers (not to be confused with containers based on namespace functionality of the Linux kernel). You can create containers (AKA buckets) in this interface, upload files, and create directories. Containers can also be created using S3-compatible CLI clients.  
You can also perform some management tasks for your object storage using the Object Store tab for your project at https://arbutus.cloud.computecanada.ca/. This interface refers to data containers (AKA buckets). You can create data containers with this interface, upload files, and create directories. Containers can also be created using S3-compatible CLI clients.  
Please note that if you create a new container as ''Public'', any object placed within this container can be freely accessed (read-only) by anyone on the Internet simply by navigating to <code><nowiki>https://object-arbutus.cloud.computecanada.ca/<YOUR CONTAINER NAME HERE>/<YOUR OBJECT NAME HERE></nowiki></code> with your container and object names inserted in place.
Please note that if you create a new container as ''Public'', any object placed within this container can be freely accessed (read-only) by anyone on the Internet simply by navigating to <code><nowiki>https://object-arbutus.cloud.computecanada.ca/<YOUR CONTAINER NAME HERE>/<YOUR OBJECT NAME HERE></nowiki></code> with your container and object names inserted in place.


Line 58: Line 58:
* Container policies are managed via json files.
* Container policies are managed via json files.


= Connection details and <tt>s3cmd</tt> configuration = <!--T:19-->
= Accessing your Arbutus Object Store =
 
There are two ways to access your data containers/buckets:
<!--T:20-->
* if your data container policies are set to private (default), object storage is accessible via an S3 client (e.g. s3cmd)
Object storage is accessible via an HTTPS endpoint:
* if your policies are set to public (not default), object storage is accessible via an HTTPS endpoint:
<code>object-arbutus.cloud.computecanada.ca:443</code>


<!--T:21-->
<!--T:21-->
<code>object-arbutus.cloud.computecanada.ca:443</code>
<code>object-arbutus.cloud.computecanada.ca:443</code>


<!--T:22-->
The following is an example of a minimal s3cmd configuration file. You will need these values, but are free to explore additional s3cmd configuration options to fit your use case. Note that in the example the keys are redacted and you will need to replace them with your provided key values:
<!--T:23-->
<pre>[default]
access_key = <redacted>
check_ssl_certificate = True
check_ssl_hostname = True
host_base = object-arbutus.cloud.computecanada.ca
host_bucket = object-arbutus.cloud.computecanada.ca
secret_key = <redacted>
use_https = True
</pre>
<!--T:24-->
Using s3cmd's <code>--configure</code> feature is [[Arbutus object storage clients#Configuring_s3cmd | described here]].
= Example operations on a bucket = <!--T:25-->


<!--T:26-->
ucket policies for your Arbutus Object Store
<ul>
<li><p>Make a bucket public so that it is Web accessible:</p>
<p><code>s3cmd setacl s3://testbucket --acl-public</code></p></li>
<li><p>Make the bucket private again:</p>
<p><code>s3cmd setacl s3://testbucket --acl-private</code></p></li>
<li><p>View the configuration of a bucket:</p>
<p><code>s3cmd info s3://testbucket</code></p></li>
</ul>


= Bucket policies = <!--T:31-->
= Managing data containers policies for your Arbutus Object Store = <!--T:31-->
{{Warning
{{Warning
   |title=Attention
   |title=Attention
Rmc
cc_staff
172

edits

Retrieved from "https://docs.alliancecan.ca/wiki/Special:MobileDiff/130352"