S3 Bucket Configuration
This document will provide a step-by-step on how 45Drives makes S3 services readily available through our Ceph cluster solution. We will cover creating a S3 user, creating a S3 bucket and then how to link that bucket to either push or pull data, based on individual use case.
- Must have a 45Drives Ceph cluster installed, standing, and either in or ready for production.
- An S3 service to make use of Ceph’s S3 offering, such as Amazon, Azure, etc.
- Rados Gateway services must be installed on the cluster. If installing RGW dependencies on a cluster that is already standing, you will need to run the dashboard playbook and create the necessary pools for the RGW.
These are the necessary pools for RGW, they can be viewed on your cluster at any time using ceph df in the CLI:
First, navigate to your Ceph dashboard. If you’re uncertain of which Ceph node the dashboard is hosted on, run ceph mgr services on one of the manager nodes.
Once you’re logged into the dashboard, navigate to Object Gateway on the top ribbon. Select “Users”
In the create user screen, there are a few fields to take into account.
S3 Key: This key can be auto-generated to supplied from your S3 service, such as Azure. Using auto-generate will depend on whether you wish to push or pull data. When pulling data, you will want to input your access key or secret key from your S3 service.
User Quota: Using this field, you can set the maximum number of objects allowed per user, and/or, the storage capacity of their bucket.
Bucket Quota: Rather than set limits on a user, you can also set limits on the buckets themselves to ensure they do not exceed a maximum capacity.
Creating a Bucket
Creating a new S3 bucket is done through the same Object Gateway tab on the Ceph dashboard:
Before naming the bucket, make sure the user you want to access the bucket is listed under users to select as the owner. If not, it’s possible you may have created a user through the Ceph user management feature rather than through the Object Gateway tab.
To access the new bucket, you’ll need the hostname of the node the Rados gateway is living on.
You can find this information under Object Gateway > Daemons
Once you have the host name, you will be able to access the S3 gateway through the S3 application of choice with http://[HostName]:8080 or http://[HostIP]:8080, depending on if the DNS is set up with proper host names, followed by the username and password. In this case, it would be s3testuser. The password would be the S3 key.