Topics: Ceph

Scope/Description This article will walk you through taking a Ceph node offline safely and then online it and bring the cluster back safely. The flags can be set in the event a node requires a reboot for an update or general maintenance. They will prevent the cluster from marking OSDs as out, thus stopping any […]

Scope/Description This article will explain the steps to begin configuring the network for a new Ceph cluster.  It will explain how to properly cable each storage node and gateway system for best practices. Assumptions: A 5 node cluster with 2 filesystem gateways will be used as an example 2 networks will be used, a cluster […]

Scope/Description This article will walk through how to add “hba” and “port” buckets to an existing CRUSH map. These CRUSH buckets then can be used as failure domains in a CRUSH rule. e.g You want to create a ceph storage pool that will distribute objects or objects chunks across OSDs grouped by the HBA or […]

Scope/Description This guide will show you how to configure your RBDs for the specific use case of VMware to improve performance. Prerequisites A running Ceph cluster iSCSI gateways up and configured. Guide can be found here http://knowledgebase.45drives.com/kb/kb450229-setup-and-configuration-of-iscsi-gateways-on-ceph-cluster/ Steps Set the object size of your RBD images to 1MB. When creating your RBD’s in the Ceph dashboard, […]

Scope/Description This article will show proper syntax in order to allow emails to be sent from alert manager Prerequisites A running Ceph Cluster with the ceph dashboard configured with ceph-ansible Access to the cluster ansible-admin node An email address, mail server name and port you wish to send the alerts to Steps Log in to […]

Scope/Description This article will show how to manually create a cephfs snapshots and then walk through the process of setting up automated hourly,daily,weekly,monthly, and/or yearly. Prerequisites An existing Nautilus ceph cluster with cephfs configured When using ceph-ansible-45d to build the cluster, this process is to be done after running the “core.yml”, “cephfs.yml”, “dashboard.yml” playbook Steps […]

Scope/Description This article outlines a network diagram/explanation for a typical 3 node cluster with 2 gateway nodes. High Level Services and Network Diagram Explanation of Services Ceph is a license free, open source storage platform that ties together multiple storage servers to provide interfaces for object, block and file-level storage in a single, horizontally scalable […]

Scope/Description This article details the process of clearing the HEALTH_WARN on a ceph cluster due to a large omap object. Prerequisites Configured Ceph Cluster running CephFS Steps In some cases, the Ceph health reporter will start reporting that ‘large objects’ are found within a pool. This error will display when running the following commands: ceph […]

Scope/Description This article describes the process of repairing inconsistent PGs/damaged objects on your Ceph Cluster. Prerequisites Ceph Cluster Experiencing HEALTH_ERR state with damaged objects PGs that are inconsistent Steps Identifying damaged PGs We can see with ceph -s  that we have some inconsistent PGs, and possible data damage. cluster: id: cec9ca98-b59f-4d91-8ddd-43802195c735 health: HEALTH_ERR 1 scrub […]

Scope/Description This guide will detail the process to add storage drives to a cluster. Although, not necessary it is best practice to add the same amount of drives to each node and drives of the same capacity. Prerequisites Ceph Cluster is in a healthy state Steps First make sure the status of the cluster is […]