Rebooting Ceph Storage Nodes
This guide will detail the process of going through a rolling reboot of each OSD/GW node. This will need to be done after an update to the kernel.
A Cluster in a Healthy State
To reboot the Ceph Storage nodes, follow this process:
Select the first Ceph Storage node to reboot and log into it.
Disable Ceph Storage cluster rebalancing temporarily:
ceph osd set noout ceph osd set nobackfill ceph osd set norecover
Reboot the node:
Wait until the node boots.
Log into the node and check the cluster status:
Verify all OSDs, MON and MGR services have started and rejoined cluster
Log out of the node, reboot the next node, and check its status. Repeat this process until you have rebooted all Ceph storage nodes.
When complete, enable cluster rebalancing again:
ceph osd unset noout ceph osd unset nobackfill ceph osd unset norecover
Perform a final status check to make sure the cluster reports
If the cluster is above 90 percent full there may be some client IO issues when rebooting a node. It is better to do this process after hours in that case.