Chapter 18. Storage Cluster Upgrade

To upgrade monitors, first remove existing Ceph repos.

From monitor node, execute:

cd /etc/yum.repos.d/
sudo rm -rf calamari-minion.repo ceph.repo

cd /etc/yum.repos.d/
sudo rm -rf calamari-minion.repo ceph.repo

Then, execute the following from your admin node:

ceph-deploy install --repo <ceph-node>[<ceph-node> ...]
ceph-deploy install <ceph-node>[<ceph-node> ...]

ceph-deploy install --repo <ceph-node>[<ceph-node> ...]
ceph-deploy install <ceph-node>[<ceph-node> ...]

ceph-deploy will install the latest version of Ceph.

Although your monitor node is already connected with Calamari node from the previous installation, you need to reconnect your monitor node to the Calamari to get the latest salt-minion package.

Execute from your admin node:

ceph-deploy calamari connect <ceph-node>

ceph-deploy calamari connect <ceph-node>

From the monitor node, restart the Ceph Monitor daemon:

sudo /etc/init.d/ceph [options] restart mon.[id]

sudo /etc/init.d/ceph [options] restart mon.[id]

Upgrade each monitor one at a time, and allow the monitor to come up and in, rejoining the monitor quorum, before proceeding to upgrade the next monitor.

To upgrade OSDs, first remove existing Ceph repos.

From OSD node, execute:

cd /etc/yum.repos.d/
sudo rm -rf calamari-minion.repo ceph.repo

cd /etc/yum.repos.d/
sudo rm -rf calamari-minion.repo ceph.repo

Then, execute the following from your admin node:

ceph-deploy install --repo <ceph-node>[<ceph-node> ...]
ceph-deploy install <ceph-node>[<ceph-node> ...]

ceph-deploy install --repo <ceph-node>[<ceph-node> ...]
ceph-deploy install <ceph-node>[<ceph-node> ...]

ceph-deploy will install the latest version of Ceph.

Although your OSD node is already connected with Calamari node from the previous installation, you need to reconnect your OSD node to the Calamari node to get the latest salt-minion package.

Execute from your admin node:

ceph-deploy calamari connect <ceph-node>

ceph-deploy calamari connect <ceph-node>

We recommend upgrading OSDs by CRUSH hierarchy—​i.e., by failure domain or performance domain. Give each daemon time to come up and in with the cluster reaching a HEALTH_OK state before proceeding to the next CRUSH hierarchy. To restart an OSD, execute ceph with the restart command. Use the following syntax:

sudo /etc/init.d/ceph [options] restart osd.[id]

sudo /etc/init.d/ceph [options] restart osd.[id]

To upgrade a Ceph Object Gateway daemon, first remove existing Ceph repos (if any).

From gateway node, execute:

cd /etc/yum.repos.d/
sudo rm -rf ceph.repo

cd /etc/yum.repos.d/
sudo rm -rf ceph.repo

Then, execute the following from your admin node:

ceph-deploy install --repo <gateway-node>

ceph-deploy install --repo <gateway-node>

Then upgrade the ceph-radosgw package. Execute from your gateway node:

sudo yum install ceph-radosgw

sudo yum install ceph-radosgw

To upgrade the Ceph Object Gateway synchronization agent, execute from your gateway node:

sudo yum install radosgw-agent

sudo yum install radosgw-agent

Restart each Ceph Object gateway daemon. To do so, execute the following on each gateway node:

sudo service ceph-radosgw restart

sudo service ceph-radosgw restart

If you are running a federated architecture, restart your sync agent(s). For data replication agents, go to the terminal and execute ctrl + c; then, execute:

radosgw-agent -c [config-file]

radosgw-agent -c [config-file]

For metadata replication agents, go to the terminal and execute ctrl + c; then, execute:

radosgw-agent -c [config-file] --metadata-only

radosgw-agent -c [config-file] --metadata-only