Chapter 4. Upgrading a Red Hat Ceph Storage Cluster

As the root user, navigate to the /usr/share/ceph-ansible/ directory:

[root@admin ~]# cd /usr/share/ceph-ansible/

Skip this step when upgrading from Red Hat Ceph Storage version 3.x to the latest version. Back up the group_vars/all.yml and group_vars/osds.yml files.

[root@admin ceph-ansible]# cp group_vars/all.yml group_vars/all_old.yml
[root@admin ceph-ansible]# cp group_vars/osds.yml group_vars/osds_old.yml
[root@admin ceph-ansible]# cp group_vars/clients.yml group_vars/clients_old.yml

Skip this step when upgrading from Red Hat Ceph Storage version 3.x to the latest version. When upgrading from Red Hat Ceph Storage 2.x to 3.x, create new copies of the group_vars/all.yml.sample, group_vars/osds.yml.sample and group_vars/clients.yml.sample files, and rename them to group_vars/all.yml, group_vars/osds.yml, and group_vars/clients.yml respectively. Open and edit them accordingly. For details, see Appendix H, Changes in Ansible Variables Between Version 2 and 3 and Section 3.2, “Installing a Red Hat Ceph Storage Cluster” .

[root@admin ceph-ansible]# cp group_vars/all.yml.sample group_vars/all.yml
[root@admin ceph-ansible]# cp group_vars/osds.yml.sample group_vars/osds.yml
[root@admin ceph-ansible]# cp group_vars/clients.yml.sample group_vars/clients.yml

Skip this step when upgrading from Red Hat Ceph Storage version 3.x to the latest version. When upgrading from Red Hat Ceph Storage 2.x to 3.x, open the group_vars/clients.yml file, and uncomment the following lines:

keys:
  - { name: client.test, caps: { mon: "allow r", osd: "allow class-read object_prefix rbd_children, allow rwx pool=test" },  mode: "{{ ceph_keyring_permissions }}" }

In the group_vars/all.yml file, uncomment the upgrade_ceph_packages option and set it to True.

upgrade_ceph_packages: True

Add the fetch_directory parameter to the group_vars/all.yml file.

fetch_directory: <full_directory_path>

Replace:

If the existing path is lost or missing, then do the following first:

If the cluster you want to upgrade contains any Ceph Object Gateway nodes, add the radosgw_interface parameter to the group_vars/all.yml file.

radosgw_interface: <interface>

Replace:

Starting with Red Hat Ceph Storage 3.2, the default OSD object store is BlueStore. To keep the traditional OSD object store, you must explicitly set the osd_objectstore option to filestore in the group_vars/all.yml file.

osd_objectstore: filestore

In the Ansible inventory file located at /etc/ansible/hosts, add the Ceph Manager (ceph-mgr) nodes under the [mgrs] section. Colocate the Ceph Manager daemon with Monitor nodes. Skip this step when upgrading from version 3.x to the latest version.

[mgrs]
<monitor-host-name>
<monitor-host-name>
<monitor-host-name>

Copy rolling_update.yml from the infrastructure-playbooks directory to the current directory.

[root@admin ceph-ansible]# cp infrastructure-playbooks/rolling_update.yml .

Create the /var/log/ansible/ directory and assign the appropriate permissions for the ansible user:

[root@admin ceph-ansible]# mkdir /var/log/ansible
[root@admin ceph-ansible]# chown ansible:ansible  /var/log/ansible
[root@admin ceph-ansible]# chmod 755 /var/log/ansible

As the Ansible user, run the playbook:

[user@admin ceph-ansible]$ ansible-playbook rolling_update.yml

While logged in as the root user on the RBD mirroring daemon node, upgrade rbd-mirror manually:

$ sudo apt-get upgrade rbd-mirror

Restart the daemon:

# systemctl restart  ceph-rbd-mirror@<client-id>

If working in an OpenStack environment, update all the cephx users to use the RBD profile for pools. The following commands must be run as the root user: