Red Hat Summit 红帽全球峰会支持控制台（Console）开发人员开始试用联系人

此内容没有您所选择的语言版本。

Chapter 8. Upgrading to Red Hat Gluster Storage 3.3

This chapter describes the procedure to upgrade to Red Hat Gluster Storage 3.3 from Red Hat Gluster Storage 3.1 or 3.2.

Upgrade support limitations

8.1. Offline Upgrade to Red Hat Gluster Storage 3.3
复制链接

Warning

Before you upgrade, be aware of changed requirements that exist after Red Hat Gluster Storage 3.1.3. If you want to access a volume being provided by a Red Hat Gluster Storage 3.1.3 or higher server, your client must also be using Red Hat Gluster Storage 3.1.3 or higher. Accessing volumes from other client versions can result in data becoming unavailable and problems with directory operations. This requirement exists because Red Hat Gluster Storage 3.1.3 contained a number of changes that affect how the Distributed Hash Table works in order to improve directory consistency and remove the effects seen in BZ#1115367 and BZ#1118762.

Important

In Red Hat Enterprise Linux 7 based Red Hat Gluster Storage 3.1 and higher, updating reloads firewall rules. All runtime-only changes made before the reload are lost, so ensure that any changes you want to keep are made persistently.

Procedure 8.1. Before you upgrade

  1. Back up the following configuration directory and files in a location that is not on the operating system partition.
    • /var/lib/glusterd
    • /etc/swift
    • /etc/samba
    • /etc/ctdb
    • /etc/glusterfs
    • /var/lib/samba
    • /var/lib/ctdb
    • /var/run/gluster/shared_storage/nfs-ganesha
    If you use NFS-Ganesha, back up the following files from all nodes:
    • /etc/ganesha/exports/export.*.conf
    • /etc/ganesha/ganesha.conf
    • /etc/ganesha/ganesha-ha.conf
  2. Unmount gluster volumes from all clients. On a client, use the following command to unmount a volume from a mount point. 
    # umount mount-point
    Copy to Clipboard Toggle word wrap
  3. If you use NFS-Ganesha, run the following on a gluster server to disable the nfs-ganesha service: 
    # gluster nfs-ganesha disable
    Copy to Clipboard Toggle word wrap
  4. On a gluster server, disable the shared volume. 
    # gluster volume set all cluster.enable-shared-storage disable
    Copy to Clipboard Toggle word wrap
  5. Stop all volumes. 
    # for vol in `gluster volume list`; do gluster --mode=script volume stop $vol; sleep 2s; done
    Copy to Clipboard Toggle word wrap
  6. Verify that all volumes are stopped. 
    # gluster volume info
    Copy to Clipboard Toggle word wrap
  7. Unmount the data partition(s) from the servers using the following command. 
    # umount mount-point
    Copy to Clipboard Toggle word wrap
  8. Stop the glusterd services on all servers using the following command: 
    # service glusterd stop
# pkill glusterfs
# pkill glusterfsd
    Copy to Clipboard Toggle word wrap
  9. Stop the pcsd service. 
    # systemctl stop pcsd
    Copy to Clipboard Toggle word wrap

Procedure 8.2. Upgrade using yum

  1. Verify that your system is not on the legacy Red Hat Network Classic update system. 
    # migrate-rhs-classic-to-rhsm --status
    Copy to Clipboard Toggle word wrap
    If you are still on Red Hat Network Classic, run the following command to migrate to Red Hat Subscription Manager. 
    # migrate-rhs-classic-to-rhsm --rhn-to-rhsm
    Copy to Clipboard Toggle word wrap
    Then verify that your status has changed. 
    # migrate-rhs-classic-to-rhsm --status
    Copy to Clipboard Toggle word wrap
  2. If you use Samba:
    1. For Red Hat Enterprise Linux 6.7 or higher, enable the following repository: 
      # subscription-manager repos --enable=rh-gluster-3-samba-for-rhel-6-server-rpms
      Copy to Clipboard Toggle word wrap
      For Red Hat Enterprise Linux 7, enable the following repository: 
      # subscription-manager repos --enable=rh-gluster-3-samba-for-rhel-7-server-rpms
      Copy to Clipboard Toggle word wrap
    2. Ensure that Samba is upgraded on all the nodes simultaneously, as running different versions of Samba in the same cluster will lead to data corruption.
      Stop the CTDB and SMB services and verify that they are stopped. 
      # service ctdb stop
      Copy to Clipboard Toggle word wrap 
      # ps axf | grep -E '(ctdb|smb|winbind|nmb)[d]'
      Copy to Clipboard Toggle word wrap
  3. If you want to migrate from Gluster NFS to NFS Ganesha as part of this upgrade, perform the following additional steps.
    1. Stop and disable CTDB. This ensures that multiple versions of Samba do not run in the cluster during the update process, and avoids data corruption. 
      # systemctl stop ctdb
# systemctl disable ctdb
      Copy to Clipboard Toggle word wrap
    2. Verify that the CTDB and NFS services are stopped: 
      ps axf | grep -E '(ctdb|nfs)[d]'
      Copy to Clipboard Toggle word wrap
    3. Delete the CTDB volume by executing the following command: 
      # gluster vol delete <ctdb_vol_name>
      Copy to Clipboard Toggle word wrap
  4. Upgrade the server to Red Hat Gluster Storage 3.3. 
    # yum update
    Copy to Clipboard Toggle word wrap
    Wait for the update to complete.
  5. Reboot the server to ensure that kernel updates are applied.
  6. Ensure that glusterd and pcsd services are started. 
    # systemctl start glusterd
# systemctl start pcsd
    Copy to Clipboard Toggle word wrap
  7. When all nodes have been upgraded, run the following command to update the op-version of the cluster. This helps to prevent any compatibility issues within the cluster. 
    # gluster volume set all cluster.op-version 31102
    Copy to Clipboard Toggle word wrap

    Note

    31102 is the cluster.op-version value for the latest Red Hat Gluster Storage 3.3.1 glusterfs Async. Refer to Section 1.5, “Supported Versions of Red Hat Gluster Storage” for the correct cluster.op-version value for other versions.
  8. If you want to migrate from Gluster NFS to NFS Ganesha as part of this upgrade, install the NFS-Ganesha packages as described in Chapter 4, Deploying NFS-Ganesha on Red Hat Gluster Storage, and use the information in the NFS Ganesha section of the Red Hat Gluster Storage 3.3 Administration Guide to configure the NFS Ganesha cluster.
  9. Start all volumes. 
    # for vol in `gluster volume list`; do gluster --mode=script volume start $vol; done
    Copy to Clipboard Toggle word wrap
  10. If you are using NFS-Ganesha:
    1. Copy the volume's export information from your backup copy of ganesha.conf to the new /etc/ganesha/ganesha.conf file.
      The export information in the backed up file is similar to the following: 
      %include "/etc/ganesha/exports/export.v1.conf"
%include "/etc/ganesha/exports/export.v2.conf"
%include "/etc/ganesha/exports/export.v3.conf"
      Copy to Clipboard Toggle word wrap
    2. Copy the backup volume export files from the backup directory to /etc/ganesha/exports by running the following command from the backup directory: 
      # cp export.* /etc/ganesha/exports/
      Copy to Clipboard Toggle word wrap
  11. Enable firewall settings for new services and ports. See the Red Hat Gluster Storage 3.3 Administration Guide for details: https://access.redhat.com/documentation/en-us/red_hat_gluster_storage/3.3/html/administration_guide/chap-getting_started.
  12. Enable the shared volume. 
    # gluster volume set all cluster.enable-shared-storage enable
    Copy to Clipboard Toggle word wrap
  13. Ensure that the shared storage volume is mounted on the server. If the volume is not mounted, run the following command: 
    # mount -t glusterfs hostname:gluster_shared_storage /var/run/gluster/shared_storage
    Copy to Clipboard Toggle word wrap
  14. Ensure that the /var/run/gluster/shared_storage/nfs-ganesha directory is created. 
    # cd /var/run/gluster/shared_storage/
# mkdir nfs-ganesha
    Copy to Clipboard Toggle word wrap
  15. If you use NFS-Ganesha:
    1. Copy the ganesha.conf and ganesha-ha.conf files, and the /etc/ganesha/exports directory to the /var/run/gluster/shared_storage/nfs-ganesha directory. 
      # cd /etc/ganesha/
# cp ganesha.conf  ganesha-ha.conf /var/run/gluster/shared_storage/nfs-ganesha/
# cp -r exports/ /var/run/gluster/shared_storage/nfs-ganesha/
      Copy to Clipboard Toggle word wrap
    2. Update the path of any export entries in the ganesha.conf file. 
      # sed -i 's/\/etc\/ganesha/\/var\/run\/gluster\/shared_storage\/nfs-ganesha/' /var/run/gluster/shared_storage/nfs-ganesha/ganesha.conf
      Copy to Clipboard Toggle word wrap
    3. Run the following to clean up any existing cluster configuration: 
      /usr/libexec/ganesha/ganesha-ha.sh --cleanup /var/run/gluster/shared_storage/nfs-ganesha
      Copy to Clipboard Toggle word wrap
    4. If you have upgraded to Red Hat Enterprise Linux 7.4 or later, set the following SELinux Booleans: 
      # setsebool -P ganesha_use_fusefs on
# setsebool -P gluster_use_execmem on
      Copy to Clipboard Toggle word wrap
  16. Start the ctdb service (and nfs-ganesha service, if used) and verify that all nodes are functional. 
    # systemctl start ctdb
# gluster nfs-ganesha enable
    Copy to Clipboard Toggle word wrap
  17. If this deployment uses NFS-Ganesha, enable NFS-Ganesha on all volumes. 
    # gluster volume set volname ganesha.enable on
    Copy to Clipboard Toggle word wrap

Procedure 8.3. Before you upgrade

  1. Back up the following configuration directory and files in a location that is not on the operating system partition.
    • /var/lib/glusterd
    • /etc/swift
    • /etc/samba
    • /etc/ctdb
    • /etc/glusterfs
    • /var/lib/samba
    • /var/lib/ctdb
    • /var/run/gluster/shared_storage/nfs-ganesha
    If you use NFS-Ganesha, back up the following files from all nodes:
    • /etc/ganesha/exports/export.*.conf
    • /etc/ganesha/ganesha.conf
    • /etc/ganesha/ganesha-ha.conf
  2. Unmount gluster volumes from all clients. On a client, use the following command to unmount a volume from a mount point. 
    # umount mount-point
    Copy to Clipboard Toggle word wrap
  3. If you use NFS-Ganesha, run the following on a gluster server to disable the nfs-ganesha service: 
    # gluster nfs-ganesha disable
    Copy to Clipboard Toggle word wrap
  4. On a gluster server, disable the shared volume. 
    # gluster volume set all cluster.enable-shared-storage disable
    Copy to Clipboard Toggle word wrap
  5. Stop all volumes. 
    # for vol in `gluster volume list`; do gluster --mode=script volume stop $vol; sleep 2s; done
    Copy to Clipboard Toggle word wrap
  6. Verify that all volumes are stopped. 
    # gluster volume info
    Copy to Clipboard Toggle word wrap
  7. Unmount the data partition(s) from the servers using the following command. 
    # umount mount-point
    Copy to Clipboard Toggle word wrap
  8. Stop the glusterd services on all servers using the following command: 
    # service glusterd stop
# pkill glusterfs
# pkill glusterfsd
    Copy to Clipboard Toggle word wrap
  9. Stop the pcsd service. 
    # systemctl stop pcsd
    Copy to Clipboard Toggle word wrap

Procedure 8.4. Upgrade using Satellite

  1. Create an Activation Key at the Red Hat Network Satellite Server, and associate it with the following channels. For more information, see Section 2.5, “Installing from Red Hat Satellite Server”
    • For Red Hat Enterprise Linux 6.7 or higher: 
      Base Channel: Red Hat Enterprise Linux Server (v.6 for 64-bit x86_64)

Child channels:
RHEL Server Scalable File System (v. 6 for x86_64)
Red Hat Gluster Storage Server 3 (RHEL 6 for x86_64)
      Copy to Clipboard Toggle word wrap
      If you use Samba, add the following channel: 
      Red Hat Gluster 3 Samba (RHEL 6 for x86_64)
      Copy to Clipboard Toggle word wrap
    • For Red Hat Enterprise Linux 7: 
      Base Channel: Red Hat Enterprise Linux Server (v.7 for 64-bit x86_64)

Child channels:
RHEL Server Scalable File System (v. 7 for x86_64)
Red Hat Gluster Storage Server 3 (RHEL 7 for x86_64)
      Copy to Clipboard Toggle word wrap
      If you use Samba, add the following channel: 
      Red Hat Gluster 3 Samba (RHEL 6 for x86_64)
      Copy to Clipboard Toggle word wrap
  2. Unregister your system from Red Hat Network Satellite by following these steps:
    1. Log in to the Red Hat Network Satellite server.
    2. Click on the Systems tab in the top navigation bar and then the name of the old or duplicated system in the System List.
    3. Click the delete system link in the top-right corner of the page.
    4. To confirm the system profile deletion by clicking the Delete System button.
  3. Run the following command on your Red Hat Gluster Storage server, using your credentials and the Activation Key you prepared earlier. This re-registers the system to the Red Hat Gluster Storage 3.3 channels on the Red Hat Network Satellite Server. 
    # rhnreg_ks --username username --password password --force --activationkey Activation Key ID
    Copy to Clipboard Toggle word wrap
  4. Verify that the channel subscriptions have been updated.
    On Red Hat Enterprise Linux 6.7 and higher, look for the following channels, as well as the rhel-x86_64-server-6-rh-gluster-3-samba channel if you use Samba. 
    # rhn-channel --list
rhel-x86_64-server-6
rhel-x86_64-server-6-rhs-3
rhel-x86_64-server-sfs-6
    Copy to Clipboard Toggle word wrap
    On Red Hat Enterprise Linux 7, look for the following channels, as well as the rhel-x86_64-server-7-rh-gluster-3-samba channel if you use Samba. 
    # rhn-channel --list
rhel-x86_64-server-7
rhel-x86_64-server-7-rhs-3
rhel-x86_64-server-sfs-7
    Copy to Clipboard Toggle word wrap
  5. Upgrade to Red Hat Gluster Storage 3.3. 
    # yum update
    Copy to Clipboard Toggle word wrap
  6. Reboot the server and run volume and data integrity checks.
  7. When all nodes have been upgraded, run the following command to update the op-version of the cluster. This helps to prevent any compatibility issues within the cluster. 
    # gluster volume set all cluster.op-version 31102
    Copy to Clipboard Toggle word wrap

    Note

    31102 is the cluster.op-version value for the latest Red Hat Gluster Storage 3.3.1 glusterfs Async. See Section 1.5, “Supported Versions of Red Hat Gluster Storage” for the correct cluster.op-version value for other versions.
  8. Start all volumes. 
    # for vol in `gluster volume list`; do gluster --mode=script volume start $vol; done
    Copy to Clipboard Toggle word wrap
  9. If you are using NFS-Ganesha:
    1. Copy the volume's export information from your backup copy of ganesha.conf to the new /etc/ganesha/ganesha.conf file.
      The export information in the backed up file is similar to the following: 
      %include "/etc/ganesha/exports/export.v1.conf"
%include "/etc/ganesha/exports/export.v2.conf"
%include "/etc/ganesha/exports/export.v3.conf"
      Copy to Clipboard Toggle word wrap
    2. Copy the backup volume export files from the backup directory to /etc/ganesha/exports by running the following command from the backup directory: 
      # cp export.* /etc/ganesha/exports/
      Copy to Clipboard Toggle word wrap
  10. Enable firewall settings for new services and ports. See the Red Hat Gluster Storage 3.3 Administration Guide for details: https://access.redhat.com/documentation/en-us/red_hat_gluster_storage/3.3/html/administration_guide/chap-getting_started.
  11. Enable the shared volume. 
    # gluster volume set all cluster.enable-shared-storage enable
    Copy to Clipboard Toggle word wrap
  12. Ensure that the shared storage volume is mounted on the server. If the volume is not mounted, run the following command: 
    # mount -t glusterfs hostname:gluster_shared_storage /var/run/gluster/shared_storage
    Copy to Clipboard Toggle word wrap
  13. Ensure that the /var/run/gluster/shared_storage/nfs-ganesha directory is created. 
    # cd /var/run/gluster/shared_storage/
# mkdir nfs-ganesha
    Copy to Clipboard Toggle word wrap
  14. If you use NFS-Ganesha:
    1. Copy the ganesha.conf and ganesha-ha.conf files, and the /etc/ganesha/exports directory to the /var/run/gluster/shared_storage/nfs-ganesha directory. 
      # cd /etc/ganesha/
# cp ganesha.conf  ganesha-ha.conf /var/run/gluster/shared_storage/nfs-ganesha/
# cp -r exports/ /var/run/gluster/shared_storage/nfs-ganesha/
      Copy to Clipboard Toggle word wrap
    2. Update the path of any export entries in the ganesha.conf file. 
      # sed -i 's/\/etc\/ganesha/\/var\/run\/gluster\/shared_storage\/nfs-ganesha/' /var/run/gluster/shared_storage/nfs-ganesha/ganesha.conf
      Copy to Clipboard Toggle word wrap
    3. Run the following to clean up any existing cluster configuration: 
      /usr/libexec/ganesha/ganesha-ha.sh --cleanup /var/run/gluster/shared_storage/nfs-ganesha
      Copy to Clipboard Toggle word wrap
    4. If you have upgraded to Red Hat Enterprise Linux 7.4 or later, set the following SELinux Booleans: 
      # setsebool -P ganesha_use_fusefs on
# setsebool -P gluster_use_execmem on
      Copy to Clipboard Toggle word wrap
  15. Start the ctdb service (and nfs-ganesha service, if used) and verify that all nodes are functional. 
    # systemctl start ctdb
# gluster nfs-ganesha enable
    Copy to Clipboard Toggle word wrap
  16. If this deployment uses NFS-Ganesha, enable NFS-Ganesha on all volumes. 
    # gluster volume set volname ganesha.enable on
    Copy to Clipboard Toggle word wrap
返回顶部
Red Hat logoGithubredditYoutubeTwitter

学习

尝试、购买和销售

社区

关于红帽文档

通过我们的产品和服务，以及可以信赖的内容，帮助红帽用户创新并实现他们的目标。 了解我们当前的更新.

让开源更具包容性

红帽致力于替换我们的代码、文档和 Web 属性中存在问题的语言。欲了解更多详情，请参阅红帽博客.

關於紅帽

我们提供强化的解决方案，使企业能够更轻松地跨平台和环境（从核心数据中心到网络边缘）工作。

Theme

© 2025 Red Hat