OpenShift Container Storage is now OpenShift Data Foundation starting with version 4.9.
Chapter 5. Deploy Containerized Storage in Independent Mode
Deployment workflow | Registry | Metrics | Logging | Applications |
---|---|---|---|---|
Section 5.3, “Deploying Red Hat Openshift Container Storage in Independent Mode” | ✔ | |||
Section 5.4, “Deploying Red Hat Openshift Container Storage in Independent mode for Applications with Registry, Logging, and Metrics” | ✔ | ✔ | ✔ | ✔ |
Note
- Red Hat Openshift Container Storage does not support a simultaneous deployment of converged and independent mode with ansible workflow. Therefore, you must deploy either converged mode or independent mode: you cannot mix both modes during deployment.
- s3 is deployed manually and not through Ansible installer. For more information on manual deployment, see https://access.redhat.com/documentation/en-us/red_hat_openshift_container_storage/3.10/html-single/operations_guide/#S3_Object_Store
5.1. Setting up a RHGS Cluster Copy linkLink copied to clipboard!
5.1.1. Installing Red Hat Gluster Storage Server on Red Hat Enterprise Linux (Layered Install) Copy linkLink copied to clipboard!
Important
/var
partition that is large enough (50GB - 100GB) for log files, geo-replication related miscellaneous files, and other files.
Perform a base install of Red Hat Enterprise Linux 7 Server
Independent mode is supported only on Red Hat Enterprise Linux 7.Register the System with Subscription Manager
Run the following command and enter your Red Hat Network username and password to register the system with the Red Hat Network:subscription-manager register
# subscription-manager register
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Identify Available Entitlement Pools
Run the following commands to find entitlement pools containing the repositories required to install Red Hat Gluster Storage:subscription-manager list --available
# subscription-manager list --available
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Attach Entitlement Pools to the System
Use the pool identifiers located in the previous step to attach theRed Hat Enterprise Linux Server
andRed Hat Gluster Storage
entitlements to the system. Run the following command to attach the entitlements:subscription-manager attach --pool=[POOLID]
# subscription-manager attach --pool=[POOLID]
Copy to Clipboard Copied! Toggle word wrap Toggle overflow For example:subscription-manager attach --pool=8a85f9814999f69101499c05aa706e47
# subscription-manager attach --pool=8a85f9814999f69101499c05aa706e47
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Enable the Required Channels
For Red Hat Gluster Storage 3.4 on Red Hat Enterprise Linux 7.x- Run the following commands to enable the repositories required to install Red Hat Gluster Storage
subscription-manager repos --enable=rhel-7-server-rpms subscription-manager repos --enable=rh-gluster-3-for-rhel-7-server-rpms subscription-manager repos --enable=rhel-7-server-extras-rpms
# subscription-manager repos --enable=rhel-7-server-rpms # subscription-manager repos --enable=rh-gluster-3-for-rhel-7-server-rpms # subscription-manager repos --enable=rhel-7-server-extras-rpms
Copy to Clipboard Copied! Toggle word wrap Toggle overflow
Verify if the Channels are Enabled
Run the following command to verify if the channels are enabled:yum repolist
# yum repolist
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Update all packages
Ensure that all packages are up to date by running the following command.yum update
# yum update
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Important
If any kernel packages are updated, reboot the system with the following command.shutdown -r now
# shutdown -r now
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Kernel Version Requirement
Independent mode requires the kernel-3.10.0-690.el7 version or higher to be used on the system. Verify the installed and running kernel versions by running the following command:rpm -q kernel
# rpm -q kernel kernel-3.10.0-862.11.6.el7.x86_64
Copy to Clipboard Copied! Toggle word wrap Toggle overflow uname -r
# uname -r 3.10.0-862.11.6.el7.x86_64
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Install Red Hat Gluster Storage
Run the following command to install Red Hat Gluster Storage:yum install redhat-storage-server
# yum install redhat-storage-server
Copy to Clipboard Copied! Toggle word wrap Toggle overflow - To enable gluster-block execute the following command:
yum install gluster-block
# yum install gluster-block
Copy to Clipboard Copied! Toggle word wrap Toggle overflow
Reboot
Reboot the system.
5.1.2. Configuring Port Access Copy linkLink copied to clipboard!
firewall-cmd --zone=zone_name --add-port=24010/tcp --add-port=3260/tcp --add-port=111/tcp --add-port=22/tcp --add-port=24007/tcp --add-port=24008/tcp --add-port=49152-49664/tcp firewall-cmd --zone=zone_name --add-port=24010/tcp --add-port=3260/tcp --add-port=111/tcp --add-port=22/tcp --add-port=24007/tcp --add-port=24008/tcp --add-port=49152-49664/tcp --permanent
# firewall-cmd --zone=zone_name --add-port=24010/tcp --add-port=3260/tcp --add-port=111/tcp --add-port=22/tcp --add-port=24007/tcp --add-port=24008/tcp --add-port=49152-49664/tcp
# firewall-cmd --zone=zone_name --add-port=24010/tcp --add-port=3260/tcp --add-port=111/tcp --add-port=22/tcp --add-port=24007/tcp --add-port=24008/tcp --add-port=49152-49664/tcp --permanent
Note
- Port 24010 and 3260 are for gluster-blockd and iSCSI targets respectively.
- The port range starting at 49664 defines the range of ports that can be used by GlusterFS for communication to its volume bricks. In the above example the total number of bricks allowed is 512. Configure the port range based on the maximum number of bricks that could be hosted on each node.
5.1.3. Enabling Kernel Modules Copy linkLink copied to clipboard!
- You must ensure that the
dm_thin_pool
andtarget_core_user
modules are loaded in the Red Hat Gluster Storage nodes.modprobe target_core_user
# modprobe target_core_user
Copy to Clipboard Copied! Toggle word wrap Toggle overflow modprobe dm_thin_pool
# modprobe dm_thin_pool
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Execute the following command to verify if the modules are loaded:lsmod | grep dm_thin_pool
# lsmod | grep dm_thin_pool
Copy to Clipboard Copied! Toggle word wrap Toggle overflow lsmod | grep target_core_user
# lsmod | grep target_core_user
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Note
To ensure these operations are persisted across reboots, create the following files and update each file with the content as mentioned:cat /etc/modules-load.d/dm_thin_pool.conf dm_thin_pool
# cat /etc/modules-load.d/dm_thin_pool.conf dm_thin_pool
Copy to Clipboard Copied! Toggle word wrap Toggle overflow cat /etc/modules-load.d/target_core_user.conf target_core_user
# cat /etc/modules-load.d/target_core_user.conf target_core_user
Copy to Clipboard Copied! Toggle word wrap Toggle overflow - You must ensure that the
dm_multipath
module is loaded on all OpenShift Container Platform nodes.modprobe dm_multipath
# modprobe dm_multipath
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Execute the following command to verify if the modules are loaded:lsmod | grep dm_multipath
# lsmod | grep dm_multipath
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Note
To ensure these operations are persisted across reboots, create the following file and update it with the content as mentioned:cat /etc/modules-load.d/dm_multipath.conf dm_multipath
# cat /etc/modules-load.d/dm_multipath.conf dm_multipath
Copy to Clipboard Copied! Toggle word wrap Toggle overflow
5.1.4. Starting and Enabling Services Copy linkLink copied to clipboard!
systemctl start sshd
# systemctl start sshd
systemctl enable sshd
# systemctl enable sshd
systemctl start glusterd
# systemctl start glusterd
systemctl enable glusterd
# systemctl enable glusterd
systemctl start gluster-blockd
# systemctl start gluster-blockd
systemctl enable gluster-blockd
# systemctl enable gluster-blockd