10.5. Quorum Devices
Red Hat Enterprise Linux 7.4 provides full support for the ability to configure a separate quorum device which acts as a third-party arbitration device for the cluster. Its primary use is to allow a cluster to sustain more node failures than standard quorum rules allow. A quorum device is recommended for clusters with an even number of nodes. With two-node clusters, the use of a quorum device can better determine which node survives in a split-brain situation.
You must take the following into account when configuring a quorum device.
- It is recommended that a quorum device be run on a different physical network at the same site as the cluster that uses the quorum device. Ideally, the quorum device host should be in a separate rack than the main cluster, or at least on a separate PSU and not on the same network segment as the corosync ring or rings.
- You cannot use more than one quorum device in a cluster at the same time.
- Although you cannot use more than one quorum device in a cluster at the same time, a single quorum device may be used by several clusters at the same time. Each cluster using that quorum device can use different algorithms and quorum options, as those are stored on the cluster nodes themselves. For example, a single quorum device can be used by one cluster with an
ffsplit
(fifty/fifty split) algorithm and by a second cluster with anlms
(last man standing) algorithm. - A quorum device should not be run on an existing cluster node.
10.5.1. Installing Quorum Device Packages Copy linkLink copied to clipboard!
Copy linkLink copied to clipboard!
Configuring a quorum device for a cluster requires that you install the following packages:
- Install
corosync-qdevice
on the nodes of an existing cluster.[root@node1:~]# yum install corosync-qdevice [root@node2:~]# yum install corosync-qdevice
[root@node1:~]# yum install corosync-qdevice [root@node2:~]# yum install corosync-qdevice
Copy to Clipboard Copied! Toggle word wrap Toggle overflow - Install
pcs
andcorosync-qnetd
on the quorum device host.[root@qdevice:~]# yum install pcs corosync-qnetd
[root@qdevice:~]# yum install pcs corosync-qnetd
Copy to Clipboard Copied! Toggle word wrap Toggle overflow - Start the
pcsd
service and enablepcsd
at system start on the quorum device host.[root@qdevice:~]# systemctl start pcsd.service [root@qdevice:~]# systemctl enable pcsd.service
[root@qdevice:~]# systemctl start pcsd.service [root@qdevice:~]# systemctl enable pcsd.service
Copy to Clipboard Copied! Toggle word wrap Toggle overflow
10.5.2. Configuring a Quorum Device Copy linkLink copied to clipboard!
Copy linkLink copied to clipboard!
This section provides a sample procedure to configure a quorum device in a Red Hat high availability cluster. The following procedure configures a quorum device and adds it to the cluster. In this example:
- The node used for a quorum device is
qdevice
. - The quorum device model is
net
, which is currently the only supported model. Thenet
model supports the following algorithms:ffsplit
: fifty-fifty split. This provides exactly one vote to the partition with the highest number of active nodes.lms
: last-man-standing. If the node is the only one left in the cluster that can see theqnetd
server, then it returns a vote.Warning
The LMS algorithm allows the cluster to remain quorate even with only one remaining node, but it also means that the voting power of the quorum device is great since it is the same as number_of_nodes - 1. Losing connection with the quorum device means losing number_of_nodes - 1 votes, which means that only a cluster with all nodes active can remain quorate (by overvoting the quorum device); any other cluster becomes inquorate.
For more detailed information on the implementation of these algorithms, see thecorosync-qdevice
(8) man page. - The cluster nodes are
node1
andnode2
.
The following procedure configures a quorum device and adds that quorum device to a cluster.
- On the node that you will use to host your quorum device, configure the quorum device with the following command. This command configures and starts the quorum device model
net
and configures the device to start on boot.Copy to Clipboard Copied! Toggle word wrap Toggle overflow After configuring the quorum device, you can check its status. This should show that thecorosync-qnetd
daemon is running and, at this point, there are no clients connected to it. The--full
command option provides detailed output.Copy to Clipboard Copied! Toggle word wrap Toggle overflow - Enable the ports on the firewall needed by the
pcsd
daemon and thenet
quorum device by enabling thehigh-availability
service onfirewalld
with following commands.[root@qdevice:~]# firewall-cmd --permanent --add-service=high-availability [root@qdevice:~]# firewall-cmd --add-service=high-availability
[root@qdevice:~]# firewall-cmd --permanent --add-service=high-availability [root@qdevice:~]# firewall-cmd --add-service=high-availability
Copy to Clipboard Copied! Toggle word wrap Toggle overflow - From one of the nodes in the existing cluster, authenticate user
hacluster
on the node that is hosting the quorum device.[root@node1:~] # pcs cluster auth qdevice Username: hacluster Password: qdevice: Authorized
[root@node1:~] # pcs cluster auth qdevice Username: hacluster Password: qdevice: Authorized
Copy to Clipboard Copied! Toggle word wrap Toggle overflow - Add the quorum device to the cluster.Before adding the quorum device, you can check the current configuration and status for the quorum device for later comparison. The output for these commands indicates that the cluster is not yet using a quorum device.
[root@node1:~]# pcs quorum config Options:
[root@node1:~]# pcs quorum config Options:
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Copy to Clipboard Copied! Toggle word wrap Toggle overflow The following command adds the quorum device that you have previously created to the cluster. You cannot use more than one quorum device in a cluster at the same time. However, one quorum device can be used by several clusters at the same time. This example command configures the quorum device to use theffsplit
algorithm. For information on the configuration options for the quorum device, see thecorosync-qdevice
(8) man page.Copy to Clipboard Copied! Toggle word wrap Toggle overflow - Check the configuration status of the quorum device.From the cluster side, you can execute the following commands to see how the configuration has changed.The
pcs quorum config
shows the quorum device that has been configured.Copy to Clipboard Copied! Toggle word wrap Toggle overflow Thepcs quorum status
command shows the quorum runtime status, indicating that the quorum device is in use.Copy to Clipboard Copied! Toggle word wrap Toggle overflow Thepcs quorum device status
shows the quorum device runtime status.Copy to Clipboard Copied! Toggle word wrap Toggle overflow From the quorum device side, you can execute the following status command, which shows the status of thecorosync-qnetd
daemon.Copy to Clipboard Copied! Toggle word wrap Toggle overflow
10.5.3. Managing the Quorum Device Service Copy linkLink copied to clipboard!
Copy linkLink copied to clipboard!
PCS provides the ability to manage the quorum device service on the local host (
corosync-qnetd
), as shown in the following example commands. Note that these commands affect only the corosync-qnetd
service.
[root@qdevice:~]# pcs qdevice start net [root@qdevice:~]# pcs qdevice stop net [root@qdevice:~]# pcs qdevice enable net [root@qdevice:~]# pcs qdevice disable net [root@qdevice:~]# pcs qdevice kill net
[root@qdevice:~]# pcs qdevice start net
[root@qdevice:~]# pcs qdevice stop net
[root@qdevice:~]# pcs qdevice enable net
[root@qdevice:~]# pcs qdevice disable net
[root@qdevice:~]# pcs qdevice kill net
10.5.4. Managing the Quorum Device Settings in a Cluster Copy linkLink copied to clipboard!
Copy linkLink copied to clipboard!
The following sections describe the PCS commands that you can use to manage the quorum device settings in a cluster, showing examples that are based on the quorum device configuration in Section 10.5.2, “Configuring a Quorum Device”.
10.5.4.1. Changing Quorum Device Settings Copy linkLink copied to clipboard!
Copy linkLink copied to clipboard!
You can change the setting of a quorum device with the
pcs quorum device update
command.
Warning
To change the
host
option of quorum device model net
, use the pcs quorum device remove
and the pcs quorum device add
commands to set up the configuration properly, unless the old and the new host are the same machine.
The following command changes the quorum device algorithm to
lms
.
10.5.4.2. Removing a Quorum Device Copy linkLink copied to clipboard!
Copy linkLink copied to clipboard!
Use the following command to remove a quorum device configured on a cluster node.
After you have removed a quorum device, you should see the following error message when displaying the quorum device status.
[root@node1:~]# pcs quorum device status Error: Unable to get quorum status: corosync-qdevice-tool: Can't connect to QDevice socket (is QDevice running?): No such file or directory
[root@node1:~]# pcs quorum device status
Error: Unable to get quorum status: corosync-qdevice-tool: Can't connect to QDevice socket (is QDevice running?): No such file or directory
10.5.4.3. Destroying a Quorum Device Copy linkLink copied to clipboard!
Copy linkLink copied to clipboard!
To disable and stop a quorum device on the quorum device host and delete all of its configuration files, use the following command.