14.3. Preparing to Deploy Geo-replication

Creating Geo-replication Sessions

1. To create a common pem pub file, run the following command on the master node where the passwordless SSH connection is configured:

   # gluster system:: execute gsec_create

   Copy to Clipboard Toggle word wrap
2. Create the geo-replication session using the following command. The push-pem option is needed to perform the necessary pem-file setup on the slave nodes.

   # gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL create push-pem [force]# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL create push-pem [force]# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL create push-pem [force]# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL create push-pem [force]# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL create push-pem [force]# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL create push-pem [force]# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL create push-pem [force]

   Copy to Clipboard Toggle word wrap
   For example:

   # gluster volume geo-replication Volume1 example.com::slave-vol create push-pem

   Copy to Clipboard Toggle word wrap

   Note

   There must be passwordless SSH access between the node from which this command is run, and the slave host specified in the above command. This command performs the slave verification, which includes checking for a valid slave URL, valid slave volume, and available space on the slave. If the verification fails, you can use the force option which will ignore the failed verification and create a geo-replication session.
3. Configure the meta-volume for geo-replication:

   # gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL config use_meta_volume true

   Copy to Clipboard Toggle word wrap
   For example:

   # gluster volume geo-replication Volume1 example.com::slave-vol config use_meta_volume true

   Copy to Clipboard Toggle word wrap
   For more information on configuring meta-volume, see Section 14.3.5, “Configuring a Meta-Volume”.
4. Start the geo-replication by running the following command on the master node:
   For example,

   # gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL start [force]# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL start [force]# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL start [force]# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL start [force]# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL start [force]# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL start [force]

   Copy to Clipboard Toggle word wrap
5. Verify the status of the created session by running the following command:

   # gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL status# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL status# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL status# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL status# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL status# gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL status

   Copy to Clipboard Toggle word wrap

1. Create a new group. For example, geogroup.
2. Create a unprivileged account. For example, geoaccount. Add geoaccount as a member of geogroup group.
3. As a root, create a new directory with permissions 0711 and with correct SELinux context. Ensure that the location where this directory is created is writeable only by root but geoaccount is able to access it.
   For example,

   # mkdir /var/mountbroker-root
   # chmod 0711 /var/mountbroker-root
   # semanage fcontext -a -e /home /var/mountbroker-root
   # restorecon -Rv /var/mountbroker-root

   Copy to Clipboard Toggle word wrap
4. Run the following commands in any one of the Slave node:

   # gluster system:: execute mountbroker opt mountbroker-root /var/mountbroker-root
   # gluster system:: execute mountbroker user geoaccount slavevol
   # gluster system:: execute mountbroker opt geo-replication-log-group geogroup
   # gluster system:: execute mountbroker opt rpc-auth-allow-insecure on

   Copy to Clipboard Toggle word wrap
   See Section 2.4, “Storage Concepts” for information on glusterd.vol volume file of a Red Hat Gluster Storage volume.
   If the above commands fails, check if the glusterd.vol file is available at /etc/glusterfs/ directory. If not found, create a glusterd.vol file containing the default configuration and save it at /etc/glusterfs/ directory. Now re-run the above commands listed above to get all the required geo-replication options.
   The following is the sample glusterd.vol file along with default options:

   volume management
       type mgmt/glusterd
       option working-directory /var/lib/glusterd
       option transport-type socket,rdma
       option transport.socket.keepalive-time 10
       option transport.socket.keepalive-interval 2
       option transport.socket.read-fail-log off
       option rpc-auth-allow-insecure on
       
       option mountbroker-root /var/mountbroker-root 
       option mountbroker-geo-replication.geoaccount slavevol
       option geo-replication-log-group geogroup
   end-volume

   Copy to Clipboard Toggle word wrap
   • If you have multiple slave volumes on Slave, repeat Step 2 for each of them and run the following commands to update the vol file:

     # gluster system:: execute mountbroker user geoaccount2 slavevol2
     # gluster system:: execute mountbroker user geoaccount3 slavevol3

     Copy to Clipboard Toggle word wrap
     You can use gluster system:: execute mountbroker info command to view the configured mountbroker options.
   • You can add multiple slave volumes within the same account (geoaccount) by providing comma-separated list (without spaces) as the argument of mountbroker-geo-replication.geogroup. You can also have multiple options of the form mountbroker-geo-replication.*. It is recommended to use one service account per Master machine. For example, if there are multiple slave volumes on Slave for the master machines Master1, Master2, and Master3, then create a dedicated service user on Slave for them by repeating Step 2. for each (like geogroup1, geogroup2, and geogroup3), and then run the following commands to add the corresponding options to the volfile:

     # gluster system:: execute mountbroker user geoaccount1 slavevol11,slavevol12,slavevol13
     # gluster system:: execute mountbroker user geoaccount2 slavevol21,slavevol22
     # gluster system:: execute mountbroker user geoaccount3 slavevol31

     Copy to Clipboard Toggle word wrap
5. Restart glusterd service on all the Slave nodes.
   After you setup an auxiliary glusterFS mount for the unprivileged account on all the Slave nodes, perform the following steps to setup a non-root geo-replication session.:
6. Setup a passwordless SSH from one of the master node to the user on one of the slave node.
   For example, to setup a passwordless SSH to the user geoaccount.

   # ssh-keygen
   # ssh-copy-id -i identity_file geoaccount@slave_node_IPaddress/Hostname

   Copy to Clipboard Toggle word wrap
7. Create a common pem pub file by running the following command on the master node where the passwordless SSH connection is configured to the user on the slave node:

   # gluster system:: execute gsec_create

   Copy to Clipboard Toggle word wrap
8. Create a geo-replication relationship between master and slave to the user by running the following command on the master node:
   For example,

   # gluster volume geo-replication MASTERVOL geoaccount@SLAVENODE::slavevol create push-pem

   Copy to Clipboard Toggle word wrap
   If you have multiple slave volumes and/or multiple accounts, create a geo-replication session with that particular user and volume.
   For example,

   # gluster volume geo-replication MASTERVOL geoaccount2@SLAVENODE::slavevol2 create push-pem

   Copy to Clipboard Toggle word wrap
9. In the slavenode, which is used to create relationship, run /usr/libexec/glusterfs/set_geo_rep_pem_keys.sh as a root with user name, master volume name, and slave volume names as the arguments.
   For example,

    # /usr/libexec/glusterfs/set_geo_rep_pem_keys.sh geoaccount MASTERVOL SLAVEVOL_NAME 

   Copy to Clipboard Toggle word wrap
10. Configure the meta-volume for geo-replication:

    # gluster volume geo-replication MASTER_VOL SLAVE_HOST::SLAVE_VOL config use_meta_volume true

    Copy to Clipboard Toggle word wrap
    For example:

    # gluster volume geo-replication Volume1 example.com::slave-vol config use_meta_volume true

    Copy to Clipboard Toggle word wrap
    For more information on configuring meta-volume, see Section 14.3.5, “Configuring a Meta-Volume”.
11. Start the geo-replication with slave user by running the following command on the master node:
    For example,

    # gluster volume geo-replication MASTERVOL geoaccount@SLAVENODE::slavevol start

    Copy to Clipboard Toggle word wrap
12. Verify the status of geo-replication session by running the following command on the master node:

    # gluster volume geo-replication MASTERVOL geoaccount@SLAVENODE::slavevol status

    Copy to Clipboard Toggle word wrap