1.9.2. 为 Red Hat Ceph Storage RGW 迁移完成先决条件

流程

1. 检查 Red Hat Ceph Storage 节点的当前状态：

   (undercloud) [stack@undercloud-0 ~]$ metalsmith list
   
   
       +------------------------+    +----------------+
       | IP Addresses           |    |  Hostname      |
       +------------------------+    +----------------+
       | ctlplane=192.168.24.25 |    | cephstorage-0  |
       | ctlplane=192.168.24.10 |    | cephstorage-1  |
       | ctlplane=192.168.24.32 |    | cephstorage-2  |
       | ctlplane=192.168.24.28 |    | compute-0      |
       | ctlplane=192.168.24.26 |    | compute-1      |
       | ctlplane=192.168.24.43 |    | controller-0   |
       | ctlplane=192.168.24.7  |    | controller-1   |
       | ctlplane=192.168.24.41 |    | controller-2   |
       +------------------------+    +----------------+

2. 登录到 controller-0，并检查 Pacemaker 状态以识别 RGW 迁移的重要信息：

   Full List of Resources:
     * ip-192.168.24.46	(ocf:heartbeat:IPaddr2):     	Started controller-0
     * ip-10.0.0.103   	(ocf:heartbeat:IPaddr2):     	Started controller-1
     * ip-172.17.1.129 	(ocf:heartbeat:IPaddr2):     	Started controller-2
     * ip-172.17.3.68  	(ocf:heartbeat:IPaddr2):     	Started controller-0
     * ip-172.17.4.37  	(ocf:heartbeat:IPaddr2):     	Started controller-1
     * Container bundle set: haproxy-bundle
   
   [undercloud-0.ctlplane.redhat.local:8787/rh-osbs/rhosp17-openstack-haproxy:pcmklatest]:
       * haproxy-bundle-podman-0   (ocf:heartbeat:podman):  Started controller-2
       * haproxy-bundle-podman-1   (ocf:heartbeat:podman):  Started controller-0
       * haproxy-bundle-podman-2   (ocf:heartbeat:podman):  Started controller-1

3. 识别存储网络的范围。以下是一个示例，值可能与您环境中的不同：

   [heat-admin@controller-0 ~]$ ip -o -4 a
   
   1: lo	inet 127.0.0.1/8 scope host lo\   	valid_lft forever preferred_lft forever
   2: enp1s0	inet 192.168.24.45/24 brd 192.168.24.255 scope global enp1s0\   	valid_lft forever preferred_lft forever
   2: enp1s0	inet 192.168.24.46/32 brd 192.168.24.255 scope global enp1s0\   	valid_lft forever preferred_lft forever
   7: br-ex	inet 10.0.0.122/24 brd 10.0.0.255 scope global br-ex\   	valid_lft forever preferred_lft forever 

   1

   
   8: vlan70	inet 172.17.5.22/24 brd 172.17.5.255 scope global vlan70\   	valid_lft forever preferred_lft forever
   8: vlan70	inet 172.17.5.94/32 brd 172.17.5.255 scope global vlan70\   	valid_lft forever preferred_lft forever
   9: vlan50	inet 172.17.2.140/24 brd 172.17.2.255 scope global vlan50\   	valid_lft forever preferred_lft forever
   10: vlan30	inet 172.17.3.73/24 brd 172.17.3.255 scope global vlan30\   	valid_lft forever preferred_lft forever 

   2

   
   10: vlan30	inet 172.17.3.68/32 brd 172.17.3.255 scope global vlan30\   	valid_lft forever preferred_lft forever
   11: vlan20	inet 172.17.1.88/24 brd 172.17.1.255 scope global vlan20\   	valid_lft forever preferred_lft forever
   12: vlan40	inet 172.17.4.24/24 brd 172.17.4.255 scope global vlan40\   	valid_lft forever preferred_lft forever

   1

   br-ex 代表外部网络，在当前环境中，HAProxy 已分配前端虚拟 IP (VIP)。

   2

   vlan30 代表存储网络，应在 Red Hat Ceph Storage 节点上启动新的 RGW 实例。

4. 识别您之前在 HAProxy 中具有的网络，并通过 director Operator 传播到 Red Hat Ceph Storage 节点。使用此网络保留由 Red Hat Ceph Storage 拥有的新 VIP，作为 RGW 服务的入口点。

   1. 登录到 controller-0，并在当前 HAProxy 配置中找到 ceph_rgw 部分：

      $ less /var/lib/config-data/puppet-generated/haproxy/etc/haproxy/haproxy.cfg
      ...
      ...
      listen ceph_rgw
        bind 10.0.0.103:8080 transparent
        bind 172.17.3.68:8080 transparent
        mode http
        balance leastconn
        http-request set-header X-Forwarded-Proto https if { ssl_fc }
        http-request set-header X-Forwarded-Proto http if !{ ssl_fc }
        http-request set-header X-Forwarded-Port %[dst_port]
        option httpchk GET /swift/healthcheck
        option httplog
        option forwardfor
        server controller-0.storage.redhat.local 172.17.3.73:8080 check fall 5 inter 2000 rise 2
        server controller-1.storage.redhat.local 172.17.3.146:8080 check fall 5 inter 2000 rise 2
        server controller-2.storage.redhat.local 172.17.3.156:8080 check fall 5 inter 2000 rise 2

   2. 确认网络已用作 HAProxy 前端。下例演示了 controller-0 使用外部网络来公开服务，这不包括在 Red Hat Ceph Storage 节点。您必须通过 director Operator 传播外部网络：

      [controller-0]$ ip -o -4 a
      
      ...
      7: br-ex	inet 10.0.0.106/24 brd 10.0.0.255 scope global br-ex\   	valid_lft forever preferred_lft forever
      ...

      注意

      如果目标节点不是由 director 管理，则无法使用此流程配置网络。管理员必须手动配置所有必需的网络。

5. 将 HAProxy 前端网络传播到 Red Hat Ceph Storage 节点。

   1. 在用来定义 ceph-storage 网络接口的 NIC 模板中，在 Red Hat Ceph Storage 网络配置模板文件中添加新配置部分，例如 /home/stack/composable_roles/network/nic-configs/ceph-storage.j2 ：

      ---
      network_config:
      - type: interface
        name: nic1
        use_dhcp: false
        dns_servers: {{ ctlplane_dns_nameservers }}
        addresses:
        - ip_netmask: {{ ctlplane_ip }}/{{ ctlplane_cidr }}
        routes: {{ ctlplane_host_routes }}
      - type: vlan
        vlan_id: {{ storage_mgmt_vlan_id }}
        device: nic1
        addresses:
        - ip_netmask: {{ storage_mgmt_ip }}/{{ storage_mgmt_cidr }}
        routes: {{ storage_mgmt_host_routes }}
      - type: interface
        name: nic2
        use_dhcp: false
        defroute: false
      - type: vlan
        vlan_id: {{ storage_vlan_id }}
        device: nic2
        addresses:
        - ip_netmask: {{ storage_ip }}/{{ storage_cidr }}
        routes: {{ storage_host_routes }}
      - type: ovs_bridge
        name: {{ neutron_physical_bridge_name }}
        dns_servers: {{ ctlplane_dns_nameservers }}
        domain: {{ dns_search_domains }}
        use_dhcp: false
        addresses:
        - ip_netmask: {{ external_ip }}/{{ external_cidr }}
        routes: {{ external_host_routes }}
        members: []
        - type: interface
          name: nic3
          primary: true

   2. 将外部网络添加到裸机文件中，例如： /home/stack/composable_roles/network/baremetal_deployment.yaml，该文件由 metalsmith:

      注意

      在触发 os-net-config 时，确保为目标节点启用了 network_config_update，以传播到目标节点。

      - name: CephStorage
        count: 3
        hostname_format: cephstorage-%index%
        instances:
        - hostname: cephstorage-0
        name: ceph-0
        - hostname: cephstorage-1
        name: ceph-1
        - hostname: cephstorage-2
        name: ceph-2
        defaults:
        profile: ceph-storage
        network_config:
            template: /home/stack/composable_roles/network/nic-configs/ceph-storage.j2
            network_config_update: true
        networks:
        - network: ctlplane
            vif: true
        - network: storage
        - network: storage_mgmt
        - network: external

   3. 在裸机节点上配置新网络：

      (undercloud) [stack@undercloud-0]$ openstack overcloud node provision \
         -o overcloud-baremetal-deployed-0.yaml \
         --stack overcloud \
         --network-config -y \
        $PWD/composable_roles/network/baremetal_deployment.yaml

   4. 验证 Red Hat Ceph Storage 节点上的新网络是否已配置：

      [root@cephstorage-0 ~]# ip -o -4 a
      
      1: lo	inet 127.0.0.1/8 scope host lo\   	valid_lft forever preferred_lft forever
      2: enp1s0	inet 192.168.24.54/24 brd 192.168.24.255 scope global enp1s0\   	valid_lft forever preferred_lft forever
      11: vlan40	inet 172.17.4.43/24 brd 172.17.4.255 scope global vlan40\   	valid_lft forever preferred_lft forever
      12: vlan30	inet 172.17.3.23/24 brd 172.17.3.255 scope global vlan30\   	valid_lft forever preferred_lft forever
      14: br-ex	inet 10.0.0.133/24 brd 10.0.0.255 scope global br-ex\   	valid_lft forever preferred_lft forever