Red Hat Summit Red Hat SummitSupportConsoleDevelopersStart a trialContact

Appendix B. Booting Fibre Channel from SAN

The following procedure lists the steps to configure booting a Fibre Channel from SAN before configuring the overcloud and deploying your Red Hat OpenStack Platform cloud.

Note

This procedure lists the steps which differ from the standard steps as described in the Director Installation and Configuration guide.

Make sure you have installed the undercloud by installing the necessary packages and subscribing to the channels as described in the Installing the Undercloud.

After you have completed installing the undercloud, download the images and upload them to the Image service (glance) as described in Obtaining Images for Overcloud Nodes.

Next, you need to set the nameserver on the undercloud’s OpenStack Networking subnet:

  1. On viewing the current ctlplane-subnet, you will see there is currently no dns_nameserver: 

    # openstack subnet list
# openstack subnet show <subnet-uuid>
    Copy to Clipboard Toggle word wrap

  2. Update this ctlplane-subnet to have a DNS nameserver: 

    # openstack subnet set --name ctlplane-subnet --dns-nameserver <dns-ip-address>
    Copy to Clipboard Toggle word wrap

  3. Check to make sure dns_nameserver is present and pingable: 

    # openstack subnet show $(openstack subnet list | awk '/ctlplane/ {print $2}') | grep dns_nameservers
    Copy to Clipboard Toggle word wrap

  4. Register the controller and compute nodes for the overcloud as described in the Registering Nodes for the Overcloud.

    For example, a template for registering two nodes might look like this: 

    {
    "nodes":[
    {
            "name": "cougar12",
            "pm_type":"pxe_ipmitool",
            "mac":[
                "bb:bb:bb:bb:bb:bb
"
            ],
            "cpu":"1",
            "memory":"8192",
            "disk":"40",
            "arch":"x86_64",
            "pm_user":"root",
            "pm_password":"password",
            "pm_addr":"192.168.24.205
"
        },
        {
            "name": "cougar09",
            "pm_type":"pxe_ipmitool",
            "mac":[
                "cc:cc:cc:cc:cc:cc"
            ],
            "cpu":"1",
            "memory":"8192",
            "disk":"40",
            "arch":"x86_64",
            "pm_user":"root",
            "pm_password":"password",
            "pm_addr":"192.168.24.205
"
        }
    ]
}
    Copy to Clipboard Toggle word wrap

    Here cougar9 and cougar12 are the nodes respectively.

  5. After creating the template, save the file to the stack user’s home directory (/home/stack/instackenv.json), then import it into the director using the following commands: 

    # openstack overcloud node import ~/instackenv.json
    Copy to Clipboard Toggle word wrap

  6. Verify the nodes are registered: 

    # openstack baremetal node list
    Copy to Clipboard Toggle word wrap

  7. (Optional) To monitor the logs: 

    # sudo journalctl -l -u openstack-ironic-inspector -u openstack-ironic-inspector-dnsmasq -u openstack-ironic-conductor -f
    Copy to Clipboard Toggle word wrap

  8. When the command completes running, the nodes should show power off, managed, false: 

    # openstack baremetal node list
    Copy to Clipboard Toggle word wrap

  9. Introspect all the nodes: 

    # openstack overcloud node introspect --all-manageable
# openstack overcloud node provide --all-manageable
    Copy to Clipboard Toggle word wrap

  10. Find the serial information to let the nodes know where to boot from as shown in the following example: 

    # openstack baremetal introspection data save cougar12|jq '.inventory.disks'
{
    "size": 64424509440,
    "serial": "514f0c5a51600d7b",
    "rotational": false,
    "vendor": "XtremIO",
    "name": "/dev/sdb",
    "wwn_vendor_extension": null,
    "hctl": "7:0:0:1",
    "wwn_with_extension": "0x514f0c5a51600d7b",
    "model": "XtremApp",
    "wwn": "0x514f0c5a51600d7b"

# openstack baremetal node set 3a5c5a91-334b-4baa-8347-6cc79dba75b7 --property root_device='{"serial": "514f0c5a51600d7b"}'

+------------------------+--------------------------------------------------------------------------+
| Property               | Value                                                                    |
+------------------------+--------------------------------------------------------------------------+
| boot_interface         |                                                                          |
| chassis_uuid           | None                                                                     |
| clean_step             | {}                                                                       |
| console_enabled        | False                                                                    |
| console_interface      |                                                                          |
| created_at             | 2017-08-02T15:14:44+00:00                                                |
| deploy_interface       |                                                                          |
| driver                 | pxe_ipmitool                                                             |
| driver_info            | {u'deploy_kernel': u'50ce10e3-5ffc-4ccd-ac29-93aac89d01f5',              |
|                        | u'ipmi_address': u'10.35.160.114', u'deploy_ramdisk': u'b1e4bd0e-        |
|                        | 17f8-4ebe-9854-ccd9ce0bbec2', u'ipmi_password': u'******',               |
|                        | u'ipmi_username': u'root'}                                               |
| driver_internal_info   | {}                                                                       |
| extra                  | {u'hardware_swift_object': u'extra_hardware-3a5c5a91-334b-               |
|                        | 4baa-8347-6cc79dba75b7'}                                                 |
| inspect_interface      |                                                                          |
| inspection_finished_at | None                                                                     |
| inspection_started_at  | None                                                                     |
| instance_info          | {}                                                                       |
| instance_uuid          | None                                                                     |
| last_error             | None                                                                     |
| maintenance            | False                                                                    |
| maintenance_reason     | None                                                                     |
| management_interface   |                                                                          |
| name                   | cougar12                                                                 |
| network_interface      | flat                                                                     |
| power_interface        |                                                                          |
| power_state            | power off                                                                |
| properties             | {u'cpu_arch': u'x86_64', u'root_device': {u'serial':                     |
|                        | u'514f0c5a51600d7b'}, u'cpus': u'12', u'capabilities': u'cpu_aes:true,cp |
|                        | u_hugepages:true,boot_option:local,cpu_vt:true,cpu_hugepages_1g:true,boo |
|                        | t_mode:bios', u'memory_mb': u'65536', u'local_gb': u'59'}                |
| provision_state        | available                                                                |
| provision_updated_at   | 2017-08-02T16:52:24+00:00                                                |
| raid_config            | {}                                                                       |
| raid_interface         |                                                                          |
| reservation            | localhost.localdomain                                                    |
| resource_class         | None                                                                     |
| storage_interface      |                                                                          |
| target_power_state     | None                                                                     |
| target_provision_state | None                                                                     |
| target_raid_config     | {}                                                                       |
| updated_at             | 2017-08-02T17:09:43+00:00                                                |
| uuid                   | 3a5c5a91-334b-4baa-8347-6cc79dba75b7                                     |
| vendor_interface       |                                                                          |
+------------------------+--------------------------------------------------------------------------+

# openstack baremetal introspection data save cougar09|jq '.inventory.disks'
{
    "size": 64424509440,
    "serial": "514f0c5a51600d79",
    "rotational": false,
    "vendor": "XtremIO",
    "name": "/dev/sdc",
    "wwn_vendor_extension": null,
    "hctl": "6:0:0:1",
    "wwn_with_extension": "0x514f0c5a51600d79",
    "model": "XtremApp",
    "wwn": "0x514f0c5a51600d79"
  },

# openstack baremetal node set e64dbe76-de91-4a59-96fa-bd7b6080bcea     --property root_device='{"serial": "514f0c5a51600d79"}'
+------------------------+--------------------------------------------------------------------------+
| Property               | Value                                                                    |
+------------------------+--------------------------------------------------------------------------+
| boot_interface         |                                                                          |
| chassis_uuid           | None                                                                     |
| clean_step             | {}                                                                       |
| console_enabled        | False                                                                    |
| console_interface      |                                                                          |
| created_at             | 2017-08-02T15:14:49+00:00                                                |
| deploy_interface       |                                                                          |
| driver                 | pxe_ipmitool                                                             |
| driver_info            | {u'deploy_kernel': u'50ce10e3-5ffc-4ccd-ac29-93aac89d01f5',              |
|                        | u'ipmi_address': u'10.35.160.140', u'deploy_ramdisk': u'b1e4bd0e-        |
|                        | 17f8-4ebe-9854-ccd9ce0bbec2', u'ipmi_password': u'******',               |
|                        | u'ipmi_username': u'root'}                                               |
| driver_internal_info   | {}                                                                       |
| extra                  | {u'hardware_swift_object': u'extra_hardware-e64dbe76-de91-4a59-96fa-     |
|                        | bd7b6080bcea'}                                                           |
| inspect_interface      |                                                                          |
| inspection_finished_at | None                                                                     |
| inspection_started_at  | None                                                                     |
| instance_info          | {}                                                                       |
| instance_uuid          | None                                                                     |
| last_error             | None                                                                     |
| maintenance            | False                                                                    |
| maintenance_reason     | None                                                                     |
| management_interface   |                                                                          |
| name                   | cougar09                                                                 |
| network_interface      | flat                                                                     |
| power_interface        |                                                                          |
| power_state            | power off                                                                |
| properties             | {u'cpu_arch': u'x86_64', u'root_device': {u'serial':                     |
|                        | u'514f0c5a51600d79'}, u'cpus': u'12', u'capabilities': u'cpu_aes:true,cp |
|                        | u_hugepages:true,boot_option:local,cpu_vt:true,cpu_hugepages_1g:true,boo |
|                        | t_mode:bios', u'memory_mb': u'65536', u'local_gb': u'59'}                |
| provision_state        | available                                                                |
| provision_updated_at   | 2017-08-02T16:52:24+00:00                                                |
| raid_config            | {}                                                                       |
| raid_interface         |                                                                          |
| reservation            | localhost.localdomain                                                    |
| resource_class         | None                                                                     |
| storage_interface      |                                                                          |
| target_power_state     | None                                                                     |
| target_provision_state | None                                                                     |
| target_raid_config     | {}                                                                       |
| updated_at             | 2017-08-02T17:10:30+00:00                                                |
| uuid                   | e64dbe76-de91-4a59-96fa-bd7b6080bcea                                     |
| vendor_interface       |                                                                          |
+------------------------+--------------------------------------------------------------------------+
    Copy to Clipboard Toggle word wrap

  11. Tag the nodes to the controller and compute profiles respectively. Check before and after to check the profile changes using the openstack overcloud profiles list: 

    # openstack baremetal node set --property capabilities='profile:compute,boot_option:local'  cougar09

# openstack baremetal node set --property capabilities='profile:compute,boot_option:local'  cougar12

# openstack overcloud profiles list
    Copy to Clipboard Toggle word wrap

  12. Make sure to check the openstack flavor list and update the templates/node_data.yaml file to match accordingly. Ensure your DNS servers are correct and pingable: 

    # openstack flavor list
+--------------------------------------+---------------+------+------+-----------+-------+-----------+
| ID                                   | Name          |  RAM | Disk | Ephemeral | VCPUs | Is Public |
+--------------------------------------+---------------+------+------+-----------+-------+-----------+
| 17606b91-5e0f-4b2b-90f9-b00ba711612b | baremetal     | 4096 |   40 |         0 |     1 | True      |
| 25e764bc-7f0d-45ed-9025-22e05570d4a8 | block-storage | 4096 |   40 |         0 |     1 | True      |
| a6892705-65c4-44b3-872f-784455a14290 | ceph-storage  | 4096 |   40 |         0 |     1 | True      |
| afc46d67-074b-42c8-9c19-5a586103b868 | control       | 4096 |   40 |         0 |     1 | True      |
| ba5f0485-b41a-4057-b0fe-7dd946c7d4fb | compute       | 4096 |   40 |         0 |     1 | True      |
| c508df47-9f59-4d69-ac8f-0b0f62cbfe73 | swift-storage | 4096 |   40 |         0 |     1 | True      |
+--------------------------------------+---------------+------+------+-----------+-------+-----------+
    Copy to Clipboard Toggle word wrap
    Note

    Make sure that the control and compute names match the names in the nodes_data.yaml file: 

    # cat templates/nodes_data.yaml
parameter_defaults:
    ControllerCount: '1'
    OvercloudControlFlavor: 'control'
    ComputeCount: '1'
    OvercloudComputeFlavor: 'compute'
    NtpServer: ["clock.redhat.com","clock2.redhat.com"]
    DnsServers: ["192.168.24.205","192.168.22.202"]
    Copy to Clipboard Toggle word wrap

  13. Set up the registry:

    For remote registry:

    Discover tag: 

    # sudo openstack overcloud container image tag discover \
--image registry.access.redhat.com/rhosp12/openstack-base:latest \
--tag-from-label <12-RELEASE>
    Copy to Clipboard Toggle word wrap

    Create the rhos12.yaml file: 

    # openstack overcloud container image prepare \
--namespace=registry.access.redhat.com/rhosp12 \
--env-file=/home/stack/rhos12.yaml --prefix=openstack- --suffix=-docker --tag=$TAG
    Copy to Clipboard Toggle word wrap

    For local registry:

    Discover tag: 

    # sudo openstack overcloud container image tag discover \
--image registry.access.redhat.com/rhosp12/openstack-base:latest \
--tag-from-label <12-RELEASE>
    Copy to Clipboard Toggle word wrap

    Create the container_images.yaml file: 

    # openstack overcloud container image prepare \ --namespace=192.168.24.1:8787/rhosp12 \ --env-file=/home/stack/container_images.yaml --prefix=openstack- \ --suffix=-docker --tag=$TAG
    Copy to Clipboard Toggle word wrap

    Upload the container image: 

    # sudo openstack overcloud container image upload --verbose \
--config-file /home/stack/container_images.yaml
    Copy to Clipboard Toggle word wrap

    Create the rhos12.yaml file: 

    # openstack overcloud container image prepare \ --namespace=192.168.24.1:8787/rhosp12 \ --env-file=/home/stack/rhos12.yaml --prefix=openstack- \ --suffix=-docker --tag=$TAG
    Copy to Clipboard Toggle word wrap

    Add the following line to the rhos12.yaml file: 

    parameter_defaults:
   DockerInsecureRegistryAddress: 192.168.24.1:8787
    Copy to Clipboard Toggle word wrap

  14. Restart the docker service on the undercloud and deploy the overcloud: 

    # systemctl restart docker
# openstack overcloud deploy --templates \
--libvirt-type kvm \
-e /home/stack/templates/nodes_data.yaml \
-e /home/stack/rhos12.yaml
    Copy to Clipboard Toggle word wrap

B.1. Enabling Multipath in the Overcloud Nodes
Copy link

By default, multipath is disabled on the overcloud nodes. In order to enable multipath support on the overcloud nodes, you need to run the following steps:

  1. Add the following configuration options to the /etc/multipath.conf file: 

    multipaths {
       multipath {
               wwid                    3514f0c5a51600d7b
               alias                   elmertlee
       }
}
    Copy to Clipboard Toggle word wrap

  2. Start and enable the multipath daemon (multipathd): 

    # systemctl restart multipathd
# systemctl status multipathd
# systemctl is-enabled multipathd
    Copy to Clipboard Toggle word wrap

  3. Add the wwid for the specified device to the `wwid`s file: 

    for i in `lsblk --list --paths --nodeps --noheadings --output NAME,MODEL,VENDOR|awk '/Xtrem/ {print $1}'`; do multipath -a $i; done
$i all the disk that are the same LAN  4 paths to same LAN
    Copy to Clipboard Toggle word wrap

  4. Boot with multipath in initramfs, dracut is a low-level tool for generating an initramfs image: 

    /sbin/dracut --force -H --add multipath
    Copy to Clipboard Toggle word wrap

  5. Reboot and allow OpenStack to utilize the multipath and verify the reboot: 

    # multipath -ll
WDC_WD5003ABYX-18WERA0_WD-WMAYP2759782 dm-3 ATA,WDC WD5003ABYX-1
size=466G features='0' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
  `- 2:0:0:0 sda 8:0  active ready running
elmertlee (3514f0c5a51600d7b) dm-0 XtremIO ,XtremApp
size=60G features='0' hwhandler='0' wp=rw
`-+- policy='queue-length 0' prio=1 status=active
  |- 6:0:0:1 sdb 8:16 active ready running
  |- 6:0:1:1 sdc 8:32 active ready running
  |- 7:0:0:1 sdd 8:48 active ready running
  `- 7:0:1:1 sde 8:64 active ready running

# multipath -ll
ST1000NM0011_Z1N4784E dm-4 ATA,ST1000NM0011
size=932G features='0' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
  `- 4:0:0:0 sdb 8:16 active ready running
WDC_WD5003ABYX-18WERA0_WD-WMAYP2908342 dm-3 ATA     ,WDC WD5003ABYX-1
size=466G features='0' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
  `- 2:0:0:0 sda 8:0  active ready running
3514f0c5a51600d79 dm-0 XtremIO ,XtremApp
size=60G features='0' hwhandler='0' wp=rw
`-+- policy='queue-length 0' prio=1 status=active
  |- 6:0:0:1 sdc 8:32 active ready running
  |- 6:0:1:1 sdd 8:48 active ready running
  |- 7:0:0:1 sde 8:64 active ready running
  `- 7:0:1:1 sdf 8:80 active ready running
    Copy to Clipboard Toggle word wrap
Back to top
Red Hat logoGithubredditYoutubeTwitter

Learn

Try, buy, & sell

Communities

About Red Hat Documentation

We help Red Hat users innovate and achieve their goals with our products and services with content they can trust. Explore our recent updates.

Making open source more inclusive

Red Hat is committed to replacing problematic language in our code, documentation, and web properties. For more details, see the Red Hat Blog.

About Red Hat

We deliver hardened solutions that make it easier for enterprises to work across platforms and environments, from the core datacenter to the network edge.

Theme

© 2025 Red Hat