Chapter 2. Troubleshooting installation issues

Procedure

1. Generate the commands that are required to obtain the installation logs from the bootstrap and control plane machines:

   • If you used installer-provisioned infrastructure, change to the directory that contains the installation program and run the following command:

     $ ./openshift-install gather bootstrap --dir <installation_directory> 1

     Copy to clipboard

     1

     installation_directory is the directory you specified when you ran ./openshift-install create cluster. This directory contains the OpenShift Container Platform definition files that the installation program creates.

     For installer-provisioned infrastructure, the installation program stores information about the cluster, so you do not specify the hostnames or IP addresses.

   • If you used infrastructure that you provisioned yourself, change to the directory that contains the installation program and run the following command:

     $ ./openshift-install gather bootstrap --dir <installation_directory> \ 1
         --bootstrap <bootstrap_address> \ 2
         --master <master_1_address> \ 3
         --master <master_2_address> \ 4
         --master <master_3_address> 5

     Copy to clipboard

     1

     For installation_directory, specify the same directory you specified when you ran ./openshift-install create cluster. This directory contains the OpenShift Container Platform definition files that the installation program creates.

     2

     <bootstrap_address> is the fully qualified domain name or IP address of the cluster’s bootstrap machine.

     3 4 5

     For each control plane, or master, machine in your cluster, replace <master_*_address> with its fully qualified domain name or IP address.

     Note

     A default cluster contains three control plane machines. List all of your control plane machines as shown, no matter how many your cluster uses.

   Example output

   INFO Pulling debug logs from the bootstrap machine
   INFO Bootstrap gather logs captured here "<installation_directory>/log-bundle-<timestamp>.tar.gz"

   Copy to clipboard

   If you open a Red Hat support case about your installation failure, include the compressed logs in the case.

Procedure

1. Collect the bootkube.service service logs from the bootstrap host using the journalctl command by running:

   $ journalctl -b -f -u bootkube.service

   Copy to clipboard

2. Collect the bootstrap host’s container logs using the podman logs. This is shown as a loop to get all of the container logs from the host:

   $ for pod in $(sudo podman ps -a -q); do sudo podman logs $pod; done

   Copy to clipboard

3. Alternatively, collect the host’s container logs using the tail command by running:

   # tail -f /var/lib/containers/storage/overlay-containers/*/userdata/ctr.log

   Copy to clipboard

4. Collect the kubelet.service and crio.service service logs from the master and worker hosts using the journalctl command by running:

   $ journalctl -b -f -u kubelet.service -u crio.service

   Copy to clipboard

5. Collect the master and worker host container logs using the tail command by running:

   $ sudo tail -f /var/log/containers/*

   Copy to clipboard

Procedure

1. Access journald unit logs under /var/log by running:

   $ oc adm node-logs --role=master -u kubelet

   Copy to clipboard

2. Access host file paths under /var/log by running:

   $ oc adm node-logs --role=master --path=openshift-apiserver

   Copy to clipboard

Procedure

1. Destroy the cluster and remove all the resources associated with the cluster, including the hidden installer state files in the installation directory:

   $ ./openshift-install destroy cluster --dir <installation_directory> 1

   Copy to clipboard

   1

   installation_directory is the directory you specified when you ran ./openshift-install create cluster. This directory contains the OpenShift Container Platform definition files that the installation program creates.

2. Before reinstalling the cluster, delete the installation directory:

   $ rm -rf <installation_directory>

   Copy to clipboard
3. Follow the procedure for installing a new OpenShift Container Platform cluster.