9장.
9.1. 링크 복사링크가 클립보드에 복사되었습니다!
clusterinstance/ ├── site1-sno-du.yaml ├── extra-manifest/ │ ├── 01-example-machine-config.yaml │ ├── enable-crun-master.yaml │ └── enable-crun-worker.yaml └── kustomization.yamlapiVersion: kustomize.config.k8s.io/v1beta1 kind: Kustomization resources: - site1-sno-du.yaml configMapGenerator: - name: extra-manifests-cm namespace: site1-sno-du files: - extra-manifest/01-example-machine-config.yaml - extra-manifest/enable-crun-master.yaml - extra-manifest/enable-crun-worker.yaml generatorOptions: disableNameSuffixHash: trueapiVersion: siteconfig.open-cluster-management.io/v1alpha1 kind: ClusterInstance metadata: name: "site1-sno-du" namespace: "site1-sno-du" spec: clusterName: "site1-sno-du" networkType: "OVNKubernetes" extraManifestsRefs: - name: extra-manifests-cm # ...- 참고
9.2. 링크 복사링크가 클립보드에 복사되었습니다!
apiVersion: kustomize.config.k8s.io/v1beta1 kind: Kustomization resources: - site1-sno-du.yaml configMapGenerator: - name: br-ex-extra-manifest namespace: site1-sno-du files: - extra-manifest/10-br-ex-master.yaml generatorOptions: disableNameSuffixHash: trueapiVersion: siteconfig.open-cluster-management.io/v1alpha1 kind: ClusterInstance metadata: name: "site1-sno-du" namespace: "site1-sno-du" spec: clusterName: "site1-sno-du" networkType: "OVNKubernetes" extraManifestsRefs: - name: br-ex-extra-manifest # ...
$ oc get configmap br-ex-extra-manifest -n site1-sno-du$ oc get machineconfig 10-br-ex-master
9.3. 링크 복사링크가 클립보드에 복사되었습니다!
apiVersion: siteconfig.open-cluster-management.io/v1alpha1 kind: ClusterInstance metadata: name: "site1-sno-du" namespace: "site1-sno-du" spec: nodes: - hostName: "node1.example.com" nodeNetwork: interfaces: - name: "bond0.120" macAddress: "00:00:00:00:00:00" config: interfaces: - name: bond0.120 type: vlan state: up mtu: 9100 ipv4: enabled: true dhcp: false address: - ip: "192.168.120.15" prefix-length: 25 vlan: base-iface: bond0 id: 120 # ...apiVersion: operator.openshift.io/v1 kind: Network metadata: name: cluster spec: defaultNetwork: ovnKubernetesConfig: mtu: 8900clusterinstance/ ├── site1-sno-du.yaml ├── extra-manifest/ │ └── set-cluster-mtu.yaml └── kustomization.yamlapiVersion: kustomize.config.k8s.io/v1beta1 kind: Kustomization resources: - site1-sno-du.yaml configMapGenerator: - name: cluster-mtu-extra-manifests namespace: site1-sno-du files: - extra-manifest/set-cluster-mtu.yaml generatorOptions: disableNameSuffixHash: trueapiVersion: siteconfig.open-cluster-management.io/v1alpha1 kind: ClusterInstance metadata: name: "site1-sno-du" namespace: "site1-sno-du" spec: clusterName: "site1-sno-du" networkType: "OVNKubernetes" extraManifestsRefs: - name: cluster-mtu-extra-manifests # ...
$ oc get networks.operator.openshift.io cluster -o yamlapiVersion: operator.openshift.io/v1 kind: Network metadata: name: cluster # ... spec: # ... defaultNetwork: ovnKubernetesConfig: # ... mtu: 8900
9.4. 링크 복사링크가 클립보드에 복사되었습니다!
apiVersion: siteconfig.open-cluster-management.io/v1alpha1 kind: ClusterInstance metadata: name: "example-cluster" namespace: "example-cluster" spec: # ... nodes: - hostName: "worker-node2.example.com" role: "worker" extraAnnotations: BareMetalHost: bmac.agent-install.openshift.io/remove-agent-and-node-on-delete: "true" # ...$ oc get bmh -n <cluster_namespace> <bmh_name> -ojsonpath='{.metadata}' | jq -r '.annotations["bmac.agent-install.openshift.io/remove-agent-and-node-on-delete"]'trueapiVersion: siteconfig.open-cluster-management.io/v1alpha1 kind: ClusterInstance metadata: name: "example-cluster" namespace: "example-cluster" spec: # ... nodes: - hostName: "worker-node2.example.com" role: "worker" pruneManifests: - apiVersion: metal3.io/v1alpha1 kind: BareMetalHost # ...
$ oc get bmh -n <cluster_namespace>$ oc get agent -n <cluster_namespace>$ oc get nodes참고
9.5. 링크 복사링크가 클립보드에 복사되었습니다!
$ oc --kubeconfig <managed_cluster_kubeconfig> get nodesNAME STATUS ROLES AGE VERSION control-plane-0.example.com Ready control-plane,master 10d v1.33.0 control-plane-1.example.com Ready control-plane,master 10d v1.33.0 control-plane-2.example.com NotReady control-plane,master 10d v1.33.0 compute-1.example.com Ready worker 10d v1.33.0
apiVersion: siteconfig.open-cluster-management.io/v1alpha1 kind: ClusterInstance metadata: name: "example-cluster" namespace: "example-cluster" spec: # ... nodes: - hostName: "control-plane-2.example.com" role: "master" extraAnnotations: BareMetalHost: bmac.agent-install.openshift.io/remove-agent-and-node-on-delete: "true" # ...$ oc --kubeconfig <hub_cluster_kubeconfig> get bmh -n <cluster_namespace> <bmh_name> \ -o jsonpath='{.metadata.annotations.bmac\.agent-install\.openshift.io/remove-agent-and-node-on-delete}{"\n"}'trueapiVersion: siteconfig.open-cluster-management.io/v1alpha1 kind: ClusterInstance metadata: name: "example-cluster" namespace: "example-cluster" spec: # ... nodes: - hostName: "control-plane-2.example.com" role: "master" extraAnnotations: BareMetalHost: bmac.agent-install.openshift.io/remove-agent-and-node-on-delete: "true" pruneManifests: - apiVersion: metal3.io/v1alpha1 kind: BareMetalHost # ...$ oc --kubeconfig <hub_cluster_kubeconfig> get bmh -n <cluster_namespace>$ oc --kubeconfig <hub_cluster_kubeconfig> get agent -n <cluster_namespace> \ -o jsonpath='{range .items[*]}{.spec.hostname}{"\n"}{end}' | grep <failed_hostname>- 중요
$ oc --kubeconfig <managed_cluster_kubeconfig> get nodesapiVersion: siteconfig.open-cluster-management.io/v1alpha1 kind: ClusterInstance metadata: name: "example-cluster" namespace: "example-cluster" spec: # ... nodes: - hostName: "control-plane-2.example.com" role: "master" bmcAddress: "redfish-virtualmedia+https://192.0.2.22/redfish/v1/Systems/System.Embedded.1" bmcCredentialsName: name: "control-plane-2-bmc-secret" bootMACAddress: "AA:BB:CC:DD:EE:22" bootMode: "UEFI" nodeNetwork: interfaces: - name: eno1 macAddress: "AA:BB:CC:DD:EE:22" config: interfaces: - name: eno1 type: ethernet state: up macAddress: "AA:BB:CC:DD:EE:22" ipv4: enabled: true address: - ip: 192.0.2.12 prefix-length: 24 ipv6: enabled: false # ...
apiVersion: v1 kind: Secret metadata: name: "control-plane-2-bmc-secret" namespace: example-cluster stringData: username: "username" password: "password" type: Opaque$ oc --kubeconfig <hub_cluster_kubeconfig> get bmh -n <cluster_namespace>NAME STATE CONSUMER ONLINE ERROR AGE control-plane-0.example.com provisioned true 10d control-plane-1.example.com provisioned true 10d control-plane-2.example.com provisioning true 5m
$ oc --kubeconfig <managed_cluster_kubeconfig> get nodes -l node-role.kubernetes.io/control-plane$ oc --kubeconfig <managed_cluster_kubeconfig> get pods -n openshift-etcd$ oc --kubeconfig <managed_cluster_kubeconfig> rsh -n openshift-etcd <etcd_pod> \ etcdctl member list -w table$ oc --kubeconfig <managed_cluster_kubeconfig> rsh -n openshift-etcd <etcd_pod> \ etcdctl endpoint health --cluster$ oc --kubeconfig <managed_cluster_kubeconfig> get clusteroperators etcd kube-apiserver