About Red Hat OpenShift Cluster Observability Operator

流程

1. 使用以下配置添加 MonitoringStack 资源：

   MonitoringStack 对象示例

   apiVersion: monitoring.rhobs/v1alpha1
   kind: MonitoringStack
   metadata:
     labels:
       coo: example
     name: sample-monitoring-stack
     namespace: coo-demo
   spec:
     logLevel: debug
     retention: 1d
     resourceSelector:
       matchLabels:
         app: demo

   Copy to Clipboard Toggle word wrap

2. coo-demo 命名空间中生成了一个名为 sample-monitoring-stack 的 Prometheus 资源。运行以下命令，检索生成的 Prometheus 资源的受管字段：

   $ oc -n coo-demo get Prometheus.monitoring.rhobs -oyaml --show-managed-fields

   Copy to Clipboard Toggle word wrap

   输出示例

   managedFields:
   - apiVersion: monitoring.rhobs/v1
     fieldsType: FieldsV1
     fieldsV1:
       f:metadata:
         f:labels:
           f:app.kubernetes.io/managed-by: {}
           f:app.kubernetes.io/name: {}
           f:app.kubernetes.io/part-of: {}
         f:ownerReferences:
           k:{"uid":"81da0d9a-61aa-4df3-affc-71015bcbde5a"}: {}
       f:spec:
         f:additionalScrapeConfigs: {}
         f:affinity:
           f:podAntiAffinity:
             f:requiredDuringSchedulingIgnoredDuringExecution: {}
         f:alerting:
           f:alertmanagers: {}
         f:arbitraryFSAccessThroughSMs: {}
         f:logLevel: {}
         f:podMetadata:
           f:labels:
             f:app.kubernetes.io/component: {}
             f:app.kubernetes.io/part-of: {}
         f:podMonitorSelector: {}
         f:replicas: {}
         f:resources:
           f:limits:
             f:cpu: {}
             f:memory: {}
           f:requests:
             f:cpu: {}
             f:memory: {}
         f:retention: {}
         f:ruleSelector: {}
         f:rules:
           f:alert: {}
         f:securityContext:
           f:fsGroup: {}
           f:runAsNonRoot: {}
           f:runAsUser: {}
         f:serviceAccountName: {}
         f:serviceMonitorSelector: {}
         f:thanos:
           f:baseImage: {}
           f:resources: {}
           f:version: {}
         f:tsdb: {}
     manager: observability-operator
     operation: Apply
   - apiVersion: monitoring.rhobs/v1
     fieldsType: FieldsV1
     fieldsV1:
       f:status:
         .: {}
         f:availableReplicas: {}
         f:conditions:
           .: {}
           k:{"type":"Available"}:
             .: {}
             f:lastTransitionTime: {}
             f:observedGeneration: {}
             f:status: {}
             f:type: {}
           k:{"type":"Reconciled"}:
             .: {}
             f:lastTransitionTime: {}
             f:observedGeneration: {}
             f:status: {}
             f:type: {}
         f:paused: {}
         f:replicas: {}
         f:shardStatuses:
           .: {}
           k:{"shardID":"0"}:
             .: {}
             f:availableReplicas: {}
             f:replicas: {}
             f:shardID: {}
             f:unavailableReplicas: {}
             f:updatedReplicas: {}
         f:unavailableReplicas: {}
         f:updatedReplicas: {}
     manager: PrometheusOperator
     operation: Update
     subresource: status

   Copy to Clipboard Toggle word wrap

3. 检查 metadata.managedFields 值，并观察 metadata 和 spec 中的一些字段是否由 MonitoringStack 资源管理。

4. 修改不是由 MonitoringStack 资源控制的字段：

   1. 更改 spec.enforcedSampleLimit，这是 MonitoringStack 资源未设置的字段。创建 prom-spec-edited.yaml 文件：

      prom-spec-edited.yaml

      apiVersion: monitoring.rhobs/v1
      kind: Prometheus
      metadata:
        name: sample-monitoring-stack
        namespace: coo-demo
      spec:
        enforcedSampleLimit: 1000

      Copy to Clipboard Toggle word wrap

   2. 运行以下命令来应用 YAML：

      $ oc apply -f ./prom-spec-edited.yaml --server-side

      Copy to Clipboard Toggle word wrap
      注意

      您必须使用 --server-side 标志。

   3. 获取更改的 Prometheus 对象，并注意，managedFields 中有多个部分，其 spec.enforcedSampleLimit:

      $ oc get prometheus -n coo-demo

      Copy to Clipboard Toggle word wrap

      输出示例

      managedFields: 

      1

      
      - apiVersion: monitoring.rhobs/v1
        fieldsType: FieldsV1
        fieldsV1:
          f:metadata:
            f:labels:
              f:app.kubernetes.io/managed-by: {}
              f:app.kubernetes.io/name: {}
              f:app.kubernetes.io/part-of: {}
          f:spec:
            f:enforcedSampleLimit: {} 

      2

      
        manager: kubectl
        operation: Apply

      Copy to Clipboard Toggle word wrap

      1

      managedFields

      2

      spec.enforcedSampleLimit

5. 修改由 MonitoringStack 资源管理的字段：

   1. 使用以下 YAML 配置更改 spec.LogLevel，它是由 MonitoringStack 资源管理的字段：

      # changing the logLevel from debug to info
      apiVersion: monitoring.rhobs/v1
      kind: Prometheus
      metadata:
        name: sample-monitoring-stack
        namespace: coo-demo
      spec:
        logLevel: info 

      1

      Copy to Clipboard Toggle word wrap

      1

      添加了 spec.logLevel

   2. 运行以下命令来应用 YAML：

      $ oc apply -f ./prom-spec-edited.yaml --server-side

      Copy to Clipboard Toggle word wrap

      输出示例

      error: Apply failed with 1 conflict: conflict with "observability-operator": .spec.logLevel
      Please review the fields above--they currently have other managers. Here
      are the ways you can resolve this warning:
      * If you intend to manage all of these fields, please re-run the apply
        command with the `--force-conflicts` flag.
      * If you do not intend to manage all of the fields, please edit your
        manifest to remove references to the fields that should keep their
        current managers.
      * You may co-own fields by updating your manifest to match the existing
        value; in this case, you'll become the manager if the other manager(s)
        stop managing the field (remove it from their configuration).
      See https://kubernetes.io/docs/reference/using-api/server-side-apply/#conflicts

      Copy to Clipboard Toggle word wrap

   3. 请注意，无法使用 Server-Side Apply 更改字段 spec.logLevel，因为它已经由 observability-operator 管理。

   4. 使用 --force-conflicts 标志来强制更改。

      $ oc apply -f ./prom-spec-edited.yaml --server-side --force-conflicts

      Copy to Clipboard Toggle word wrap

      输出示例

      prometheus.monitoring.rhobs/sample-monitoring-stack serverside-applied

      Copy to Clipboard Toggle word wrap

      with-force-conflicts 标志，字段可以被强制更改，但因为同一字段也由 MonitoringStack 资源管理，所以 Observability Operator 会检测到更改，并将其恢复到 MonitoringStack 资源设置的值。

      注意

      MonitoringStack 资源生成的一些 Prometheus 字段受到 MonitoringStack spec 小节中的字段的影响，如 logLevel。可以通过更改 MonitoringStack spec 来更改它们。

   5. 要更改 Prometheus 对象中的 logLevel，请应用以下 YAML 以更改 MonitoringStack 资源：

      apiVersion: monitoring.rhobs/v1alpha1
      kind: MonitoringStack
      metadata:
        name: sample-monitoring-stack
        labels:
          coo: example
      spec:
        logLevel: info

      Copy to Clipboard Toggle word wrap

   6. 要确认已进行了更改，请运行以下命令来查询日志级别：

      $ oc -n coo-demo get Prometheus.monitoring.rhobs -o=jsonpath='{.items[0].spec.logLevel}'

      Copy to Clipboard Toggle word wrap

      输出示例

      info

      Copy to Clipboard Toggle word wrap