8장. 자동 스케일링을 위해 사용자 정의 애플리케이션 메트릭 노출

프로세스

1. 구성의 YAML 파일을 생성합니다. 이 예제에서는 파일을 deploy.yaml이라고 합니다.

2. prometheus-adapter에 대한 서비스 계정, 역할 및 역할 바인딩을 생성하기 위한 설정 세부 정보를 추가합니다.

   kind: ServiceAccount
   apiVersion: v1
   metadata:
     name: custom-metrics-apiserver
     namespace: custom-prometheus
   ---
   apiVersion: rbac.authorization.k8s.io/v1
   kind: ClusterRole
   metadata:
     name: custom-metrics-server-resources
   rules:
   - apiGroups:
     - custom.metrics.k8s.io
     resources: ["*"]
     verbs: ["*"]
   ---
   apiVersion: rbac.authorization.k8s.io/v1
   kind: ClusterRole
   metadata:
     name: custom-metrics-resource-reader
   rules:
   - apiGroups:
     - ""
     resources:
     - namespaces
     - pods
     - services
     verbs:
     - get
     - list
   ---
   apiVersion: rbac.authorization.k8s.io/v1
   kind: ClusterRoleBinding
   metadata:
     name: custom-metrics:system:auth-delegator
   roleRef:
     apiGroup: rbac.authorization.k8s.io
     kind: ClusterRole
     name: system:auth-delegator
   subjects:
   - kind: ServiceAccount
     name: custom-metrics-apiserver
     namespace: custom-prometheus
   ---
   apiVersion: rbac.authorization.k8s.io/v1
   kind: RoleBinding
   metadata:
     name: custom-metrics-auth-reader
     namespace: kube-system
   roleRef:
     apiGroup: rbac.authorization.k8s.io
     kind: Role
     name: extension-apiserver-authentication-reader
   subjects:
   - kind: ServiceAccount
     name: custom-metrics-apiserver
     namespace: custom-prometheus
   ---
   apiVersion: rbac.authorization.k8s.io/v1
   kind: ClusterRoleBinding
   metadata:
     name: custom-metrics-resource-reader
   roleRef:
     apiGroup: rbac.authorization.k8s.io
     kind: ClusterRole
     name: custom-metrics-resource-reader
   subjects:
   - kind: ServiceAccount
     name: custom-metrics-apiserver
     namespace: custom-prometheus
   ---
   apiVersion: rbac.authorization.k8s.io/v1
   kind: ClusterRoleBinding
   metadata:
     name: hpa-controller-custom-metrics
   roleRef:
     apiGroup: rbac.authorization.k8s.io
     kind: ClusterRole
     name: custom-metrics-server-resources
   subjects:
   - kind: ServiceAccount
     name: horizontal-pod-autoscaler
     namespace: kube-system
   ---

3. prometheus-adapter의 사용자 정의 메트릭에 대한 설정 세부 정보를 추가합니다.

   apiVersion: v1
   kind: ConfigMap
   metadata:
     name: adapter-config
     namespace: custom-prometheus
   data:
     config.yaml: |
       rules:
       - seriesQuery: 'http_requests_total{namespace!="",pod!=""}' 1
         resources:
           overrides:
             namespace: {resource: "namespace"}
             pod: {resource: "pod"}
             service: {resource: "service"}
         name:
           matches: "^(.*)_total"
           as: "${1}_per_second" 2
         metricsQuery: 'sum(rate(<<.Series>>{<<.LabelMatchers>>}[2m])) by (<<.GroupBy>>)'
   ---

   1

   선택한 메트릭을 HTTP 요청 수로 지정합니다.

   2

   메트릭의 빈도를 지정합니다.

4. prometheus-adapter를 API 서비스로 등록하기 위한 설정 세부 정보를 추가합니다.

   apiVersion: v1
   kind: Service
   metadata:
     annotations:
       service.beta.openshift.io/serving-cert-secret-name: prometheus-adapter-tls
     labels:
       name: prometheus-adapter
     name: prometheus-adapter
     namespace: custom-prometheus
   spec:
     ports:
     - name: https
       port: 443
       targetPort: 6443
     selector:
       app: prometheus-adapter
     type: ClusterIP
   ---
   apiVersion: apiregistration.k8s.io/v1beta1
   kind: APIService
   metadata:
     name: v1beta1.custom.metrics.k8s.io
   spec:
     service:
       name: prometheus-adapter
       namespace: custom-prometheus
     group: custom.metrics.k8s.io
     version: v1beta1
     insecureSkipTLSVerify: true
     groupPriorityMinimum: 100
     versionPriority: 100
   ---

5. Prometheus Adapter 이미지를 나열합니다.

   $ oc get -n openshift-monitoring deploy/prometheus-adapter -o jsonpath="{..image}"

6. prometheus-adapter 배포에 대한 설정 세부 정보를 추가합니다.

   apiVersion: apps/v1
   kind: Deployment
   metadata:
     labels:
       app: prometheus-adapter
     name: prometheus-adapter
     namespace: custom-prometheus
   spec:
     replicas: 1
     selector:
       matchLabels:
         app: prometheus-adapter
     template:
       metadata:
         labels:
           app: prometheus-adapter
         name: prometheus-adapter
       spec:
         serviceAccountName: custom-metrics-apiserver
         containers:
         - name: prometheus-adapter
           image: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a46915a206cd7d97f240687c618dd59e8848fcc3a0f51e281f3384153a12c3e0 1
           args:
           - --secure-port=6443
           - --tls-cert-file=/var/run/serving-cert/tls.crt
           - --tls-private-key-file=/var/run/serving-cert/tls.key
           - --logtostderr=true
           - --prometheus-url=http://prometheus-operated.default.svc:9090/
           - --metrics-relist-interval=1m
           - --v=4
           - --config=/etc/adapter/config.yaml
           ports:
           - containerPort: 6443
           volumeMounts:
           - mountPath: /var/run/serving-cert
             name: volume-serving-cert
             readOnly: true
           - mountPath: /etc/adapter/
             name: config
             readOnly: true
           - mountPath: /tmp
             name: tmp-vol
         volumes:
         - name: volume-serving-cert
           secret:
             secretName: prometheus-adapter-tls
         - name: config
           configMap:
             name: adapter-config
         - name: tmp-vol
           emptyDir: {}

   1

   이전 단계에서 발견된 Prometheus Adapter 이미지를 지정합니다.

7. 클러스터에 구성을 적용합니다.

   $ oc apply -f deploy.yaml

   출력 예

   serviceaccount/custom-metrics-apiserver created
   clusterrole.rbac.authorization.k8s.io/custom-metrics-server-resources created
   clusterrole.rbac.authorization.k8s.io/custom-metrics-resource-reader created
   clusterrolebinding.rbac.authorization.k8s.io/custom-metrics:system:auth-delegator created
   rolebinding.rbac.authorization.k8s.io/custom-metrics-auth-reader created
   clusterrolebinding.rbac.authorization.k8s.io/custom-metrics-resource-reader created
   clusterrolebinding.rbac.authorization.k8s.io/hpa-controller-custom-metrics created
   configmap/adapter-config created
   service/prometheus-adapter created
   apiservice.apiregistration.k8s.io/v1.custom.metrics.k8s.io created
   deployment.apps/prometheus-adapter created

8. 사용자 정의 프로젝트의 prometheus-adapter Pod가 실행 중 상태인지 확인합니다. 이 예에서 프로젝트는 custom-prometheus입니다.

   $ oc -n custom-prometheus get pods prometheus-adapter-<string>

9. 이제 애플리케이션의 메트릭이 노출되어 수평 Pod 자동 스케일링을 구성하는 데 사용할 수 있습니다.