Chapter 4. OTLP data ingestion in Loki

When using the Loki Operator in openshift-logging mode, attribute mapping follow OpenShift default values, but you can configure custom mappings to adjust default values. In the openshift-logging mode, you can configure custom attribute mappings globally for all tenants or for individual tenants as needed. When you define custom mappings, they are appended to the OpenShift default values. If you do not need default labels, you can disable them in the tenant configuration.

Within LokiStack, attribute mapping configuration is managed through the limits setting. See the following example LokiStack configuration:

# ...
spec:
  limits:
    global:
      otlp: {} 

    tenants:
      application:
        otlp: {} 

Stream labels derive only from resource-level attributes, which the LokiStack resource structure reflects. See the following LokiStack example configuration:

spec:
  limits:
    global:
      otlp:
        streamLabels:
          resourceAttributes:
          - name: "k8s.namespace.name"
          - name: "k8s.pod.name"
          - name: "k8s.container.name"

You can drop attributes of type resource, scope, or log from the log entry.

# ...
spec:
  limits:
    global:
      otlp:
        streamLabels:
# ...
        drop:
          resourceAttributes:
          - name: "process.command_line"
          - name: "k8s\\.pod\\.labels\\..+"
            regex: true
          scopeAttributes:
          - name: "service.name"
          logAttributes:
          - name: "http.route"

You can use regular expressions by setting regex: true to apply a configuration for attributes with similar names.

Attributes that are not explicitly set as stream labels or dropped from the entry are saved as structured metadata by default.

In the openshift-logging mode, you must not remove certain required attributes because they are essential to OpenShift functions.

If you use the OpenShift Container Platform web console to query logs, enable the attributes called console labels. When you enable console labels, the following attributes are added to stream labels:

For information about enabling console attributes, see Configuring LokiStack for OTLP data ingestion.

You can add custom stream labels or drop information from the structured metadata when you use the openshift-logging mode. The custom configuration is merged with the OpenShift defaults.

For information about the attributes, see OpenTelemetry data model attributes.