Chapter 6. Configuring Knative broker for Apache Kafka

Procedure

1. Navigate to Operators Installed Operators.
2. Check that the Project dropdown at the top of the page is set to Project: knative-eventing.
3. In the list of Provided APIs for the OpenShift Serverless Operator, find the Knative Kafka box and click Create Instance.

4. Configure the KnativeKafka object in the Create Knative Kafka page.

   Important

   To use the Kafka channel, source, broker, or sink on your cluster, you must toggle the enabled switch for the options you want to use to true. These switches are set to false by default. Additionally, to use the Kafka channel, broker, or sink you must specify the bootstrap servers.

   • Use the form for simpler configurations that do not require full control of KnativeKafka object creation.

   • Edit the YAML for more complex configurations that require full control of KnativeKafka object creation. You can access the YAML by clicking the Edit YAML link on the Create Knative Kafka page.

     You get an output similar to the following example:

     apiVersion: operator.serverless.openshift.io/v1alpha1
     kind: KnativeKafka
     metadata:
         name: knative-kafka
         namespace: knative-eventing
     spec:
         channel:
             enabled: true
             bootstrapServers: <bootstrap_servers>
         source:
             enabled: true
         broker:
             enabled: true
             defaultConfig:
                 bootstrapServers: <bootstrap_servers>
                 numPartitions: <num_partitions>
                 replicationFactor: <replication_factor>
         sink:
             enabled: true
         logging:
             level: INFO

     spec.channel.enabled

     Enables developers to use the KafkaChannel channel type in the cluster.

     spec.channel.bootstrapServers

     A comma-separated list of bootstrap servers from your AMQ Streams cluster.

     spec.source.enabled

     Enables developers to use the KafkaSource event source type in the cluster.

     spec.broker.enabled

     Enables developers to use the Knative broker implementation for Apache Kafka in the cluster.

     spec.broker.defaultConfig.bootstrapServers

     A comma-separated list of bootstrap servers from your Red Hat AMQ Streams cluster.

     spec.broker.defaultConfig.numPartitions

     Defines the number of partitions of the Kafka topics, backed by the Broker objects. The default is 10.

     spec.broker.defaultConfig.replicationFactor

     Defines the replication factor of the Kafka topics, backed by the Broker objects. The default is 3. The replicationFactor value must be less than or equal to the number of nodes of your Red Hat AMQ Streams cluster.

     sink.enabled

     Enables developers to use a Kafka sink in the cluster.

     logging.level

     Defines the log level of the Kafka data plane. Allowed values are TRACE, DEBUG, INFO, WARN and ERROR. The default value is INFO.

     Warning

     Do not use DEBUG or TRACE as the logging level in production environments. The outputs from these logging levels are verbose and can degrade performance.

5. Click Create after you have completed any of the optional configurations for Kafka. You are automatically directed to the Knative Kafka tab where knative-kafka is in the list of resources.

Verification

1. Click the knative-kafka resource in the Knative Kafka tab. You are automatically directed to the Knative Kafka Overview page.

2. View the list of Conditions for the resource and confirm that they have a status of True.

   

   If the conditions have a status of Unknown or False, wait a few moments to refresh the page.

3. Check that the Knative broker for Apache Kafka resources have been created:

   $ oc get pods -n knative-eventing

   You get an output similar to the following example:

   NAME                                        READY   STATUS    RESTARTS   AGE
   kafka-broker-dispatcher-7769fbbcbb-xgffn    2/2     Running   0          44s
   kafka-broker-receiver-5fb56f7656-fhq8d      2/2     Running   0          44s
   kafka-channel-dispatcher-84fd6cb7f9-k2tjv   2/2     Running   0          44s
   kafka-channel-receiver-9b7f795d5-c76xr      2/2     Running   0          44s
   kafka-controller-6f95659bf6-trd6r           2/2     Running   0          44s
   kafka-source-dispatcher-6bf98bdfff-8bcsn    2/2     Running   0          44s
   kafka-webhook-eventing-68dc95d54b-825xs     2/2     Running   0          44s