Red Hat SummitChapter 8. Kafka Connect page
This feature is a technology preview and not intended for a production environment. For more information see the release notes.
The Kafka Connect page lists Kafka Connect connectors and clusters associated with a Kafka cluster.
You can filter each list by name.
- Connectors list
- Shows the state of each connector and the number of tasks it’s running, as well as the associated Kafka Connect cluster
- Clusters list
- Shows the Kafka Connect version, with the number of workers (or replicas) in the cluster.
If a connector is shown as Managed, it means that is managed using Streams for Apache Kafka.
Use the information provided on the tabs to check the configuration of your Kafka Connect environment. Click on a name to view additional information on specific connectors and clusters.
8.1. Checking Kafka Connect connectors
Track the status of a specific Kafka Connect connector from the Connectors tab. The Connectors tab lists the connectors associated with a Kafka Connect cluster.
Procedure
- Log in to the Kafka cluster in the Streams for Apache Kafka Console, then click Kafka Connect.
- On the Kafka Connect page, click the name of the connector you want to inspect.
Review the connector details:
- Connect worker ID
- Identifies the Kafka Connect worker that runs the connector.
- State
- Shows the current status of the connector, such as Running, Paused, or Failed.
- Topics
- Lists the Kafka topics used by the connector to produce or consume data.
- Class
- Displays the Java class that implements the connector logic.
- Type
- Indicates whether the connector is a source or sink connector.
- Max tasks
- Specifies the maximum number of concurrent tasks that the connector can run.
Click the Connectors and Configuration tabs to view the following information:
Connectors tab:
- Task ID
- Identifies a specific task instance of the connector.
- State
- Shows the current status of the task, such as Running, Paused, or Failed.
- Worker ID
- Identifies the Kafka Connect worker that runs the task.
Configuration tab: Displays the property values that define how the connector is configured.
8.2. Checking Kafka Connect clusters
Track the status of a specific Kafka Connect cluster from the Connect clusters tab. The Connect clusters tab lists the Kafka Connect clusters associated with the Kafka cluster.
Procedure
- Log in to the Kafka cluster in the Streams for Apache Kafka Console, then click Kafka Connect.
On the Kafka Connect page, click the Connect clusters tab, then click the name of the cluster you want to inspect.
The page displays the number of workers used to run connectors and their tasks. This information is available only for Kafka Connect clusters managed by Streams for Apache Kafka.
Click the Connectors and Plugins tabs to view the following information:
Connectors tab:
- Name
- Displays the name of the connector deployed in the cluster.
- Type
- Indicates whether the connector is a source or sink connector.
- State
- Shows the current status of the connector, such as Running, Paused, or Failed.
- Replicas
- Displays the number of task replicas currently running for the connector.
Plugins tab:
- Class
- Displays the fully qualified Java class name of the connector implementation.
- Type
- Indicates the connector type.
- Version
- Shows the plugin version provided by the Kafka Connect runtime.
Plugins provide the implementation classes used to create connectors. The plugins list includes plugins for standard source and sink connectors, as well as the connectors used by Kafka MirrorMaker.
'%20d='M201.5%20305.5c-13.8%200-24.9-11.1-24.9-24.6%200-13.8%2011.1-24.9%2024.9-24.9%2013.6%200%2024.6%2011.1%2024.6%2024.9%200%2013.6-11.1%2024.6-24.6%2024.6zM504%20256c0%20137-111%20248-248%20248S8%20393%208%20256%20119%208%20256%208s248%20111%20248%20248zm-132.3-41.2c-9.4%200-17.7%203.9-23.8%2010-22.4-15.5-52.6-25.5-86.1-26.6l17.4-78.3%2055.4%2012.5c0%2013.6%2011.1%2024.6%2024.6%2024.6%2013.8%200%2024.9-11.3%2024.9-24.9s-11.1-24.9-24.9-24.9c-9.7%200-18%205.8-22.1%2013.8l-61.2-13.6c-3-.8-6.1%201.4-6.9%204.4l-19.1%2086.4c-33.2%201.4-63.1%2011.3-85.5%2026.8-6.1-6.4-14.7-10.2-24.1-10.2-34.9%200-46.3%2046.9-14.4%2062.8-1.1%205-1.7%2010.2-1.7%2015.5%200%2052.6%2059.2%2095.2%20132%2095.2%2073.1%200%20132.3-42.6%20132.3-95.2%200-5.3-.6-10.8-1.9-15.8%2031.3-16%2019.8-62.5-14.9-62.5zM302.8%20331c-18.2%2018.2-76.1%2017.9-93.6%200-2.2-2.2-6.1-2.2-8.3%200-2.5%202.5-2.5%206.4%200%208.6%2022.8%2022.8%2087.3%2022.8%20110.2%200%202.5-2.2%202.5-6.1%200-8.6-2.2-2.2-6.1-2.2-8.3%200zm7.7-75c-13.6%200-24.6%2011.1-24.6%2024.9%200%2013.6%2011.1%2024.6%2024.6%2024.6%2013.8%200%2024.9-11.1%2024.9-24.6%200-13.8-11-24.9-24.9-24.9z'/%3e%3c/svg%3e){kind=small}