Red Hat SummitChapter 2. Features
Streams for Apache Kafka 2.7 introduces the features described in this section.
Streams for Apache Kafka 2.7 on RHEL is based on Apache Kafka 3.7.0.
To view all the enhancements and bugs that are resolved in this release, see the Streams for Apache Kafka Jira project.
2.1. Kafka 3.7.0 support
Streams for Apache Kafka now supports and uses Apache Kafka version 3.7.0. Only Kafka distributions built by Red Hat are supported.
For upgrade instructions, see the instructions for Streams for Apache Kafka and Kafka upgrades in the following guides:
Refer to the Kafka 3.7.0 Release Notes for additional information.
Kafka 3.6.x is supported only for the purpose of upgrading to Streams for Apache Kafka 2.7. We recommend that you perform a rolling update to use the new binaries.
Kafka 3.7.0 provides access to KRaft mode, where Kafka runs without ZooKeeper by utilizing the Raft protocol.
2.2. KRaft: Support for migrating from ZooKeeper-based to KRaft-based Kafka clusters
KRaft mode in Streams for Apache Kafka is a technology preview, with some limitations, but this release introduces a number of new features that support KRaft. To support using KRaft, a new using guide is available: Using Streams for Apache Kafka on RHEL in KRaft mode.
If you are using ZooKeeper for metadata management in your Kafka cluster, you can now migrate to using Kafka in KRaft mode.
During the migration, you do the following:
- Install a quorum of controller nodes, which replaces ZooKeeper for management of your cluster.
-
Enable KRaft migration in the controller configuration by setting the
zookeeper.metadata.migration.enableflag totrue. -
Enable KRaft migration in the brokers by setting the
zookeeper.metadata.migration.enableflag totrue. -
Switch the brokers to using KRaft by adding a
brokerKRaft role and node ID. -
Switch the controllers out of migration mode by removing the
zookeeper.metadata.migration.enableproperty.
2.3. KRaft: Kafka upgrades for the KRaft-based clusters
KRaft to KRaft upgrades are now supported. You update the installation files, then configure and restart all Kafka nodes. You then upgrade the KRaft-based Kafka cluster to a newer supported KRaft metadata version.
Updating the KRaft metadata version
./bin/kafka-features.sh --bootstrap-server <broker_host>:<port> upgrade --metadata 3.72.4. RHEL 7 no longer supported
RHEL 7 is no longer supported. The decision was made due to known incompatibility issues.
'%20d='M201.5%20305.5c-13.8%200-24.9-11.1-24.9-24.6%200-13.8%2011.1-24.9%2024.9-24.9%2013.6%200%2024.6%2011.1%2024.6%2024.9%200%2013.6-11.1%2024.6-24.6%2024.6zM504%20256c0%20137-111%20248-248%20248S8%20393%208%20256%20119%208%20256%208s248%20111%20248%20248zm-132.3-41.2c-9.4%200-17.7%203.9-23.8%2010-22.4-15.5-52.6-25.5-86.1-26.6l17.4-78.3%2055.4%2012.5c0%2013.6%2011.1%2024.6%2024.6%2024.6%2013.8%200%2024.9-11.3%2024.9-24.9s-11.1-24.9-24.9-24.9c-9.7%200-18%205.8-22.1%2013.8l-61.2-13.6c-3-.8-6.1%201.4-6.9%204.4l-19.1%2086.4c-33.2%201.4-63.1%2011.3-85.5%2026.8-6.1-6.4-14.7-10.2-24.1-10.2-34.9%200-46.3%2046.9-14.4%2062.8-1.1%205-1.7%2010.2-1.7%2015.5%200%2052.6%2059.2%2095.2%20132%2095.2%2073.1%200%20132.3-42.6%20132.3-95.2%200-5.3-.6-10.8-1.9-15.8%2031.3-16%2019.8-62.5-14.9-62.5zM302.8%20331c-18.2%2018.2-76.1%2017.9-93.6%200-2.2-2.2-6.1-2.2-8.3%200-2.5%202.5-2.5%206.4%200%208.6%2022.8%2022.8%2087.3%2022.8%20110.2%200%202.5-2.2%202.5-6.1%200-8.6-2.2-2.2-6.1-2.2-8.3%200zm7.7-75c-13.6%200-24.6%2011.1-24.6%2024.9%200%2013.6%2011.1%2024.6%2024.6%2024.6%2013.8%200%2024.9-11.1%2024.9-24.6%200-13.8-11-24.9-24.9-24.9z'/%3e%3c/svg%3e){kind=small}