Chapter 13. Setting throughput and storage limits on brokers

Procedure

1. Edit the Kafka configuration properties file.

   Example plugin configuration

   # ...
   client.quota.callback.class=io.strimzi.kafka.quotas.StaticQuotaCallback 

   1

   
   client.quota.callback.static.produce=1000000 

   2

   
   client.quota.callback.static.fetch=1000000 

   3

   
   client.quota.callback.static.storage.per.volume.limit.min.available.bytes=500000000000 

   4

   
   client.quota.callback.static.storage.check-interval=5 

   5

   
   client.quota.callback.static.kafka.admin.bootstrap.servers=localhost:9092 

   6

   
   client.quota.callback.static.excluded.principal.name.list=User:my-user-1;User:my-user-2 

   7

   
   # ...

   1

   Loads the plugin.

   2

   Sets the producer byte-rate threshold of 1 MBps.

   3

   Sets the consumer byte-rate threshold. 1 MBps.

   4

   Sets an available bytes limit of 500 GB.

   5

   Sets the interval in seconds between checks on storage to 5 seconds. The default is 60 seconds. Set this property to 0 to disable the check.

   6

   Kafka cluster bootstrap servers address. This property is required if storage.check-interval is >0. All configuration properties starting with client.quota.callback.static.kafka.admin. prefix are passed to the Kafka Admin client configuration.

   7

   Excludes my-user-1 and my-user-2 from the restrictions. Each principal must be be prefixed with User:.

   storage.per.volume.limit.min.available.bytes and storage.per.volume.limit.min.available.ratio are mutually exclusive. Only configure one of these parameters.

   Note

   The full list of supported configuration properties can be found in the plugin documentation.

2. Start the Kafka broker with the default configuration file.

   ./bin/kafka-server-start.sh -daemon ./config/kraft/server.properties

3. Verify that the Kafka broker is running.

   jcmd | grep Kafka