Flow View

The Flow View in Kadeck displays the current Consumer and and Producer as well as their offset or lag depending on the data displayed in the Data Browser.

This makes it possible to filter data by specific characteristics and times and to see which of records are consumed by which consumers or generated by which producers.

To have a general overview of the consumer metrics, the Consumer View should be used instead.

Flow View

The Flow View is divided into three sections:

Producers

The Producers area displays the producers that have produced the records currently displayed in the Data Browser. The producer list is generated dynamically from the data records via a header field.

In order to identify the individual producers by name, you need to add a header field "producerid" to the Kafka Record that contains the producer's name as a UTF8 string. Otherwise, the producer will be shown as "Unknown".

Partitions

The partition view shows all partitions of the topic, in which partitions data sets of the respective producer can actually be found (i.e. based on the data currently displayed in the Data Browser) and which consumer members consume from the respective partitions. Additionally, the lag and current offset of the partition are displayed based on the displayed data sets. 

Note: This is not the general offset of the respective partition in the topic, but the largest offset based on the displayed data.

Consumer groups

This area shows all consumer groups and individual consumer members.  Clicking on the name of the consumer group takes you to the detailed view of the consumer group in the consumer view.

Hover the mouse cursor over the individual members to check the current lag of the consumer compared to the highest offset of the displayed data. 

FAQ: How can I name producers? They are all shown as "Unknown".

In order to identify individual producers by name, you will need to add a "producerid" header field to the Kafka record that contains the name of the producer as a UTF8 string. Otherwise, the producer will show up as "Unknown".

Header Field

Key	producerid
Value	UTF-8 String, e.g. "my-producer-id"

• Related Articles

• Release 4.2.9

  This article describes the changes of the version 4.2.x update. Note: We have released a 4.2.9 hotfix that solves a performance problem in connection with the schema registry, which led to an extremely long connection process or missing schemas for ...

• Getting Started

  The Kadeck Team says: Thank you! Kadeck is the result of experienced developers, operations, architects and project managers from the IT field, who were looking for an easier and better way to implement, communicate and operate data streaming ...

• Release 4.3

  This article describes the changes of the version 4.3.x update. New image tag: xeotek/kadeck:4.3.7 Kadeck Teams is no longer run as root as of version 4.3.5. Instead, a separate user kadeck is used. Depending on the container service, this requires ...

• ACL Rights Management

  The rights to manage or view ACLs can be configured flexibly: from basic rights that cover all ACLs to resource-specific rights with specifications on the naming scheme. The latter allows teams to independently manage resources within their working ...

• Release 5.X

  This article describes the changes of the version 5.x update. Latest image tag: xeotek/kadeck:5.1.13 Activating the new monitoring section can lead to slightly higher memory and thread consumption. A new right is required to access the monitoring ...