Monitoring Overview

Monitoring Overview

The Monitoring Overview page is your infrastructure command post and concisely summarizes all activity in your Apache Kafka cluster.

Cluster Overview

  • AI Health Assistant Cluster Status: Get insights on the health status of your cluster, as monitored by our AI assistant.
  • In-Sync Replicas: Shows the percentage of replicas that are in-sync.
  • Brokers: View the number of active brokers in the cluster.

Topics Overview

  • Total Topics: See the overall count of topics in the cluster.
  • Total Messages: Displays the number of messages across all topics.
  • Total Partitions: Reflects the total partitions in the cluster.

Consumer Groups

  • Total Active: Number of active consumer groups.
  • Total Empty/Dead: Consumer groups that are either empty or no longer functioning.
  • Delta of Consumer Lag: Displays the accumulative change in consumer lag over the last hour.

Detailed Metrics Diagrams

Under this section, you can view various diagrams that represent a more detailed breakdown of metrics. The time frame for data in these diagrams can be toggled between "Last Hour", "Last Day", and "Last Week".

Metrics include:

  • Write (msg/s): Number of messages produced per second.
  • Read (msg/s): Number of messages consumed per second.
  • Storage: Total disk space used and the percentage ratio of in-sync replicas to total replicas.
  • Messages: Total count of messages and an accumulative lag across all consumers.

Group State

A dynamic table detailing the state of all consumer groups. Each "state" is represented by a colorized square, with the time granularity dependent on the selected time frame:

  • Last Hour: Each square represents a minute.
  • Last Day: Each square denotes an hour.
  • Last Week: Seven squares, one for each day.

Color Code:

  • Yellow: Group is empty.
  • Red: Group is dead.
  • Blue: Group is rebalancing.
  • Green: Group is stable.
  • Grey: No data available.

Environment

  • Total Schemas: Count of schemas present in the schema registry.
  • Active Connectors: Number of active connectors across all Kafka Connect workers.
  • Inactive Connectors: Count of connectors that are currently inactive.



    • Related Articles

    • Introduction to Monitoring & Health

      We are excited to introduce Kadeck's new Monitoring Module, which makes monitoring and troubleshooting Apache Kafka infrastructure easier than ever and raises the bar in the industry. The new monitoring module includes four new pages, Monitoring ...
    • Topic Monitoring Overview

      This guide provides a detailed overview of the Topic Monitoring view within Kadeck's Apache Kafka UI, allowing users to monitor and analyze various metrics associated with Kafka topics. Overview Topic select: Dropdown to select specific topics or ...
    • Broker Monitoring Overview

      The Cluster Monitoring Page provides comprehensive insights into the status and performance of your Apache Kafka cluster. This guide will help you understand the metrics and visualizations on this page. Time windows: The metrics are all relative to ...
    • Getting Started

      The Kadeck Team says: Thank you! Kadeck is the result of experienced developers, operations, architects and project managers from the IT field, who were looking for an easier and better way to implement, communicate and operate data streaming ...
    • Topic Overview & Documentation

      Kadeck’s Topic Overview, provides a consolidated glance at all topic details and documentation. This article will guide you through what information you can find in this view and how to document your topic. Overview Page When you open the Data ...