Monitoring Overview

Monitoring Overview

The Monitoring Overview page is your infrastructure command post and concisely summarizes all activity in your Apache Kafka cluster.

Cluster Overview

  • AI Health Assistant Cluster Status: Get insights on the health status of your cluster, as monitored by our AI assistant.
  • In-Sync Replicas: Shows the percentage of replicas that are in-sync.
  • Brokers: View the number of active brokers in the cluster.

Topics Overview

  • Total Topics: See the overall count of topics in the cluster.
  • Total Messages: Displays the number of messages across all topics.
  • Total Partitions: Reflects the total partitions in the cluster.

Consumer Groups

  • Total Active: Number of active consumer groups.
  • Total Empty/Dead: Consumer groups that are either empty or no longer functioning.
  • Delta of Consumer Lag: Displays the accumulative change in consumer lag over the last hour.

Detailed Metrics Diagrams

Under this section, you can view various diagrams that represent a more detailed breakdown of metrics. The time frame for data in these diagrams can be toggled between "Last Hour", "Last Day", and "Last Week".

Metrics include:

  • Write (msg/s): Number of messages produced per second.
  • Read (msg/s): Number of messages consumed per second.
  • Storage: Total disk space used and the percentage ratio of in-sync replicas to total replicas.
  • Messages: Total count of messages and an accumulative lag across all consumers.

Group State

A dynamic table detailing the state of all consumer groups. Each "state" is represented by a colorized square, with the time granularity dependent on the selected time frame:

  • Last Hour: Each square represents a minute.
  • Last Day: Each square denotes an hour.
  • Last Week: Seven squares, one for each day.

Color Code:

  • Yellow: Group is empty.
  • Red: Group is dead.
  • Blue: Group is rebalancing.
  • Green: Group is stable.
  • Grey: No data available.

Environment

  • Total Schemas: Count of schemas present in the schema registry.
  • Active Connectors: Number of active connectors across all Kafka Connect workers.
  • Inactive Connectors: Count of connectors that are currently inactive.