The Monitoring Overview page is your infrastructure command post and concisely summarizes all activity in your Apache Kafka cluster.
Cluster Overview
- AI Health Assistant Cluster Status: Get insights on the health status of your cluster, as monitored by our AI assistant.
- In-Sync Replicas: Shows the percentage of replicas that are in-sync.
- Brokers: View the number of active brokers in the cluster.
Topics Overview
- Total Topics: See the overall count of topics in the cluster.
- Total Messages: Displays the number of messages across all topics.
- Total Partitions: Reflects the total partitions in the cluster.
Consumer Groups
- Total Active: Number of active consumer groups.
- Total Empty/Dead: Consumer groups that are either empty or no longer functioning.
- Delta of Consumer Lag: Displays the accumulative change in consumer lag over the last hour.
Detailed Metrics Diagrams
Under this section, you can view various diagrams that represent a more detailed breakdown of metrics. The time frame for data in these diagrams can be toggled between "Last Hour", "Last Day", and "Last Week".
Metrics include:
- Write (msg/s): Number of messages produced per second.
- Read (msg/s): Number of messages consumed per second.
- Storage: Total disk space used and the percentage ratio of in-sync replicas to total replicas.
- Messages: Total count of messages and an accumulative lag across all consumers.
Group State
A dynamic table detailing the state of all consumer groups. Each "state" is represented by a colorized square, with the time granularity dependent on the selected time frame:
- Last Hour: Each square represents a minute.
- Last Day: Each square denotes an hour.
- Last Week: Seven squares, one for each day.
Color Code:
- Yellow: Group is empty.
- Red: Group is dead.
- Blue: Group is rebalancing.
- Green: Group is stable.
- Grey: No data available.
Environment
- Total Schemas: Count of schemas present in the schema registry.
- Active Connectors: Number of active connectors across all Kafka Connect workers.
- Inactive Connectors: Count of connectors that are currently inactive.