Kafka consumer list
System Design practice on Codemia
Work through 120+ system design problems with detailed solutions, from rate limiters to multi-region storage.
Introduction
When people ask for a “Kafka consumer list,” they usually mean one of two things: a list of consumer groups in the cluster, or details about the members of a specific consumer group. Kafka’s tooling is centered around consumer groups, not around a global flat list of every consumer process.
That distinction matters because Kafka consumers coordinate through group membership. If you want operational visibility, the standard workflow is to list groups first and then describe the one you care about.
List Consumer Groups
The usual command-line entry point is:
This prints the consumer group IDs known to the cluster.
It does not automatically show each member, partition assignment, or lag details. It just gives you the group names.
Describe One Consumer Group
To inspect the consumers participating in a specific group and their partition assignments, describe the group.
This typically shows information such as:
- topic
- partition
- current offset
- log end offset
- lag
- consumer ID
- host
- client ID
That is usually what operators actually need when they say “list consumers.”
Programmatic Listing With AdminClient
If you want the same information in Java code, use Kafka’s AdminClient.
This gives you the group list. You can then drill into a specific group with more admin APIs if needed.
What You Can and Cannot List Globally
Kafka is not really designed around a single global “all consumer instances everywhere” list as the primary operational concept. The group is the coordination unit.
So the standard questions are:
- what consumer groups exist?
- what members are in this group?
- what partitions are assigned?
- what lag exists?
That framing matches the tools Kafka provides.
This is also why two monitoring tools may present the same cluster differently. One may emphasize group-level summaries, while another may emphasize member-level details only after you drill into a particular group.
Operational Tools Beyond the CLI
If you prefer a UI, monitoring platforms and Kafka dashboards can expose the same information more readably.
Typical options include:
- managed platform dashboards
- AKHQ
- cluster monitoring tools
- metrics systems that expose lag and group state
These are helpful for ongoing operations, but the CLI remains the quickest source of truth on a machine with Kafka tooling installed.
Common Pitfalls
A common mistake is expecting --list to show every consumer instance with all details. It usually only shows group IDs.
Another mistake is confusing consumer groups with individual applications. One app can run many consumers, and one group can span multiple hosts.
Developers also forget that an inactive or idle group may appear differently than an actively consuming group depending on cluster state and offsets.
Finally, if the CLI returns nothing useful, verify that you are connecting to the correct cluster and bootstrap server before assuming no consumers exist.
Summary
- In Kafka, the main operational unit is the consumer group, not a global flat list of consumers.
- Use
kafka-consumer-groups.sh --listto list group IDs. - Use
--describeon a specific group to see members, assignments, and lag. - '
AdminClientprovides the same capabilities programmatically.' - For most troubleshooting, group-level visibility is what actually matters.
Related reading
- Kafka-consumer. commitSync vs commitAsync
- Kafka-docker container scaling failed for wurstmeister with error as advertised listeners are already registered by broker 1001
- Kafka-ES-Sink ConnectException Key is used as document id and can not be null
- kafka-log4j-appender 0.9 does not work
- kafka-node LeaderNotAvailable errors on send
- kafka-node ready event is not getting triggered
- kafka-node several consumers
- kafka-node start consume from last offset

System Design Fundamentals
Build a strong foundation in designing scalable, reliable distributed systems.
View the courseTrack what you have practised
A free account saves your progress, solutions and study plan across every problem on Codemia.
System Design practice on Codemia
Work through 120+ system design problems with detailed solutions, from rate limiters to multi-region storage.