apache kafka – Amount of partitions in relation to amount of brokers and amount of consumers
The number of partitions in a topic should ideally be equal to or greater than the maximum number of consumers that will be reading from it simultaneously. This ensures that each consumer can process data from a dedicated partition, maximizing parallelism and throughput. if you have more consomer than partition, they will not consume in parallel.
If you have more partitions than consumers, not all partitions will be actively consumed.
Having more partition allows you to anticipate future developments. But this results in the use of additional resources that are not fully used.
Edit : I agree with OneCricketeer
Having more partitions than consumers is fine
Read more here: Source link
