Apache Kafka: Half of partitions not publishing messages with round robin partitioner in version 3.4.0
kafka client Round robin Partitioner uneven distribution
Kafka client version 3.4.0.
For my project it required even message distribution.
Trying to use round robin partitioner but look like the partition() function was called twice at doSent() function so that the distribution of message is uneven and half of partitions were not published any message. Here is the distribution result<partition, num of message>. This topic has total 48 partitions but only 24 partitions was published messages. Pls suggest thanks.
{
“0”: 10,
“2”: 10,
“4”: 10,
“6”: 10,
“8”: 10,
“10”: 10,
“12”: 10,
“14”: 10,
“16”: 9,
“17”: 9,
“20”: 9,
“21”: 9,
“24”: 9,
“25”: 9,
“28”: 9,
“29”: 9,
“32”: 9,
“34”: 9,
“36”: 9,
“38”: 9,
“40”: 9,
“42”: 9,
“44”: 9,
“46”: 9
}
Read more here: Source link
