Solved: Adding New Kafka Brokers: Question – Cloudera Community
Yes, you can use the CC APIs as per your requirements [1] [2]
[1] docs.cloudera.com/cdp-private-cloud-base/7.1.7/cctrl-managing/topics/cctrl-using-rest-api.ht…
[2] community.cloudera.com/t5/Customer/Frequently-Used-CRUISE-CONTROL-API-and-important-DOCs/ta-…
From the above articles you can use the following API to rebalance topics/partitions:
curl -k –negotiate -u: -X POST “https://<CC FQDN>:8899/kafkacruisecontrol/rebalance?dryrun=false&rebalance_disk=true”
To avoid high CPU, memory and disk read write you can initiate rebalance process in batches. It will automatically create a batch and rebalance topics.
curl -X POST “http://$HOSTNAME:8899/kafkacruisecontrol/rebalance?dryrun=true&concurrent_partition_movements_per_broker=10&concurrent_leader_movements=500”
If it will help you then please click on ”Accept as Solution” below this post.
Thank you.
Read more here: Source link