Hi @bw_chrc ,

max.request.size
The maximum value of the message that the producer client can send, the default value is 1048576B, 1MB. it is not recommended to blindly modify this parameter, this parameter involves the linkage of some other parameters, such as the message.max.bytes parameter on the broker side, if the broker’s message.max.bytes parameter is set to 10, and the max. request.size is set to 20, the producer parameter will report an error when sending a message with a size of 15B.

Therefore, you need to modify the above multiple parameters consecutively to take effect

Modify the following:

message.max.bytes 2M (modified on the broker side)

max.request.size 2M (modified on the client side)
After restarting again, the data is extracted to kafka normally.

For more details, please refer:

Send Large Messages With Kafka | Baeldung

How to send Large Messages in Apache Kafka? (conduktor.io)

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly. 

Hi @bw_chrc ,

max.request.size
The maximum value of the message that the producer client can send, the default value is 1048576B, 1MB. it is not recommended to blindly modify this parameter, this parameter involves the linkage of some other parameters, such as the message.max.bytes parameter on the broker side, if the broker’s message.max.bytes parameter is set to 10, and the max. request.size is set to 20, the producer parameter will report an error when sending a message with a size of 15B.

Therefore, you need to modify the above multiple parameters consecutively to take effect

Modify the following:

message.max.bytes 2M (modified on the broker side)

max.request.size 2M (modified on the client side)
After restarting again, the data is extracted to kafka normally.

For more details, please refer:

Send Large Messages With Kafka | Baeldung

How to send Large Messages in Apache Kafka? (conduktor.io)

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly.