tkafkaInput Advanced settings

[Anonymous]

Hi, 

How do i increase the max fetch size in tkafkaInput in advance setting. The error i get is;

"

kafka.common.MessageSizeTooLargeException: Found a message larger than the maximum fetch size of this consumer on topic test_topic partition 1 at fetch offset 9049820. Increase the fetch size, or decrease the maximum message size the broker will allow. Please see the image attached and advice what i could be doing wrong

"

[Anonymous]

Hi Jibe,

Which version of Kafka are you running?

[Anonymous]

version 6.1.1

[Anonymous]

Are you sure? Which branch/edition of Kafka are you using?

Apache Kafka is up to v2.0.1

[Anonymous]

Kafka 0.8.2.0

[Anonymous · Accepted solution]

Can you clear your additional Kafka properties as in your attached config and  try using the "fetch.message.max.bytes" parameter only? Set it to 524288000 as you were doing with the others.

[Anonymous]

if the i want to take a certain partion on the kafka ques can i use tkafkaInput?