topic Re: tkafkaInput Advanced settings in Talend Studio

tkafkaInput Advanced settings

Anonymous — Mon, 26 Nov 2018 06:06:16 GMT

Hi,

How do i increase the max fetch size in tkafkaInput in advance setting. The error i get is;

kafka.common.MessageSizeTooLargeException: Found a message larger than the maximum fetch size of this consumer on topic test_topic partition 1 at fetch offset 9049820. Increase the fetch size, or decrease the maximum message size the broker will allow. Please see the image attached and advice what i could be doing wrong

Re: tkafkaInput Advanced settings

Anonymous — Wed, 28 Nov 2018 10:13:08 GMT

Hi Jibe,

Which version of Kafka are you running?

Re: tkafkaInput Advanced settings

Anonymous — Wed, 28 Nov 2018 10:16:17 GMT

version 6.1.1

Re: tkafkaInput Advanced settings

Anonymous — Wed, 28 Nov 2018 10:18:58 GMT

Are you sure? Which branch/edition of Kafka are you using?

Apache Kafka is up to v2.0.1

Re: tkafkaInput Advanced settings

Anonymous — Wed, 28 Nov 2018 10:22:13 GMT

Kafka 0.8.2.0

Re: tkafkaInput Advanced settings

Anonymous — Wed, 28 Nov 2018 10:30:38 GMT

Can you clear your additional Kafka properties as in your attached config and try using the "fetch.message.max.bytes" parameter only? Set it to 524288000 as you were doing with the others.

Re: tkafkaInput Advanced settings

Anonymous — Wed, 12 Dec 2018 08:17:06 GMT

if the i want to take a certain partion on the kafka ques can i use tkafkaInput?