kafka.common.MessageSizeTooLargeException: Found a message larger than the maximum fetch size of this consumer on topic

Anonymous — Mon, 26 Nov 2018 04:28:11 GMT

Hi,

Am using the tKafkaInput component and i get the error below:

Exception in component tKafkaInput_1
kafka.common.MessageSizeTooLargeException: Found a message larger than the maximum fetch size of this consumer on topic test_topic partition 0 at fetch offset 6010065. Increase the fetch size, or decrease the maximum message size the broker will allow.
at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:90)
at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
at Test_jobkafka_job_test_1_0.kafka_job_test.tKafkaInput_1Process(kafka_job_test.java:1985)
at Test_jobkafka_job_test_1_0.kafka_job_test.tSetGlobalVar_1Process(kafka_job_test.java:2942)
at Test_jobkafka_job_test_1_0.kafka_job_test$5.run(kafka_job_test.java:3222)

I have attached a screen shot with different option i have tried.

Please assist.

Re: kafka.common.MessageSizeTooLargeException: Found a message larger than the maximum fetch size of this consumer on topic

Anonymous — Fri, 30 Nov 2018 07:43:26 GMT

Hello,

Could you please stick to one topic:https://community.talend.com/t5/Design-and-Development/tkafkaInput-Advanced-settings/m-p/142543?

So that we could pay individule attention to it.

Best regards

Sabrina

topic Re: kafka.common.MessageSizeTooLargeException: Found a message larger than the maximum fetch size of this consumer on topic in Talend Studio

kafka.common.MessageSizeTooLargeException: Found a message larger than the maximum fetch size of this consumer on topic

Re: kafka.common.MessageSizeTooLargeException: Found a message larger than the maximum fetch size of this consumer on topic