Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

kafka.common.MessageSizeTooLargeException: Found a message larger than the maximum fetch size of this consumer on topic

Hi,

 

Am using the tKafkaInput component and i get the error below:

 

 

Exception in component tKafkaInput_1
kafka.common.MessageSizeTooLargeException: Found a message larger than the maximum fetch size of this consumer on topic test_topic partition 0 at fetch offset 6010065. Increase the fetch size, or decrease the maximum message size the broker will allow.
at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:90)
at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
at Test_jobkafka_job_test_1_0.kafka_job_test.tKafkaInput_1Process(kafka_job_test.java:1985)
at Test_jobkafka_job_test_1_0.kafka_job_test.tSetGlobalVar_1Process(kafka_job_test.java:2942)
at Test_jobkafka_job_test_1_0.kafka_job_test$5.run(kafka_job_test.java:3222)

 

I have attached a screen shot with different option i have tried.

 

Please assist.

Labels (3)
1 Reply
Anonymous
Not applicable
Author

Hello,

Could you please stick to one topic:https://community.talend.com/t5/Design-and-Development/tkafkaInput-Advanced-settings/m-p/142543?

So that we could pay individule attention to it.

Best regards

Sabrina