Skip to main content
Announcements
SYSTEM MAINTENANCE: Thurs., Sept. 19, 1 AM ET, Platform will be unavailable for approx. 60 minutes.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

kafka.common.MessageSizeTooLargeException: Found a message larger than the maximum fetch size of this consumer on topic

Hi,

 

Am using the tKafkaInput component and i get the error below:

 

 

Exception in component tKafkaInput_1
kafka.common.MessageSizeTooLargeException: Found a message larger than the maximum fetch size of this consumer on topic test_topic partition 0 at fetch offset 6010065. Increase the fetch size, or decrease the maximum message size the broker will allow.
at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:90)
at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
at Test_jobkafka_job_test_1_0.kafka_job_test.tKafkaInput_1Process(kafka_job_test.java:1985)
at Test_jobkafka_job_test_1_0.kafka_job_test.tSetGlobalVar_1Process(kafka_job_test.java:2942)
at Test_jobkafka_job_test_1_0.kafka_job_test$5.run(kafka_job_test.java:3222)

 

I have attached a screen shot with different option i have tried.

 

Please assist.

Labels (3)
1 Reply
Anonymous
Not applicable
Author

Hello,

Could you please stick to one topic:https://community.talend.com/t5/Design-and-Development/tkafkaInput-Advanced-settings/m-p/142543?

So that we could pay individule attention to it.

Best regards

Sabrina