Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi All,
I have a question regarding kafka usage within talend data fabric.
How can we increase the number of consumers from talend batch job/streaming job?
Any help on this appreciated. Thanks !
Hello,
Are you trying to do Huge data processing? What is your batch job/streaming job doing? How are you managing connections in there for each message?
More information about your use case scenario and job background will be helpful for us to give you a precise answer.
Best regards
Sabrina
Yes we have a huge data processing.
As of now we are only ingesting the Kafka records into Hbase.
But we frequently run into the issue of consumer while dealing with Kafka through talend.
Hence we would like to know if we have any approach to increase the number of consumers from talend
hi ,
Any input on this?
A Talend Job being left to continually receive Kafka messages may not be the best method for consuming theses messages. Talend ESB may be a better option for this.
