Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik and ServiceNow Partner to Bring Trusted Enterprise Context into AI-Powered Workflows. Learn More!
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

How to use tKakfaInput component to consume the Topics generated via tKafkaOutput component

I have Talend job, where in I am using "tKafkaConnection", "tKafkaInput" and "tLogRow" components.
I am using Talend Open Studio for Big Data (6.3.1) Free Edition.

The value of Zookeeper Quorum list and Broker list for "tKafkaConnection" has been set properly for tKafkaConnection component.

Value of "Topic Name"has been set to "testKafkaTalend" and value of "Consumer Group Id" has been set to "Con_grp" for tKafkaInput component.
And then I have used "tLogRow" component.

I have built a Producer too in a Talend using tKafkaOutput component.

The problem that I am facing is the when I use the non-Talend Kafka Consumer (regular Kafka consumer running separately on the machine, and not use the tKafkaInput component), I can see the topics that are being produced via the Producer that I wrote.

But when I use the Talend based Kafka Consumer, I am not able to see any data being consumed.


Can anyone suggest what am I doing wrong with tKafkaInput? 
Attached are the configurations of the various components.

0683p000009LuAR.jpg0683p000009LtUF.jpg0683p000009LuAW.jpg0683p000009LuAg.jpg

 

Labels (2)
4 Replies
Anonymous
Not applicable
Author

Hello,

Is there any message printed on console when you use the Talend based Kafka Consumer(tKafkaInput component)?

Best regards

Sabrina

Anonymous
Not applicable
Author

No, there is no message that is printed on console.

 

vapukov
Master II
Master II

version of Kafka same as You set in Talend?

Kafka is very sensitive for minor version changes

Anonymous
Not applicable
Author

Yes, they are same in both producer and consumer.

For now, this has been resolved.

What I did was, created the whole job again, using the same components.

 

And it worked in the new job.

I am not able to see any difference in the old job and new job.
But it worked in the new job.