Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in Toronto Sept 9th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

How to load message on Kafka Cluster by using Talend

I would like to share that how can we produce messages on Kafka Cluster by using Talend.
How to do ?
1.It is pretty simple ,we have to   give Kafka Server detail  with port  in Kafkaconnection component and we have to write topic name in Kafka output component .You can see the screenshot as I have  subscribed to  "test" topic.
2.The datatype of your input should be byte as kafka output takes only "byte" datatype .If our input datatype  is a string then we have to use tjava or tjavarow component to perform the transformation (java code "output_row.serializedValue = input_row.users.getBytes()) ( https://help.talend.com/search/all?query=tKafkaOutput&content-lang=en)
Job screenshot
0683p000009MCns.png
0683p000009MCqj.png
0683p000009MCqo.png
0683p000009MCqt.png
Labels (3)
4 Replies
Anonymous
Not applicable
Author

Hi harkirat,
Thanks for sharing your screenshots and experience on forum.
Best regards
Sabrina
Anonymous
Not applicable
Author

This is good information. I played around with this over the weekend and it opens up doors do performing "real-time" data provisioning.
Anonymous
Not applicable
Author

Thanks for sharing.

I tried this and the Kafka output key is null, also the headers are empty as shown below.

Please advise how to fix this?  Thanks.

0683p000009M7OQ.png

Anonymous
Not applicable
Author

May you leave the ETL listening all the time for new messages? if possible, how do you do?