topic Re: How to load message on Kafka Cluster by using Talend in Talend Studio

How to load message on Kafka Cluster by using Talend

Anonymous — Sat, 16 Nov 2024 10:10:04 GMT

I would like to share that how can we produce messages on Kafka Cluster by using Talend.
How to do ?
1.It is pretty simple ,we have to give Kafka Server detail with port in Kafkaconnection component and we have to write topic name in Kafka output component .You can see the screenshot as I have subscribed to "test" topic.
2.The datatype of your input should be byte as kafka output takes only "byte" datatype .If our input datatype is a string then we have to use tjava or tjavarow component to perform the transformation (java code "output_row.serializedValue = input_row.users.getBytes()) ( https://help.talend.com/search/all?query=tKafkaOutput&content-lang=en)
Job screenshot

Re: How to load message on Kafka Cluster by using Talend

Anonymous — Thu, 05 Jan 2017 08:29:24 GMT

Hi harkirat,
Thanks for sharing your screenshots and experience on forum.
Best regards
Sabrina

Re: How to load message on Kafka Cluster by using Talend

Anonymous — Mon, 03 Apr 2017 14:43:15 GMT

This is good information. I played around with this over the weekend and it opens up doors do performing "real-time" data provisioning.

Re: How to load message on Kafka Cluster by using Talend

Anonymous — Thu, 19 Sep 2019 06:13:44 GMT

Thanks for sharing.

I tried this and the Kafka output key is null, also the headers are empty as shown below.

Please advise how to fix this? Thanks.

Re: How to load message on Kafka Cluster by using Talend

Anonymous — Mon, 23 Sep 2019 14:54:12 GMT

May you leave the ETL listening all the time for new messages? if possible, how do you do?