topic Re: Is there a component for AWS MSK Kafka in Talend Studio

Is there a component for AWS MSK Kafka

Lav777 — Sat, 16 Nov 2024 00:26:59 GMT

I need to use Talend for Big Data 7.x with AWS MSK Kafka

I see a component for Apache Kafka but not for AWS

https://help.talend.com/r/ZKOgsQ1JCBAK1GzyokKlYQ/Fju2qsByhmN~2LawpQxWoQ

not sure if i can use the same with AWS

any inputs appreciated ?

Re: Is there a component for AWS MSK Kafka

Anonymous — Fri, 12 Mar 2021 06:08:00 GMT

Hello,

Please try to use tKafkaInput and tKafkaOutput components to publish consume messages to Amazon MSK to see if it works.

We can do a test job through windows instance and MSK. Let us know what's error message you are getting.

Best regards

Sabrina

Re: Is there a component for AWS MSK Kafka

Lav777 — Fri, 12 Mar 2021 14:11:03 GMT

I did not see any option to give AWS secret key , region etc in tKafkaInput & tKafkaOutput ... how will i connect from my local windows machine to AWS MSK Kafka ?

Re: Is there a component for AWS MSK Kafka

Youssef3 — Wed, 14 Jul 2021 19:25:02 GMT

Any update on that issue? Were you able to connect Talend to Amazon MSK? I'm facing the same issue and can't seem to find a way.

Re: Is there a component for AWS MSK Kafka

Anonymous — Thu, 15 Jul 2021 03:48:02 GMT

Hello,

From our side, we are able to use tKafkaOutput and tKafkaInput component to work with Amazon MSK When we login to the windows instance, the EC2 Kafka client instance is in the putty.

Are you trying to use credentials from AWS IAM role for Kafka components? It seems to be a new feature.

https://docs.aws.amazon.com/msk/latest/developerguide/security_iam_service-with-iam.html

Best regards

Sabrina