Skip to main content
Announcements
See what Drew Clarke has to say about the Qlik Talend Cloud launch! READ THE BLOG
cancel
Showing results for 
Search instead for 
Did you mean: 
Lav777
Contributor
Contributor

Is there a component for AWS MSK Kafka

Hi

I need to use Talend for Big Data 7.x with AWS MSK Kafka

I see a component for Apache Kafka but not for AWS

https://help.talend.com/r/ZKOgsQ1JCBAK1GzyokKlYQ/Fju2qsByhmN~2LawpQxWoQ

not sure if i can use the same with AWS

any inputs appreciated ?

Labels (4)
4 Replies
Anonymous
Not applicable

Hello,

Please try to use tKafkaInput and tKafkaOutput components to publish consume messages to Amazon MSK to see if it works.

We can do a test job through windows instance and MSK. Let us know what's error message you are getting.

Best regards

Sabrina

Lav777
Contributor
Contributor
Author

I did not see any option to give AWS secret key , region etc in tKafkaInput & tKafkaOutput ... how will i connect from my local windows machine to AWS MSK Kafka ?

Youssef3
Contributor
Contributor

Any update on that issue? Were you able to connect Talend to Amazon MSK? I'm facing the same issue and can't seem to find a way.

Anonymous
Not applicable

Hello,

From our side, we are able to use tKafkaOutput and tKafkaInput component to work with Amazon MSK When we login to the windows instance, the EC2 Kafka client instance is in the putty.

Are you trying to use credentials from AWS IAM role for Kafka components? It seems to be a new feature.

https://docs.aws.amazon.com/msk/latest/developerguide/security_iam_service-with-iam.html

Best regards

Sabrina