topic Re: DockerFile in Talend Studio

DockerFile

SJeshwani1618330394 — Fri, 15 Nov 2024 23:41:53 GMT

Hi,

I want to create a dockerfile for Talend job with Talend studio Open Source with Data Integration.

I know there is a feature to create a dockerfile in the Enterprise version, but how to create with an Open source.

It would be really great if someone can share a sample DockerFile for Talend job.

Regards,

Sheetal

Re: DockerFile

Anonymous — Sun, 26 Sep 2021 03:00:26 GMT

Hello,

Please have a look at this KB article about: https://community.talend.com/s/article/Generic-Dockerfiles-for-Talend-Jobs-WSx3E and let us know if it is what you are looking for.

Best regards

Sabrina

Re: DockerFile

SJeshwani1618330394 — Sun, 26 Sep 2021 11:07:32 GMT

Hi Sabrina,

Thank you for your reply, I have checked that article but the thing is I can't find the Moreover, I am using Talend Open studio. So is it possible to use this dockerfile or it needs to be something different?

Regards,

Sheetal

Re: DockerFile

Anonymous — Mon, 27 Sep 2021 03:37:32 GMT

Hello,

This feature is not available in talend open studio.

Feel free to contact us and our team will right size a solution to you.

https://www.talend.com/free-trial/

Best regards

Sabrina

Re: DockerFile

SJeshwani1618330394 — Mon, 27 Sep 2021 07:18:41 GMT

Hi,

Thank you for the reply.

Yeah, you are right that this feature is not available in Open studio.

But my question was that, can I use the dockerfile which you mentioned earlier or I need to do some other configuration. I am aware that from Studio there is no feature to directly create a dockerfile in Open studio, but there should be some workaround to do this right? Like from outside not from Talend Studio.

Regards,

Sheetal

Re: DockerFile

Anonymous — Mon, 27 Sep 2021 08:57:46 GMT

Hello,

I didn't do this in talend open studio.

With talend subscription solution , we usually publish the jobs from Studio to Docker Repo.

If you are trying to configure the Dockerfile, please have a look at this article: https://community.talend.com/s/article/How-to-schedule-a-Talend-Job-with-Kubernetes-IB0yI

Best regards

Sabrina

Re: DockerFile

SJeshwani1618330394 — Mon, 27 Sep 2021 09:29:37 GMT

Hi Sabrina,

Thank you so much for sending me the link, I will definitely try to use this for my scenario and see if it's working for me or not.

Thank you.

Regards,

Sheetal

Re: DockerFile

Anonymous — Tue, 28 Sep 2021 07:14:36 GMT

Hello,

Don't hesitate to post your issue here.

Best regards

Sabrina

Re: DockerFile

aminegac — Mon, 04 Oct 2021 09:16:00 GMT

hello there,

seems so interesting to be able to do such things , but i can't find out why in my TOS after building a job nothing related to docker appears in the build zip after extraction ; is this feature exists in other talend products ? i also don't have the same menu that pops up when right-clicking on job to build it.

Re: DockerFile

Anonymous — Tue, 12 Oct 2021 04:17:56 GMT

Hello,

There is no feature to directly create a dockerfile in Open studio.

Best regards

Sabrina

Re: DockerFile

SJeshwani1618330394 — Fri, 15 Oct 2021 20:24:27 GMT

Hello Sabrina,

I am able to successfully create a docker file. However, I am facing another issue.

I have a scenario in which I am using s3Connection and s3Put components to load the object to IBM Cloud Object storage. Within the Talend and from the command line with .sh file, I am able to run the job successfully. But When I create a dockerfile and I run the docker image I am getting an error like below:

Exception in component tS3Connection_1 (s3co)

com.amazonaws.services.s3.model.AmazonS3Exception: The request signature we calculated does not match the signature you provided. Check your AWS Secret Access Key and signing method. For more information, see REST Authentication and SOAP Authentication for details. (Service: Amazon S3; Status Code: 403; Error Code: SignatureDoesNotMatch; Request ID: 8e344e66-4514-40ea-9b54-7f9818b26a03; S3 Extended Request ID: null), S3 Extended Request ID: null

at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1658)

at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1322)

at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1072)

at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:745)

at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:719)

at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:701)

at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:669)

at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:651)

at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:515)

at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4443)

at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4390)

at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4384)

at com.amazonaws.services.s3.AmazonS3Client.getS3AccountOwner(AmazonS3Client.java:932)

at com.amazonaws.services.s3.AmazonS3Client.getS3AccountOwner(AmazonS3Client.java:922)

at job.s3co_0_1.s3co.tS3Connection_1Process(s3co.java:370)

at job.s3co_0_1.s3co.runJobInTOS(s3co.java:1068)

at job.s3co_0_1.s3co.main(s3co.java:909)

Unable to find a region via the region provider chain. Must provide an explicit region in the builder or setup environment to supply a region.

It would be great if you can provide some suggestions as it's very urgent.

Thank you.

Regards,

Sheetal