topic Re: ETL jobs deployment in Talend Studio

ETL jobs deployment

fn_guennoun — Sat, 16 Nov 2024 01:44:07 GMT

hello

I'm working on implementing a data warehouse (PostgreSQL) in a distant server (Virtual Private Server) , loaded by a set of jobs designed in Talend Open Studio for Data integration 7.3 .

As my situation does not allow me to purchase an enterprise license to use Tend administration center, I need to find an alternative to plan, schedule and execute the jobs I have created.

My questions are:

What is the best alternative to execute the created jobs?

If it is feasible to deploy the jobs in a distant server and execute them, what are the technical requirements (software and hardware) needed?

How do I schedule jobs in a distant server?

Thank you.

Re: ETL jobs deployment

Anonymous — Thu, 06 Aug 2020 01:47:33 GMT

Without TAC, you can export the job script and deploy to distant server, schedule the jobs using third-part scheduler, Windows task manger or Linux crontab command. It requires Java installation on the system where the job is executed.

Take a look at this article to learn about how to export the job script and run it.

https://help.talend.com/reader/TIdc3fL8QrNY98FnP7p_sA/~tnruOWMct6uXgZcKMdOAw

Regards

Shong

Re: ETL jobs deployment

JohnRMK — Wed, 12 Aug 2020 08:50:41 GMT

Hello,

You can use apache airflow to schedule the job or even jankins. To store your release, you can use jFrog or nexus (the open source version)jenkins

It's in french but you can translate the article

https://www.effidic.fr/lautomatisation-des-jobs-par-jenkins/

https://www.effidic.fr/ordonnancement-de-jobs-talend-par-jenkins-les-nouveautes/