Calling ETL Jobs from Azure

Anonymous — Sat, 16 Nov 2024 03:32:10 GMT

Hello,

I'm in a project that our team need to read some files that will be storage in some blob storage (maybe Azure Storage) and insert their data in a database. These files will be put in Azure Storage and I need to call/trigger the ETL Talend job every time that a file was inserted in the Storage. I checked that the Azure has the Azure Functions that I think can help me. Exist some documentation/video that can provide this information for me? I need to know how Azure and Talend work together.

NOTE: I'm trying to use the Talend Open Studio, but I think that is impossible to perform this connection with this tool.

Thank you!

Re: Calling ETL Jobs from Azure

nivedhitha — Tue, 21 Jan 2020 22:07:33 GMT

@Moe ,

The talend jobs have to be deployed in the cloud if you want to do an event based trigger.

There are azure functions that could be created to trigger talend jobs on file creation

https://community.talend.com/t5/Architecture-Best-Practices-and/Using-Azure-Functions-to-trigger-Talend-Cloud-Jobs/ta-p/124225

The above link has detailed explanation but with Talend Open studio i don't think it is possible

topic Calling ETL Jobs from Azure in Talend Studio

Calling ETL Jobs from Azure

Re: Calling ETL Jobs from Azure