Talend with azure

Anonymous — Sat, 16 Nov 2024 03:29:08 GMT

Hi all,

I installed Talend Open Studio for Big Data to process my data with azure.

To start, I have to make a poc which allows the connection between talend and azure, then get the csv files that I have in HD Insight in azure, aggregate them with talend(tmap component) and put them in azure to finish.

For the moment I manage to recover the files from azure but then it is not possible to process them without storing them on my pc.

Do you have any idea how to do this ?

Thanks 😊 (and sorry for my english, i'm french)

Re: Talend with azure

manodwhb — Sat, 07 Mar 2020 10:22:53 GMT

@vozturk , with the open studio ,it will load into the local drive and then you need to upload into Azure using put component.

If you have enterprise edition you can leverage the batch jobs batch steaming jobs to do this job without load into local directory.

And one more thing you can try to write a java code to stream the data and directly load it azure.

topic Re: Talend with azure in Talend Data Catalog

Talend with azure

Re: Talend with azure