How to FTP files to Azure Data Lake Blob Storage

traubt — Sat, 16 Nov 2024 00:08:39 GMT

Hi,

I am fairly new to Talend Studio and learning the various components.

I want to FTP files from a 3rd party FTP site and ultimately persist them into ADLS2 Blob Storage. Is there a way to do this with having to persist the files in some local directory with tFTPGet component? Or, do I have to persist the file in some temporary location and then move the file into ADLS2 Blob Storage? I was trying to figure out if there is was a more direct route and bypass the intermediate file storage.

We have the ability to run Talend Jobs on a Talend Job Server in Azure or in containers within azure.

My pipeline is pretty basic:

tFTPConnection - > tFTPGet -> tFTPClose

I will add the capability to write the files to ADSL2 Blob Storage by adding the tAzureAdlsGen2Output component to the flow.

Any help would be appreciated!

Regards,

Tim

Re: How to FTP files to Azure Data Lake Blob Storage

Anonymous — Wed, 19 May 2021 07:22:11 GMT

Hello,

So far, talend don't support for transferring data by air.

You have to get your ftp files from 3rd party FTP site to local firstly and then write your files into ADLS2 Blob Storage.

Best regards

Sabrina

topic How to FTP files to Azure Data Lake Blob Storage in Talend Studio

How to FTP files to Azure Data Lake Blob Storage

Re: How to FTP files to Azure Data Lake Blob Storage