topic Extracting data from API, load data as a csv file then upload to SFTP in Talend Studio

Extracting data from API, load data as a csv file then upload to SFTP

tnpnguyen90 — Fri, 15 Nov 2024 23:27:32 GMT

Dear Talend Gurus,

I am trying to use the data that I received from API and convert it as a csv then upload it to a FTP. I believe using a tFileOutputDelemited component stores the csv on to your local machine, but is there anyway to convert the data to csv file then directly upload that file to a FTP without storing the file on to my local machine?

Re: Extracting data from API, load data as a csv file then upload to SFTP

Anonymous — Thu, 02 Dec 2021 14:59:04 GMT

You can do this in code using Java within Talend, but we don't supply a component which will do this. Your best course of action is to create the file to a local location, then use a tFTPPut component to send it to the FTP location. Once that is safely done, delete the local file.

To get your data from the API you will need to either extract it from JSON or XML. Both can easily be handled, but you will need to know the schema and type of data you are getting before you can decide on how to approach this.

Re: Extracting data from API, load data as a csv file then upload to SFTP

tnpnguyen90 — Mon, 06 Dec 2021 17:51:40 GMT

Thanks for the response rhall! I played around with the tFileOutputDelemited component and found out that we can use that to create a csv file as well as writing directly to the FTP location.