topic Re: Download csv file from URL in Talend Studio

Download csv file from URL

Anonymous — Sat, 16 Nov 2024 06:07:29 GMT

Hi,

I've been trying to create this job that extract csv file from 10 URLs but before i need to pass this authentification page, i've tried the tFileFetch and the tRestclient but nothing works ... please any suggestions

Thanks in advance

Maroua

Re: Download csv file from URL

Anonymous — Tue, 09 Apr 2019 05:47:48 GMT

Hi,

What is the error you are getting? Could you please post screen shots of the current job flow, component screen shots and the error you are getting?

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: Download csv file from URL

Anonymous — Tue, 09 Apr 2019 09:31:19 GMT

Hi nikhilthampi,

Thank you for responding i don't have an actual job schema because i'm still trying to figure out what to do, what i have in mind is two components the first one is a tRest to do the authentication job the second one is for downloading the csv file ( i'm not sure if i can use both of tRest and tfileFetch), then i can do the transformations and the loading ...

The attached image is just the first component, i've linked it to a tLogRow to see the result unfortunately it returns an html code of an an intermediate page 😕

capture_csv_extract.png

Re: Download csv file from URL

Anonymous — Tue, 09 Apr 2019 18:46:40 GMT

Hi,

Since yours is a special use case, I would suggest to write custom routine as it is the most easy to complete this task. If you are doing that way, you can do both tasks in single code block and integrate them to other areas.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: Download csv file from URL

Arya26 — Tue, 02 Jun 2020 20:18:18 GMT

Hello Nikhil
Can you please direct me to some link where I can get the code for custom routine. I had similar requirement to download a CSV file from Soap API URL