topic How to read only perticular files from URL in Talend Studio

How to read only perticular files from URL

rohit1804 — Fri, 15 Nov 2024 22:58:45 GMT

I have one scenario where I have to read 10 files out of 100 files from single URL. These 10 files is not in perticular order it could be 1st , 2nd or 99th place but it has some naming convention. So how can I filter those files and read those files?? Please help here

Re: How to read only perticular files from URL

Anonymous — Fri, 29 Apr 2022 03:20:30 GMT

Hello,

If we understand your requirement very well, you could use tfilefetch component and type in the URI of the site from which the file is to be fetched.

For your requirement, the URI could be set as a Dynamic variable as file path.

Here is a scenario documentation about: TalendHelpCenter: Fetching data through HTTP

Hope it helps.

Best regards

Sabrina

Re: How to read only perticular files from URL

rohit1804 — Fri, 29 Apr 2022 03:43:40 GMT

How can we select the specific files only among 100 files from single URL?

Re: How to read only perticular files from URL

Anonymous — Fri, 29 Apr 2022 03:54:40 GMT

Hello,

From your question description, 10 specific files have some naming convention?

Is it possible for you to elaborate your case with an example with input and expected output values?

Thanks for your time.

Best regards

Sabrina

Re: How to read only perticular files from URL

rohit1804 — Fri, 29 Apr 2022 04:04:31 GMT

Yes it has some name convention like file_A, file_B, file_Z. How can I read those files only ?

Re: How to read only perticular files from URL

Anonymous — Fri, 29 Apr 2022 04:12:58 GMT

Hello,

Please have a look at this component reference about: TalendHelpCenter: tfilefetch. You are able to type in the URI of the site from which the file is to be fetched. Such as: http://xxx.com/file_A.txt

Best regards

Sabrina