topic get filename from tfilelist in Talend Studio

get filename from tfilelist

Anonymous — Sat, 16 Nov 2024 07:13:38 GMT

Hi Everyone,

I am trying to get a filename from tfilelist which is not possible.

Then i tried to use tfilelistproperties but did not work out.May be I have done some mistake.

Could you please let me know how to get a specific filename using:

tfilelist->tfileinputdelimited

tfilelist->tfileproperties->tfileinputdelimited

My ultimate aim is to get a specific file from a directory and load it into Oracle database.

Regards,

Mohit

Re: get filename from tfilelist

TRF — Thu, 22 Nov 2018 17:07:07 GMT

Have a look to the following global variable associated to your component:

- tFileList_1_CURRENT_FILEPATH the current file with the full pathname

- tFileList_1_CURRENT_FILE the current filename

Re: get filename from tfilelist

Anonymous — Thu, 22 Nov 2018 17:12:13 GMT

It is not working.

tfilelist process the files in alphabetical order.

I can't select the desired fileName.

Re: get filename from tfilelist

TRF — Thu, 22 Nov 2018 17:26:26 GMT

Just put the desired filename(s) into the file mask area.

Re: get filename from tfilelist

Anonymous — Thu, 22 Nov 2018 17:28:57 GMT

That will be hard coded. When the job will run ,It will get the file that need to be loaded and try to insert that.

I can not hard code every time.

Re: get filename from tfilelist

TRF — Thu, 22 Nov 2018 17:58:06 GMT

Previously you said you want to get a specific file from a directory.
What's the rule?

Re: get filename from tfilelist

Anonymous — Thu, 22 Nov 2018 18:03:19 GMT

Hi ,

I have 10 files.My job is running.There is a validation that it is checking for which file data is already loaded into database.

Suppose there are 2 files for which the data is not loaded.

It will try to load these 2 files only

But there is a catch,'tfilelist' will load all the files.It won't check for any 2 specific files.

So nowi want to understand how to make tfilelist work to check the specific file.

regards,

Mohit

Re: get filename from tfilelist

TRF — Thu, 22 Nov 2018 18:21:44 GMT

You need to store the filename for the files which have been loaded. This list can be registered into a text file.
Then, when the job runs, search the current filename within the text file. For that, use a tIterateToFlow component connected to the tFileList on left and to a tMap on the right. The text file will be used as a lookup for the tMap to determine if the file is known or not. Catch the output rejected to get only the new files. Then send the result to a tFlowToIterate component to continue with the next tFileInputDelimited to get the content and store the filename into the text file.
Got it?

Re: get filename from tfilelist

Anonymous — Thu, 22 Nov 2018 18:33:50 GMT

Thanks,I will try it and show you the screenshot.

Regards,

Mohit