topic Re: [resolved] tFileInputDelimited accepting a variable to dynamically in Talend Studio

[resolved] tFileInputDelimited accepting a variable to dynamically

Anonymous — Sat, 16 Nov 2024 13:56:13 GMT

Is there a way to send the tFileInputDelimited component variable to dynamically fill in the file that I need to process.
1. The file is stored in a directory.
2. The file names are stored in a database table.
3. I can get the name from the db but can figure out if there is a way to send that name to the tFileInputDelimited component.
Best regards.
I am currently a novice user.

Re: [resolved] tFileInputDelimited accepting a variable to dynamically

Anonymous — Fri, 29 May 2009 21:50:32 GMT

It is possible.
You can put this value in the globalMap of your job, and use it after.
If you have several files in your DB, the better way is probably to use a tFlowToIterate (which store the fileName the globalMap for each file).

Re: [resolved] tFileInputDelimited accepting a variable to dynamically

Anonymous — Mon, 01 Jun 2009 16:48:48 GMT

Sorry it took so long to reply to this message. bcourtine this worked great!!! I decided to you use the tFlowToIterate component which worked great. The more I work with the various componets I find them easy to use.
Regards.

Re: [resolved] tFileInputDelimited accepting a variable to dynamically

Anonymous — Wed, 29 Jul 2009 22:43:29 GMT

It is possible.
You can put this value in the globalMap of your job, and use it after.
If you have several files in your DB, the better way is probably to use a tFlowToIterate (which store the fileName the globalMap for each file).

Hello,
I'm novice user so be patient with me
I have similar situation and resolve it in the same way.
Here is a picture of part of my job design.
I have a tFileInputDelimited component which holds a part of the name of the tFileInputExcel_3 file.
It is shown on a picture. It works as a charm.
My problem is, each of those excel files that I process in a loop, has several lookup excel files.
Those files are in the same directory and I can not move them.
I made a tFileInputExcel_2 component and it is not working. (bad file name).
I apply the same rule for creating a fileName as in a tFileInputExcel_3 component.
Is there a way for each record in FileInputDelimited file, to make a look up excel component with "dynamic" fileName.
bottom line:
1. in component tFlowToIterate_1 I have a variable "fileName"
2. in tFileInputExcel_3 component I dynamically create a file name with this variable "fileName". It works.
3. in tFileInputExcel_2 (lookup excel file) this variable "fileName" is null. It's not working.
In what way I can resolve this problem?
thanks in advance.
Best regards.

Re: [resolved] tFileInputDelimited accepting a variable to dynamically

Anonymous — Thu, 30 Jul 2009 03:02:48 GMT

Hello guy
Also use a tFileInputDelimited and tFlowToIterate to iterate all the file name, then use a tUnite to merge all look up records.
tFileInputDelimited-->tFlowToIterate--iterate-->tFileInputExcel_2-->tUnite-->tMap
Best regards
shong

Re: [resolved] tFileInputDelimited accepting a variable to dynamically

Anonymous — Thu, 30 Jul 2009 20:11:01 GMT

Hello guy
Also use a tFileInputDelimited and tFlowToIterate to iterate all the file name, then use a tUnite to merge all look up records.
tFileInputDelimited-->tFlowToIterate--iterate-->tFileInputExcel_2-->tUnite-->tMap
Best regards
shong

thanks for quick reply, but
I don't get it. I do not have to merge the content (tUnite component) of "main" and lookup tables.
What I need is in loop of reading input file (tFlowToIterate_1) to make three things:
1. read main excel file (tFileInputExcel_3) with dynamic fileName (I done that)
2. in the same time for each record in main excel (tFileInputExcel_3) to look up for some values in lookup excel file. The name of this lookup excel file depends on filename from point 1. (tMap component)
3. write this record to DB (main component)
and I need this loop to iterate for 20 excel tables and 20 excel lookup tables (both excel tables have dynamic filename).
I have try to use tUnite component but I do not see in what way this component can resolve my problem...maybe I miss something obvious..i do not know
Once more,
thanks for valuable input. I have learn something new..
Regrads.

Re: [resolved] tFileInputDelimited accepting a variable to dynamically

Anonymous — Fri, 31 Jul 2009 04:09:09 GMT

Hello guy

in the same time for each record in main excel (tFileInputExcel_3) to look up for some values in lookup excel file. The name of this lookup excel file depends on filename from point 1.

I get your point now.
To reach this aim, you need put the main and lookup flow in a child job, use a tRunJob component to run this child job in the father job. I have created an example job, please see my screenshots.
Hope you understand well!!
Best regards
shong

Re: [resolved] tFileInputDelimited accepting a variable to dynamically

Anonymous — Fri, 31 Jul 2009 08:41:22 GMT

Hello guy

in the same time for each record in main excel (tFileInputExcel_3) to look up for some values in lookup excel file. The name of this lookup excel file depends on filename from point 1.

I get your point now.
To reach this aim, you need put the main and lookup flow in a child job, use a tRunJob component to run this child job in the father job. I have created an example job, please see my screenshots.
Hope you understand well!!
Best regards
shong

working great.
thats what I need...
Thanks for your time.
Regards.

Re: [resolved] tFileInputDelimited accepting a variable to dynamically

Anonymous — Fri, 31 Jul 2009 08:46:33 GMT

Hello

working great.
thats what I need...
Thanks for your time.

Good news, it is very nice to help you and hope you enjoy Talend!!!
Best regards

shong

Re: [resolved] tFileInputDelimited accepting a variable to dynamically

Anonymous — Mon, 11 Jun 2018 05:43:19 GMT

Hi,

I am unable to see the solution (screenshots) for this, please advise.

Thanks