topic Re: Dynamic Selection of Input Files from Metadata in Talend Studio

Dynamic Selection of Input Files from Metadata

Anonymous — Wed, 22 May 2019 13:21:40 GMT

Hi,

I have a table with multiple columns of which one column is indicator_source_table . I want talend to read the value in a row corresponding to this column and use the value specified there to import another file.

For eg;

If in a particular row under the indicator_source_table column we get a value of "Net" then talend should import a file named Net.xlsx from my systemor metadata

Re: Dynamic Selection of Input Files from Metadata

Anonymous — Thu, 23 May 2019 04:17:14 GMT

Hi
You need to iterate the input values and pass it to tfileinputExcel as file name, eg:
tMysqlInput--main(row1)--tFlowToIterate--iterate--tFileinputExcel--main-->tlogrow

on tFileInputExcel, you can set the file path as, eg:
"D:/filepath/"+(String)globalMap.get("row1.indicator_source_table")

Hope it gives you hints.

Regards
Shong

Re: Dynamic Selection of Input Files from Metadata

Anonymous — Thu, 23 May 2019 04:58:30 GMT

Hi,

Thanks Shong for your reply .

The problem im facing is that I reached the tinputfile component but in this component we have to define the input file schema manually so that job runs properly and we can use the input file for other transformations . Is there any way that we can bypass the define schema step because if we are creating a dynamic system this tinputfile can have any table within it whose schema differ.

Annotation 2019-05-23 092712.png

Re: Dynamic Selection of Input Files from Metadata

Anonymous — Fri, 24 May 2019 01:38:29 GMT

Hi
Take a look at the dynamic schema feature, this feature is only available on enterprise subscription product.
https://community.talend.com/t5/Design-and-Development/How-to-process-changing-data-structure/ta-p/21702?advanced=false&collapse_discussion=true&filter=includeTkbs,location&include_tkbs=true&location=tkb-board:trb_develop&q=dynamic%20schema&search_type=thread
If you are using community edition, this is impossible, because the file structure always changes.

Regards
Shong