Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

[resolved] Creating metadata and using it for set of files

Hi,
I'm using TOS for Data Integration 5.4.1.
Objective : Creating metadata schema for one time and reading the csv files using metadata without specifying the schema on the fly.
Here i have created metadata for csv file and saved it. So fro other files with the same structure i can use the same metadata while reading the file using tFileInputDelimited(by selecting type as repository) , which works fine .
But facing issues while dealing with a set of csv files with the same field structure . Here i have created a job which reads csv files using tFileList.In next step when i use tFileInputDelimited to read the files , have selected the metadata by choosing type as repository. In FileName/Stream it shows the file which is given while creating the metadata.
So there i wanted to use " ((String)globalMap.get("tFileList_1_CURRENT_FILEPATH")) " kind of thing. But if i click on the fileName it doesan't allow me to do so.

So in this what can be done to achieve this.
I have attached the screenshot of the job.
0683p000009MDaD.png 0683p000009MCfk.png 0683p000009MDaI.png
Labels (3)
15 Replies
Anonymous
Not applicable
Author

Hi,
My 1st paragraph says , i have created a job with the components
tFileList >> tFileInputDelimited >> tLogrow
Here i have used built-in schema where I'm creating the schema on the fly.Here in tFileInputDelimited i'm able to specify the file by giving "((String)globalMap.get("tFileList_1_CURRENT_FILEPATH"))".
By i do not wanted to create the schema on the fly .So i have created one more job with the components
tFileList >> tFileInputDelimited >> tLogRow
Here i created the metadata schema for FileDelimited and used in tFileInputDelimited by choosing Repository schema option. But if i do this, it gives me the file already choosen while creating the FileDelimited metadata. But i wanted this to change to "((String)globalMap.get("tFileList_1_CURRENT_FILEPATH"))"> so that i read the corresponding input file and disply the result.
Also i'm not looking for dynamic metadata creation in talend.
I have attached the screen shot .
Thanks,
ShreeCS
0683p000009MDXK.png
Anonymous
Not applicable
Author

check in screenshot, how it is implemented.
0683p000009MDUf.jpg
Anonymous
Not applicable
Author

Hi,
Finally i got it and you cleared my doubts. Till now instead of selecting built-in i was chhosing repository where i was making wrong.
Thanks a lot and now the job is running properly.
But if i want to use tFileOutputDelimited instead of tLogRow. How it works. How it stores the different input files
as a output file with different name.
And alos whatever you explained is also applicable to xml files right. Is it like all the xml files should be with the same root and row tag or we can have different xml files ?

Thanks,
ShreeCS
Anonymous
Not applicable
Author

1) Learn string manipulation, use tfilelistcurrentfilepath and postfix or prefix with the timestamp. This will create respective output file for each input.
2) Yes, it is applicable for xml files as well.
Small suggestion - If you have different problem, create a new thread... Mark existing thread as fixed. People or community users will not be able to relate multiple solutions in single thread with single heading...
Please mark this thread as fixed and start new question again...
Hope you understand.
Thanks
Vaibhav
Anonymous
Not applicable
Author

Ya sure.
Thanks a lot for your help and guidance.
The thread has been fixed.
Anonymous
Not applicable
Author

Resolved