Skip to main content
Announcements
Introducing Qlik Answers: A plug-and-play, Generative AI powered RAG solution. READ ALL ABOUT IT!
cancel
Showing results for 
Search instead for 
Did you mean: 
_AnonymousUser
Specialist III
Specialist III

set priority to read lookup files

Hi,
 
We have requirement to update main table (>30millions) based on business rules & lookup files. There are 46 lookup files with different schema & business rule. The priority to update is set for each lookup file & it need to done accordingly.
 
File Priority File Name
1 AA.txt
3 BB.txt
2 XX.txt
4 ZZ.txt
 
In this case the update will happen in order: AA,XX,BB,ZZ

The solution which we can think is:

Main Table -->(Lookup AA.txt)--> tMap1--->(Lookup XX.txt)--> tMap2--->(Lookup BB.txt)--> tMap3--->(Lookup ZZ.txt)--> tMap4--->so on...
Is this approach feasible? Whether it is achievable with one tMap?

 
Please suggest optimum development approach for this scenario.
Thanks
Labels (2)
2 Replies
_AnonymousUser
Specialist III
Specialist III
Author

Whether it's possible in Talend to set priority for lookup files?
vapukov
Master II
Master II

read file(tFileInputDelimited) -> sort file (tSortRows) -> iterate over sorted rows (tFlowToIterate)