set priority to read lookup files

_AnonymousUser — Sat, 16 Nov 2024 09:59:34 GMT

Hi,

We have requirement to update main table (>30millions) based on business rules & lookup files. There are 46 lookup files with different schema & business rule. The priority to update is set for each lookup file & it need to done accordingly.

File Priority	File Name
1	AA.txt
3	BB.txt
2	XX.txt
4	ZZ.txt

In this case the update will happen in order: AA,XX,BB,ZZ

The solution which we can think is:
Main Table -->(Lookup AA.txt)--> tMap1--->(Lookup XX.txt)--> tMap2--->(Lookup BB.txt)--> tMap3--->(Lookup ZZ.txt)--> tMap4--->so on...
Is this approach feasible? Whether it is achievable with one tMap?

Please suggest optimum development approach for this scenario.
Thanks

Re: set priority to read lookup files

_AnonymousUser — Wed, 05 Apr 2017 09:58:40 GMT

Whether it's possible in Talend to set priority for lookup files?

Re: set priority to read lookup files

vapukov — Wed, 05 Apr 2017 21:36:48 GMT

read file(tFileInputDelimited) -> sort file (tSortRows) -> iterate over sorted rows (tFlowToIterate)

topic Re: set priority to read lookup files in Talend Studio

set priority to read lookup files

Re: set priority to read lookup files

Re: set priority to read lookup files