you have several options, do you have already know the diferent types? how do you chose the value you re going to keep if there are several (B ML 4 and C ML 6 ) in your exemple. How can you define the priority (manually or in db?)
yes I know different types and order of the priority is fixed: for ex. [size=3][font=Times New Roman","serif]1. PH[/font][/size] [size=3][font=Times New Roman","serif]2. BL[/font][/size] [size=3][font=Times New Roman","serif]3. ML[/font][/size] [size=3][font=Times New Roman","serif]4. CR[/font][/size] [size=3][font=Times New Roman","serif]5. BA[/font][/size] [size=3][font=Times New Roman","serif]I need to define the priority manually in the job. [/font][/size]
MMh, i think you will have to split your flow: 1) tnormalize 2) Tmap (you change the schema as you like it deleting columns and you split depending on the value of the type PH,BL as you know it) 3)you put all of your Tmap outputs in several temp files or in hashOutput if you care for perf. 4) On subjob ok -> all hashInput or TfileInput connected to Tunite in the order you want. you have your flow
