topic Re: Populate data on the basis of priority in Talend Studio

Populate data on the basis of priority

Anonymous — Sat, 16 Nov 2024 06:07:55 GMT

I am stuck with a scenario, given below,

I need to populate target table on the basis of some priority on source data, if the high priority record found then other records should not load into target from the same group, it should be get rejected. If the high priority item not found, it should check other below priority record, if found, load the same into target and ignore other records in the same group, example below,

Priority Order:

1. sfdc

2. sfdc,dc,fg ( if channel like '%sfdc%')

3. *

Note: There is no specific KEY column available, combination of columns can make a KEY.

1. if source data comes like below, it should load only last record,

name	chargecode	groupcode	channel
sme1	50958	5098	*
sme1	50958	5098	sfdc,dc,fg
sme1	50958	5098	sfdc

2. In this case 2nd record should loaded

name	chargecode	groupcode	channel
sme1	50958	5098	*
sme1	50958	5098	sfdc,dc,fg

3. If the source record coming with single channel, then it should load, so in this case priority is not required,

name	chargecode	groupcode	channel
sme1	50958	5098	sfdc,dc,fg

name	chargecode	groupcode	channel
sme1	50958	5098	*

name	chargecode	groupcode	channel
sme1	50958	5098	sfdc

Re: Populate data on the basis of priority

manodwhb — Mon, 08 Apr 2019 11:22:12 GMT

@Vibin_CT ,check the below one.

Re: Populate data on the basis of priority

Anonymous — Mon, 08 Apr 2019 11:24:12 GMT

Hi,

The most easy method is to have a ranking config table for each channel and then do a lookup with this table to get the ranking for each record. Order the incoming data based on key columns and rank. Then for each data group (using taggregaterow), pick the first record which is having highest rank.

This should resolve your issue.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: Populate data on the basis of priority

Anonymous — Mon, 08 Apr 2019 11:51:21 GMT

@nthampi:

Thank you very much!!

@manodwhb: Thanks for your quick response, but your first condition won't provide expected result, because if we find channel with only 'sfdc', we should ignore other records from the same group. I am okay with the solution provided by @nthampi .

Re: Populate data on the basis of priority

Anonymous — Mon, 08 Apr 2019 11:54:10 GMT

Thanks for the update @Vibin_CT

Since you have the solution, could you please mark the topic as closed? Kudos are also welcome 🙂

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂