topic Re: how to give priority to the source data in Data Quality

how to give priority to the source data

saikumarmdm — Sat, 16 Nov 2024 02:40:34 GMT

I have scenario to do now.

my scenario is i have data from the 3 sources (source 1,source 2 , source 3)in these data i have to give priority to the one column based on source.

For ex: lets take phone number column i have phone number fields in each source if source 1 have phone number field it should take. or if source 1 value is empty or null it should take source 2 phone number value.

if source 2 also empty or null it should take source 3 phone. how i can achieve with this talend data quality or mdm UI or stewardship not with the tmap. please solution to this problem.

Re: how to give priority to the source data

Anonymous — Thu, 16 Apr 2020 03:38:30 GMT

Hi
To extract data from data source, we need a DI job, something like:
source1--tJavaRow1...--runIf---source2--tJavaRow2..runIf.-source3---....
Check if phone number is null or empty on tJavaRow

Regards
Shong

Re: how to give priority to the source data

saikumarmdm — Thu, 16 Apr 2020 07:21:57 GMT

Is there other solution we can accomplish

i need to do this in MDM UI or Stewardhip UI,

I should define prioritizing and make automated process

Re: how to give priority to the source data

Anonymous — Thu, 16 Apr 2020 07:40:28 GMT

Hello,

You could do that in DataStewardship. If you create a Merging campaign, you can set the source names and their trust score. For each attribute, you can set a different survivorship rule, if you select "most trusted" the source with the higher trust score is selected as for the golden record.

Regards.

Re: how to give priority to the source data

saikumarmdm — Thu, 16 Apr 2020 18:27:16 GMT

Thanks for that i will check.
can you please tell me how i can automate this process MDM UI

Re: how to give priority to the source data

Anonymous — Fri, 17 Apr 2020 07:28:17 GMT

Hi,

I let someone from MDM help you with that. I only know TDS side.

Regards

Re: how to give priority to the source data

Anonymous — Fri, 17 Apr 2020 13:46:50 GMT

You could find help on DataStewardship in the documentation, the following links are for the cloud version, it's the same as the on-premise version regarding the merging campaign configuration:

https://help.talend.com/reader/PTvencuqQ1C0A2_trH580g/MAc35tilnunFRAohfsAviQ

and

https://help.talend.com/reader/Vbpa9a7H0uL63IHWcWYk9g/LVFNVhk70MXX~oTIb2Svow

Regards

Re: how to give priority to the source data

saikumarmdm — Fri, 17 Apr 2020 16:13:00 GMT

Thanks for the document please let me know with MDM because my clients want me to do with that only...