Merging data with rules.

bk2 — Sat, 16 Nov 2024 07:27:04 GMT

Hello,

I would like to merge data from multiple sources with intention to create one 'golden record'.

I'm looking for some advice how to achive workflow solution that will automatically select and pass fields based on rules.

Example data to merge:

Data Source: 01.xml

Node ID: 001

Node Description: Lorem ipsum dolor sit amet

Node Photos: 001.jpg, 002.jpg

Data Source: 02.xml

Node ID: 001

Node Description: Lorem ipsum dolor sit amet, consectetur adipiscing elit

Node Photos: abc.jpg

Rule for Node Description field: select longest string

Rule for Node Photos: select source with more values (photos)

So after all my 'golden record' should be:

Node ID: 001

Node Description: Lorem ipsum dolor sit amet, consectetur adipiscing elit

Node Photos: 001.jpg, 002.jpg

I'm on Open Studio.

Regards,

Bart

Re: Merging data with rules.

fdenis — Wed, 17 Oct 2018 09:50:04 GMT

my question is how many rules and do they change?

Re: Merging data with rules.

fdenis — Wed, 17 Oct 2018 09:52:55 GMT

you can do it with tmap.
first select all possible ids
then use ids as main input with lookup on sources.
add var values for calculation and use inline if (condition)?true:false into output.

topic Merging data with rules. in Talend Studio

Merging data with rules.

Re: Merging data with rules.

Re: Merging data with rules.