topic Re: track changes in Talend Studio

track changes

Anonymous — Sat, 16 Nov 2024 04:21:50 GMT

I have developed a job thats supposed to track changes by comparing two sources and create an output insert. My tMap has a variable expression defined as below. My records are in millions of rows and performance it not very good. Any ideas please. - thank you in advance.

source1.customerid.equals(source2.customerid) && source1.hashing.equals(source2.hashing)? "no change":"changed"

Re: track changes

TRF — Wed, 16 Oct 2019 17:30:17 GMT

Can you share the tMap?

What kind of join do you have between the main and the lookup row?

Re: track changes

Anonymous — Wed, 16 Oct 2019 17:39:12 GMT

Here is my tMap

mgs.png

Re: track changes

Anonymous — Wed, 16 Oct 2019 17:40:25 GMT

Re: track changes

Anonymous — Wed, 16 Oct 2019 18:36:01 GMT

I have posted it below.

Re: track changes

TRF — Wed, 16 Oct 2019 18:54:11 GMT

It seems you don't have a join between input rows (not sure because you have reduce everything). You should (must) have a left outer join then, depending on result you'll decide which output flow to address.