topic Re: [Data integration] Compare data from two tDBinput in Talend Studio

[Data integration] Compare data from two tDBinput

Anonymous — Wed, 08 Aug 2018 16:03:27 GMT

Hi,

Sorry if I don't post in the right place but I'm new with Talend.

For my problem, I have two tDBinput which return an identifiant, an act and the date of the act. (Each input are for different databases)

I have to compare the result of my Inputs but I don't know how to do that.

Indeed, for an exemple of data I have :

Input A :

Identifiant : 1

Act : Y - 01/01/2018

Z - 02/01/2018

Input B :

Identifiant : 1

Act : Y - 01/01/2018

Y - 01/01/2018

Z - 02/01/2018

K - 05/05/2018

The filter that I should create have to return : Y - 01/01/2018 (Cause I have 2 in input B but only one in input A) and K-05/05/2018 because it exist in input B but not in Input A.

I don't find how to do that, I don't know if it is possible

Can you help me please ?

Regards,

(Sorry for my english level)

Re: [Data integration] Compare data from two tDBinput

Jesperrekuh — Wed, 08 Aug 2018 17:07:09 GMT

You have to place a step before the actual matching:
Aggregate first and count:
Input A:
Act : Y - 01/01/2018 - 1
Z - 02/01/2018 - 1
Input B:
Act : Y - 01/01/2018 - 2
Z - 02/01/2018 - 1
K - 05/05/2018 - 1

Assuming in your given example Input B contains all of the data. Perform a left/right join and catch non matching records. Use the tMap component and read the documentation too )
Pretty easy I think.

Re: [Data integration] Compare data from two tDBinput

Anonymous — Fri, 10 Aug 2018 10:08:32 GMT

Thanks for you answer, I'm ok now with the tmap but I have a problem with the agregate and count my acte.

Indeed, insteead of have result like :

Act :

Y - 01/01/2018 - 1|| Identifiant
Z - 02/01/2018 - 1|| Identifiant
Input B:
Act : Y - 01/01/2018 - 2 || Identifiant
Z - 02/01/2018 - 1|| Identifiant
K - 05/05/2018 - 1|| Identifiant

I have something like

Input B:
Act : Y - 01/01/2018 || Identifiant || Identifiant
Z - 02/01/2018 || Identifiant
K - 05/05/2018 || Identifiant

When I try to list. And count function give me an error cause of the format of input...

I have something like that in my taggregateRow : (IEP is the identifiant)

and my data are :

act : YYYY60001-04/03/2018

ident : 214229241

Did I miss something ?

AggregateRow.PNG

Re: [Data integration] Compare data from two tDBinput

Anonymous — Mon, 13 Aug 2018 10:57:48 GMT

Hi,

I resolve my problem and now I have row1's data like :

A|ZCQJ00101-02/08/2018x1
A|JKHD00101-02/08/2018x1
A|ZCQM00101-02/08/2018x1

where Ais my ident.

For row2 I have this :

A|ZCQJ00101-02/08/2018x1
A|JKHD00101-02/08/2018x1
A|ZCQM00101-02/08/2018x1

So tmap should return me : A|JQQM01001-06/08/2018x1

Row1 is the main output with all my data and Row2 is my lookup.

On the tmap, I set as inner join, and I set "Catch output inner join" as yes for the output.

After that, take the "rejet" output in a tlogrow.

Instead of have only one row, this return me all the rows from my row1