Filtering out data

[neerajthakur]

I have two tables and want to filter data as per below example how can I achieve it in an optimized way:

T1:

Load * Inline [

ref_id

1,

2,

3,

4,

5

];

T2:

Load * Inline [

ref_id,

1,

2,

3,

4,

5,

6,

7,

8,

9,

10

];

Result_Table:

ref_id

6,7,8,9,10

[rubenmarin · Accepted solution]

Hi, in T2 just add:

T2:

NoConcatenate

...

9,

10

] Where not exits (ref_id);

DROP Table T1;

[neerajthakur]

I tried this on my own but it required changing ref_id as key for T2 table as they were getting concatenated, and then changing field name from key to ref_id in final table. You have used NoConcatenate after table which we don't use normally and I hope that must be the Key to this problem solution.

[sidhiq91]

As per below:

NoConcatenate
T1:
Load * Inline [

ref_id

1,

2,

3,

4,

5

];

NoConcatenate
T2:

Load * Inline [

ref_id,

1,

2,

3,

4,

5,

6,

7,

8,

9,

10

]
where not Exists(ref_id,ref_id);

Drop table Temp;

exit script;