preceding load with concatenated tables load

[#1]

I am combining several tables into one and need to filter on one field together with making sure values are unique.

I thought about using the preceding load and came up with something like below:

LOAD DISTINCT *
WHERE field3='A';

LOAD
field1,
field2,
field3;
SQL SELECT * FROM table1;

CONCATENATE LOAD
field1,
field2,
field3;
SQL SELECT * FROM table2;

CONCATENATE LOAD
field1,
field2,
field3;
SQL SELECT * FROM table3;

It is not working though, because all values in field3 are still available.

What am I missing out?

thanj you!

[Clever_Anjos]

Maybe filtering into your SQL can lead to a 'full table scan'.

Please contact your Database Administrator and discuss your SQL´s with him analysing the execution plan of each SQL

[#3]

I already did so, but bewilderment and no suggestion came only from his side.

I got a tip from a colleague to try with a preceding load and it worked better.

This why my stubbornness to do the above with preceding loads