For Eg In Landing table i had 100 records loaded to DW 100 records
Second day the Landing Table (Full Load) have 90 records, in DW 90 records gets updated whereas the additional 10 records should get wiped out. As in DW there is no truncate of data how to handle it.
Currently i still see 100 records in DW though 10 records got deleted from Landing table
I have the similar issue. When the DW task is created as Full Load, I expect it to purge every row loaded last time out and get a fresh data from the landing zone in. But so far, I understand that Compose does Insert/Update based on Business Key, you've defined in Entity in the Model step. This is pretty annoying and misleading to me 😞 Anyway, my workaround at the moment is that I've create a Pre-loading ETL to truncate the HUB table
