Incremental Load

[jyothish8807]

Hello All,

I am trying to to do incremental load but have a bit of confusion with multiple tables.I have four tables which are comming from different sources.

Table1:

Load *

from ...;

Table2:

Load *

from ...;

Table3:

Load *

from ...;

Table4:

Load *

from ...;

Can any one please help me with this,iam trying to do inceremntal (insert,update,delete) load. Do i require an update date field in all the tables or is it enough to have in one table.All the four tables are connected through primary key.

Regards

Jyothish KC

[ajaykumar1]

Hi,

Please find the attachment its very helpful in easy way(check both application and excel).

Regards,

Ajay

[tresesco]

If you want incremental load for all tables, the timestamp field has to be there in all the tables. Otherwise, it is normally the case, use incremental load with Fact table(the bigger one), provided the date field is there.

[jyothish8807]

Hi Ajay,

Thanks for this attachment, but this is a basic example of incremental load. I have confusing with multiple tables and complex scripts.

Regards

KC

[jyothish8807]

Hi Tresesco,

     Thanks a lot for your feedback, but can you please explain me a little more?

While storing QVD, which table should i store? or do i have to store all the tables seprately and apply incremental load on all the tables?

Is there any way to store all the tables at onces in to one QVD in a go.

I have put each table script in different tabs.Not using concatinate or join, just joining through primary key.

Regards

KC

[tresesco]

You don't have to put all the tables in one qvd. First check which tables have modification timestamp field. Implement incremental load separately for them.

[jyothish8807]

My all four sheets can be modified by any one, so i think i will need Timestam field in all of my sheets.

[jyothish8807]

Any help?