Partial Reload / Incremental reload

[#1]

Hi There,

I'm not sure if this has been answered elsewhere, I have seen other posts advising that an Incremental reload should be done rather than a partial reload.

Could someone explain the difference or point me in the direction of the documentation?

Many thanks

Gerard

[#2 · Accepted solution]

Partial reload executes a specific part of your sciprt, this can for example be used to refresh a certain table.
Incredemental reload is defined in the script to update certain tables incredementally, for example to add only new transactions to a transaction table.

Incremental reload is especially used to decrease the reload time, by for instance only loading new records from a data source instead of the complete table (which can be very big).

[#3]

That make sense, Thanks

[#4]

I have a question..

I see that partial reload is done based n the timestamp to get the new records, but if those records already exist on the table, and the timestamp changes, then they will be added again.. which means they would be duplicated on the table, is this correct?

how do you go around not having them being duplicated?

thanks,

[#5]

Hi Mark,

Can you please explain me how to do incremental reload in the attached application.

[#6]

I know this sounds redundant but is there a way to concatenate from one table to another only during partial reload?

I see that the concatenate add only does not seem to work. and I understand ADD only is the code that needs to be used in order to be executed during a partial reload.

thanks!

[#7]

Hi

Does it mean that Partial load is done at the table level and Incremental load is done at the record level. Please jusrify my understanding!

Thanks,

Attitude

[#8]

Hi All,

Can some one please justify my above understanding about the differences?

Thanks,

Attitude