Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
in incremental load data is updated only once per a month but due to data base connection error data is loaded 50% only how can i load remaining without adding duplicates
You can use where not exists(FieldName) while loading data again from source. It will not load the already loaded data.
Hi,
here is one method:
you can look at the date column in your table in your app and do a manual incremental load on it by adding the rows of the missing dates one day before the next Incremental scheduled reload.
but i want to load only unloaded data without reloading the application with previous time stamp.
in your suggestion application starts from first step and those previously loaded 50% can be removed by where condition but i want to load only unloaded data
do you have any updated/last modified time stamp ?? if you have then you could continue the load with the last record loaded with the time stamp and then load data greater than that