Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Incremental Load

Hi Guys,

I'm having sample data in some format in excel as shown below.

S1.jpg

But I have converted this data into another format which is convenient for me as shown in the below screenshot.

S2.jpg

But I need to apply incremental logic while extracting the data itself i.e first screenshot - excel file. I want this to load on daily basis based on incremental load, since it will have only historic data there is no need for me to run all the data again and again.

But my concern here is, I couldn't load the maximum date since the source excel data format is not in proper format. So, please suggest me how can I implement incremental logic for this sort of data.

Attached the sample data.

Thanks,

Siva.

3 Replies
sunny_talwar

What is wrong with the date? Didn't we create date in this thread?

Data Format Change in QV

Anonymous
Not applicable
Author

Yes Sunny, We created the date successfully in that thread. But I also need to apply incremental logic before creating the date column - I want to load the data on daily basis using incremental load.

sunny_talwar

Not sure how you would do that? Is there another way to identify which rows are new?