Incremental Load

[varunreddy]

Hi All,

I have 20 million records in a table. I tried to extract the table and store the data in a QVD (It took me 13 hours to load the data). Going forward, I don't want to load the existing 20 million records. I just want to run new records and append the records with existing records. So I tried to perform incremental load. This is only loading the new records. The issue now is after loading the new records, the reload process is still running for 13 hours. I am not sure why. Does anyone come across this situation?

Please help me in understanding the process.

Thanks in advance!

Cheers,

Varun Reddy

[varunreddy]

If I change where condition, i am getting syntax error

[sunny_talwar]

What is the exact error you are getting?

[varunreddy]

[sunny_talwar]

Where Clause isn't right, try this:

SQL SELECT *
FROM DQIHKPA1."DQMR_HK01_TBL"

Where SYSTEMDATE > TO_DATE('09/27/2016', 'MM/DD/YYYY');

[varunreddy]

This is my where clause:

where Date(SYSTEMDATE,'MM/DD/YYYY') > $(vMaxDate) .

Is there anything I need to correct?

[sunny_talwar · Accepted solution]

Try this out

Where SYSTEMDATE > TO_DATE('$(vMaxDate)', 'MM/DD/YYYY');

[varunreddy]

It worked. Thanks for your replies.

Cheers,

Varun Reddy. K

[sunny_talwar]

No problem

[varunreddy]

So the variable was not in the date format?

[sunny_talwar]

It is in date format, but not in a format that SQL would take. SQL usually takes in DD-MMM-YYYY format or you can use TO_DATE function for SQL to understand your date as date.