Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
When applying a load, it seems that the system is fetching the wrong number of data. Upon fetching new data today, it was discovered that there were 312 new entries specifically for today's date. The total number of entries in the dataset before the load was 636,058. However, upon running the incremental load again, it fetched only 315 new records for today's date, but the total number of entries remained the same at 636,058. This raises the question of why the total number of entries did not increase despite fetching additional records for today
This incremental load script I am using.
LIB CONNECT TO 'SapSql_Prod';
EBAN_Max_Date:
Load max(ERDAT) as Max_Date
from [$(vQVDPath)EBAN.qvd](qvd);
STORE * FROM [EBAN_Max_Date] INTO [$(vQVDPath)EBAN_Max_Date.qvd];
Let Last_Updated_date = date(Peek('MaxDate', 0, 'EBAN_Max_Date'),'YYYYMMDD');
trace $(Last_Updated_date);
Incremental:
load*, BANFN&'-'&BNFPO as KEY;
Select
BANFN,
ERNAM,
ERDAT,
BNFPO,
FROM EBAN where ERDAT >= '$(Last_Updated_date)';
Concatenate
LOAD
KEY,
BANFN,
ERNAM,
ERDAT,
BNFPO
FROM [$(vQVDPath)EBAN.qvd](qvd)
Where not Exists(KEY);
store Incremental into [$(vQVDPath)EBAN.qvd](qvd);
drop table Incremental;
drop table EBAN_Max_Date;
Exit Script;