Incremental Load with table updates

[tommyl]

Hello experts,

I need your help about incremental load.

My DB table is:

id	content	xdate
1	A	2020-11-26 10:12:45 AM

i have an initial QVD load as below:

LIB CONNECT TO 'ABC Hive';
Source:
LOAD id,
content,
xdate;
SQL SELECT id,
content,
xdate
FROM HIVE.`lap_uat`.`test_qvd`;
store Source into [lib://QDF/XXX/UAT/test.qvd];

exit script;

And my incremental load script is as below:

LIB CONNECT TO 'ABC Hive';


test:
LOAD id,
content,
xdate;
SQL SELECT id,
content,
xdate
FROM HIVE.`lap_uat`.`test_qvd`;
Where xdate>'$(vLastExecTime)'; 
left join
LOAD *
FROM [lib://QDF_LOYALTY/ENR/UAT/test.qvd]
(qvd);
where not exists (id);
store test into [lib://QDF/XXX/UAT/test.qvd];

exit script;

As the table is like below i cannot load the data the newly added one cannot be loaded:

I checked all solved incremental load threads here, but I dont understand the problem. Could you please help me on that? 

Regards,

Tommy,

[HeshamKhja1]

How are you calculating the vLastExecTime variable?

[tommyl]

Hi,

in every load, i stored the execution time in a variable at the end of the load script.

I fixed the problem though. It was a general time format problem.

thanks,