Overwriting data with INCREMENTAL LOAD

[#1]

Hi,

I am trying to do an incremental load from a SQL data warehouse to a QVD. I have the QVD with all the historical data and I run the query to the DWH extracting only the new data correctly. The problem is that when concatenating the QVD historical with the SQL new one , the new data overwrites the old one. This is my script:

MyData:
LOAD
session_id;
SQL SELECT session_id
FROM dw.f_sessions
WHERE bot_fk='35' AND session_id > $(lastSessionID);
Concatenate
LOAD session_id
FROM QVDS\incremental\sessions.qvd (qvd);
STORE MyData
FROM sessionsINTO QVDS\incremental\sessions.qvd;

[#2]

Hi,

You can try this,

MyData:
LOAD
 session_id;
SQL SELECT session_id
FROM dw.f_sessions
WHERE bot_fk='35' AND session_id > $(lastSessionID);
Concatenate (MyData)
LOAD session_id
FROM QVDS\incremental\sessions.qvd (qvd);
STORE MyData INTO QVDS\incremental\sessions.qvd;

[#3]

Thanks a lot Fernando, it worked

Regards

[#4]

Available, only select the forum discussion as resolved.