topic Re: Files QVD in Connectivity & Data Prep

Files QVD

Timario — Wed, 17 Aug 2022 07:29:09 GMT

Hello to All.

I have connect to my DB, but these table without index(id).

How I can add only new rows in created qvd file?

Re: Files QVD

Or — Wed, 17 Aug 2022 09:18:18 GMT

How do you know a row is new? if it's because it doesn't match any rows in the file, you could just combine the existing qvd with the full db query and load only distinct values. Otherwise, you need something which tells you the row is new...

Re: Files QVD

Timario — Thu, 18 Aug 2022 04:12:14 GMT

If I doesn't have any signal about new rows, I should load whole file?

Re: Files QVD

Or — Thu, 18 Aug 2022 08:51:43 GMT

If there's no way to tell whether a row is new, then there's no way to do what you want. You need some sort of indicator.

Re: Files QVD

SunilChauhan — Mon, 22 Aug 2022 15:29:05 GMT

there should be some lastmodified or updateddate

you can find Max modfield date and add below to qvd as we do in incremental load

set it into a Variable ; vMaxModified

Test:

Load * from qvd;

concatenate

table:

Load * from table.QVD;

concatenate

Select * from DbTable where Lastmodifiedfield> $(vMaxModified);

Store table into table.qvd;