topic Re: incremental load without date fields ? in QlikView

incremental load without date fields ?

Wed, 17 Sep 2014 08:19:37 GMT

Hello everyone,

I have an application in which I load data from the database without almost any transformation and then store the tables in qvd files.

I don't have any date fields like "creating data" or "modification date". I was wondering if there was any tips to use kind of incremental load ?

Can I compare the values to the ones existing in the qvd and then add only the new lines ? But if I have to compare each record of the table to each record of the QVD, would that improve the performance ?

Thank you for your anwers

Re: incremental load without date fields ?

MK_QSL — Wed, 17 Sep 2014 08:27:49 GMT

What is the primary key in your database?

Re: incremental load without date fields ?

ashfaq_haseeb — Wed, 17 Sep 2014 08:34:56 GMT

Possible,

But atleast you need to have primary key.

Regards

ASHFAQ

Re: incremental load without date fields ?

tresB — Wed, 17 Sep 2014 08:38:51 GMT

Incremental load without timestamp

Incremental Load without date feild

Re: incremental load without date fields ?

Wed, 17 Sep 2014 09:08:21 GMT

Hello,

Yes, in each table, there is an "id".

From what I've read, I can do insert but not update ?

Re: incremental load without date fields ?

tresB — Wed, 17 Sep 2014 09:33:44 GMT

That's true. Without modification timestamp (and actually not comparing all field values -which beats the purpose of incremental load) updated records would not be possible to identify.

Re: incremental load without date fields ?

Wed, 17 Sep 2014 12:20:46 GMT

I would like to try it but I cannot find the proper syntax:

LOAD

1 as Compteur_Location,

id,

....

;

SQL SELECT *

FROM "MyTable";

where id not in

LOAD id from

Lala\MyTable.qvd

(qvd);

id is the primary key.

ANy ideas ?

Thank you

Re: incremental load without date fields ?

Wed, 17 Sep 2014 12:43:25 GMT

I have lso tried this one :

LOAD id from

MyTable.qvd

(qvd) ;

Concatenate

LOAD

1 as Compteur_Location,

id,

...

where not exists(id);

SQL SELECT *

FROM MyTable

;

But again all the table is reloaded...