Skip to main content
Announcements
Introducing Qlik Answers: A plug-and-play, Generative AI powered RAG solution. READ ALL ABOUT IT!
cancel
Showing results for 
Search instead for 
Did you mean: 
ioannagr
Creator III
Creator III

incremental load case

Hi all.

My initial qvd is like that: 

Table1:

load id,  

field,

lastupdate

sql select id, field, lastupdate

from [databaseconnection_table1];

right join(Table1):

//table2

load id,

result

sql select id, result

from [databaseconnection_table2];

 

NewTable1:

noconcatenate

load id, field, lastupdate, result

resident from Table

where field<>'this' and field<>'that'

drop table Table;

 

I normally would use the where exception directly before the right join in the table1 where clause, but the results are not correct so I figured I would firstly do the join, and then add the exceptions in noconcatenate.

My manager rightfully complained that the incremental load takes ages to complete, because when i implement it in the noconcatenate part, it still has to load everything from the database.

On this initital qvd, how would you implement incremental load, if the exceptions only worked that way?

1 Reply
ioannagr
Creator III
Creator III
Author

the incremental load I do is like this: 

MaxKeyLoad:
Load Max([ID]) as MaxID
from [$(vPathQVD)Table1.qvd] (qvd);

Let MaxID = Peek('MaxID', 0 , MaxKeyLoad);

Table1:

load id,  

field,

lastupdate

sql select id, field, lastupdate

from [databaseconnection_table1];

right join(Table1):

//table2

load id,

result

sql select id, result

from [databaseconnection_table2];

 

NewTable1:

noconcatenate

load id, field, lastupdate, result

resident from Table

where field<>'this' and field<>'that' and [id]>'$(MaxID)';

 

drop table Table;

Concatenate
Load * from [$(vPathQVD)Table1.qvd] (qvd);