topic Re: How to Write Incremental Load scripts in SQL in QlikView

How to Write Incremental Load scripts in SQL

vikasmahajan — Mon, 30 Dec 2013 07:43:09 GMT

Dear all

We have ERP data which is very large data is there any concept in sql also to apply incremental data

while fetching data from sql .

Thanks in advance

Vikas

Re: How to Write Incremental Load scripts in SQL

sanketkhunte — Mon, 30 Dec 2013 08:14:08 GMT

Yes Vikas..

Definatly !! we do have with QLikview ..

Before applying INCREAMENTAL LOAD : You must have

- Created_Date

- Updated_Date

fields in your each database table. Just let me know do you have that fields with proper ETL logic. If yes give me one select statement for a table. I will provide you the solution.

Thank you

Sanket

Re: How to Write Incremental Load scripts in SQL

sujeetsingh — Mon, 30 Dec 2013 08:27:22 GMT

Incremental Load is one of the best feature for data model in qlikview.

I have attached a sample for it have a look .

Hope it helps you!!

Re: How to Write Incremental Load scripts in SQL

vikasmahajan — Mon, 30 Dec 2013 09:25:26 GMT

All Thanks for Reply I don't want incremental in Qlikview , But in Sql scripts only I want to tune performance

means while taking data from sql whether it is possible to apply incremental data in sql script only.

Vikas

Re: How to Write Incremental Load scripts in SQL

sanketkhunte — Mon, 30 Dec 2013 09:30:20 GMT

not any attachement. Please confirm.

Re: How to Write Incremental Load scripts in SQL

tresB — Mon, 30 Dec 2013 10:05:09 GMT

To implement incremental load, there has to be a target DB to compare with your source SQL DB. What would be that for your case? Oherwise, if you use incremental load in qv, it tunes performance because only the incremental data portion is loaded into qv. That itself is efficient. I don't see that (and not very logical too) any further improvement can be done implementing the same in SQL it self.

Re: How to Write Incremental Load scripts in SQL

Mon, 30 Dec 2013 10:23:29 GMT

You could throw your max(id) in a temptable and then load your facttable where ID > your max(id) from your temptable