topic Re: Incremental Load in QlikView

Incremental Load

Thu, 18 Sep 2014 08:30:27 GMT

Hi Friends,

Am try to QVD Generator Where it has two condition, If the file or Table is Exists in the generator the it should append the data or it should load full data from the database. Kindly help me with any Example where it should check automatically in load script.

Thanks in Advance

Regards,

Vignesh

Re: Incremental Load

Thu, 18 Sep 2014 08:34:51 GMT

could you make the question little bit clear, because incremental load is done based on the date field Incremental Load

Re: Incremental Load

MK_QSL — Thu, 18 Sep 2014 08:38:56 GMT

Set vFileName                    = 'QVD\File_Name.qvd';                         //Give you full path or relative path..
Let vFile                    = SubField('$(vFileName_PM_ACTION)','\',-1);
Let vFileExists        = IF(FileSize('$( vFileName)')>0,-1,0);

If $(vFileExists) Then

Incremental_Load:
LOAD * FROM $(vFileName) (qvd);

Max_Last_Changed:
Load Max(LAST_CHANGED) as Max_LAST_CHANGED Resident Incremental_Load;

Let vMax_Last_Changed = TimeStamp(PEEK('Max_LAST_CHANGED',0,'Max_Last_Changed'));

Drop Table Max_Last_Changed;
Drop Table Incremental_Load;

Final_Load:
LOAD *;
SQL SELECT * FROM APP."Table_Name"
WHERE LAST_CHANGED > to_date('$(vMax_Last_Changed)', 'DD/MM/YYYY HH24:MI:SS');

//The above LAST_CHANGED is fieldname as a DateTimeStamp and this is based on Oracle Database.. Change accordingly for //SQL Database

Concatenate(Final_Load)
LOAD * FROM QVD\File_Name.qvd(qvd)
Where Not Exists (Primary_Key);

Store Final_Load into QVD\ File_Name.qvd;

Drop Table Final_Load;

Else

Initial_Load:
LOAD *;
SQL SELECT * FROM APP."Table_Name";

Store Initial_Load into QVD\File_Name.qvd;
Drop Table Initial_Load;
ENDIF

Re: Incremental Load

Thu, 18 Sep 2014 08:42:15 GMT

I have a QVD generator File in a particular location. i do have scripted incremental load based on the Primary key of the table. And its working fine. What exactly i need is, i have to write a script in Which it should check the QVD generator file whether its existing or not. If the File is Existing it should automatically run the incremental load script if not it should run the full load script

Re: Incremental Load

Thu, 18 Sep 2014 08:45:07 GMT

Hi Manish,

I hope this would Working out. Let me try this one and let you know Manish.

Thanks for your help..

Re: Incremental Load

Thu, 18 Sep 2014 12:31:15 GMT

Hi Manish,

Thank you very much its working out.

Regards,

Vignesh