topic Re: Increamental Load in QlikView

Increamental Load

sunilkumarqv — Fri, 21 Feb 2014 12:51:36 GMT

These scernoirs what you send is very basic would you post somthing like sql database having multiple tables some tables are concatenated and other are remain I dont have timestamp rather that have Date.My Question is How To do update and insert for these scenarios?

Let consider these scenorios

//For Concatenated tables

TabA;

Load * From Datasource;

concatenate

TabB;

Load *From Datasource;

concatenate

TabC;

Load From Datasource;

//Normal table

TabD

Load * Datasource;

Re: Increamental Load Scenarios

Re: Increamental Load

Sat, 22 Feb 2014 20:38:08 GMT

Please post Primary Key and Timestamp or date fields (which shows the field updated or inserted) details

Re: Increamental Load

Sat, 22 Feb 2014 21:39:02 GMT

Hi Sunil,

I dont understand why you concatenate 3 times the same table as TabA. Why you are doing this? As Dathu says can you post the rules you can use to identify the rows to add or update? What is the key of this table?

Regards.

Re: Increamental Load

simsondevadoss — Sun, 23 Feb 2014 05:56:24 GMT

Hi sunil,

you need a primary key to perform incremental load.

Please find the attached document. It might be helpful to you.

Regards,

Simson

Re: Increamental Load

Anonymous — Sun, 23 Feb 2014 12:40:11 GMT

Hi Sunil,

You can use date column in source table to update or insert records.

Try to use Exist() - to update when records exist in QVD or Resident Load and source table date is greater than date in QVD for particular record.

Next use Not Exist() to insert records which do not exist in QVD or Resident Load.

You can use primary key,if you don't have date field to insert records which do not exist in already loaded data.

Re: Increamental Load

sunilkumarqv — Mon, 24 Feb 2014 05:46:43 GMT

Can you post sample script ?

Re: Increamental Load

Anonymous — Mon, 24 Feb 2014 12:21:31 GMT

Hi Sunil.

Please check below script:

MASTER:LOAD pid,
     pname,
     priceFROM

(qvd);

TEMP:LOAD MAX(pid) AS MAXPID
     Resident MASTER;
DROP Table MASTER;
LET Vmax = Peek('MAXPID',-1,'TEMP');

Sales:LOAD pid,
     pname,
     priceFROM

(ooxml, embedded labels, table is TRANSACTION) Where pid >$(Vmax);
JoinLOAD pid,
     pname,
     priceFROM

(qvd) Where NOT Exists(pid);

Re: Increamental Load

rajeshvaswani77 — Mon, 24 Feb 2014 13:18:43 GMT

Hi Sunil,

See the attachment for Incremental load scenarios in detail with examples.

thanks,

Rajesh Vaswani