topic Data Modeling in QlikView

Data Modeling

dseelam — Thu, 17 Nov 2016 18:51:25 GMT

Hello All,

This is a totally new project for me working on inventory DB, Help ?

I have 3 views in oracle one for Item master, Customers and BOM, Am pulling them and storing them in to separate qvd's one for each day to have track of history & implemented section access for all 3 tables it is successful

everything was fine but even though I implemented section access I feel like am pulling data every day in to separate QVD which means I am almost pulling every thing again, Is there a way that I can only derive changes (inserted updated and deleted records)? and store them in separate QVD for each day ? so that I can save lot of space along with time ??

Time for reloading data directly from Oracle

after implementing section access

when I compare number of lines for each day in direct reload and incremental load it does not make any sense

Re: Data Modeling

Clever_Anjos — Thu, 17 Nov 2016 21:05:02 GMT

I usually don´t use incremental load, but "sliced".

My qvd´s usually are generated like this:

LET Dat=Date(today(),'YYYY-MM-DD');

sql

select [fields] from mytable where date_field = '$(dat)';

Store t into [$(Path)\file_t_$(Dat).qvd](qvd);

Re: Data Modeling

Clever_Anjos — Thu, 17 Nov 2016 21:06:52 GMT

Section Access is not related to QVD files, but to QVW, ok?

Re: Data Modeling

dseelam — Thu, 17 Nov 2016 21:13:13 GMT

Sorry I miss worded, it is not section access incremental loading

Re: Data Modeling

Clever_Anjos — Thu, 17 Nov 2016 21:15:09 GMT

Ok, I think your could analyze a different approach like mine

Re: Data Modeling

dseelam — Thu, 17 Nov 2016 21:15:17 GMT

I am also using same logic to pull and save data for each day, but what I am asking is you are loading same data with changes every day in diff QVD's instead of that is there any way to store only changes from 2nd day

Re: Data Modeling

hectorvega — Thu, 17 Nov 2016 23:25:29 GMT

Maybe you could use this Sub-Routine for Incremental Load | Qlik Community

This will read only new and modified records

Regards