topic Re: loading large data base in QlikView

loading large data base

paulyeo11 — Wed, 07 Aug 2013 20:20:10 GMT

Hi All

Once in a while , due to some change on certain part of my QVD generator script. and when i reload full data base , it need to take about 30 mins. and during the 30 mins i have nothing to do, getting boring ,instead of waiting for reload finish. my question is it is possible to tell QV only update certain QVD file ?

meaning update one of the QVD file which is affect by the modify of the script . it is possible ?

Paul

Re: loading large data base

sushil353 — Wed, 07 Aug 2013 20:26:09 GMT

hi,

if you have multiple qvd file to generate from single file.. then you can use if condition. like this

let qvd1=1

let qvd2=1

//now the actual script

if(qvd1=1)

load xyz

asdf

asd

asdf

from table;

exit if;

if(qvd2=1)

load xyz

sad

from table2;

exit if;

now the idea is .. if you have made any changes in script of qvd 2 and you want to load this one only then at intial level change the value of variable qvd1 =0 ..

HTH

sushil

Re: loading large data base

paulyeo11 — Wed, 07 Aug 2013 23:52:59 GMT

Hi Sir

May I know which name you prefer me to addreess you ? It is kumar ?

Thank you for your sharing,

Next question is if end of the scrip is save the QVD table. And those table I never run .... edit I have to save the QVD tabke when I finish . Okay I think you approach work fine.

Will try whwn work I will.mark a correct answer.

Sent from Samsung Mobile

Re: loading large data base

sushil353 — Thu, 08 Aug 2013 00:08:36 GMT

hi.. this is Sushil

you can cover the qvd creation steps in If condition.. since you are not running the load script then there is no point to run the qvd store statement.

HTH

Sushil

Re: loading large data base

paulyeo11 — Thu, 08 Aug 2013 01:14:54 GMT

Hi sushil

You are right I dont store QVD . One more question is my script will load sales table , supplier , debt , inventory , GL Table. And I have a portion of the script to check the min and max date and these table will then use for master calendar.

So may I know how to handle share time line script portion ? when I not run sales table . And it does not create a sales table . And share time line and master calendar need the sales table. It will have error massage.

May I know how you handle this ?

Sent from Samsung Mobile

Re: loading large data base

sushil353 — Thu, 08 Aug 2013 17:53:47 GMT

For that pupose you can use variables to put in conditions..

I would better answere if you give me some script sample ..

HTH

Sushil

Re: loading large data base

paulyeo11 — Fri, 09 Aug 2013 00:05:21 GMT

Hi Sushil

Enclosed is my script example.

In this example ,

i have to load many sales table and supplier raw data for many country , usually very large data file 400k row of record. take very long. but in the example only show one country.

it will generate 2 table , sales table and supplier.

Then i have script below i called share time line , i think this script is to check the min and max date of the 2 table. if i set condition not to run sales table script , meaning it will not generate sales table , and below script will not work. ( the reasons i skip running sales table , is my issue is i modify script on supplier. my question by using the if and else script to control it will not work.

tmp:

LOAD

min(date) AS MinDate,

max(date) AS MaxDate

RESIDENT Supplier;

CONCATENATE (tmp)

LOAD

min(date) AS MinDate,

max(date) AS MaxDate

RESIDENT sales_table;