topic Re: Optimize Data in QlikView

Optimize Data

sat_tok52 — Wed, 24 Feb 2016 08:14:50 GMT

Hi Guru's,

I am loading below table in qlikview have 20M records , when i am doing reload the below table it's taking more time to reload.

How to optimize below tables load time.

TemP:

LOAD Date,

product_group

FROM

(ooxml, embedded labels, table is Sheet1);

Left join(TemP)

LOAD product_group,

bucket

FROM

(ooxml, embedded labels, table is Sheet1);

Thanks,

Sateesh.T

Re: Optimize Data

Chanty4u — Wed, 24 Feb 2016 08:16:17 GMT

can u shre ur excel?

Re: Optimize Data

PrashantSangle — Wed, 24 Feb 2016 08:18:09 GMT

Hi,

Looks like there is issue in your joining field.

Provide xls sheet to understand issue.

Regards,

Re: Optimize Data

Chanty4u — Wed, 24 Feb 2016 08:18:54 GMT

otherwise chk here

Optimised Load with Where

Re: Optimize Data

jagan — Wed, 24 Feb 2016 08:24:02 GMT

Hi,

Instead of join use Mapping Load and ApplyMap() like below if they are one-to-one.

Product_Group_Mapping:

MAPPING LOAD product_group,

bucket

FROM

(ooxml, embedded labels, table is Sheet1)

WHERE 1 = 1;

TemP:

LOAD Date,

product_group,

ApplyMap('Product_Group_Mapping', product_group, 'N/A') AS bucket

FROM

(ooxml, embedded labels, table is Sheet1);

Hope this helps you.

Regards,

Jagan.

Re: Optimize Data

Anonymous — Wed, 24 Feb 2016 08:30:32 GMT

Hi,

I do not know how many times you need to reload but I would suggest that load that data into QVD files and then load the main app from the QVD files. QVD files should reload faster but this all depends on how often the excel file is updated

Re: Optimize Data

mightyqlikers — Wed, 24 Feb 2016 08:32:07 GMT

hi,

you can also do like

TemP:

LOAD Date,

product_group

FROM

(ooxml, embedded labels, table is Sheet1);

Left join(TemP)

LOAD product_group,

bucket

FROM

(ooxml, embedded labels, table is Sheet1)

where exists(product_group);

Regards

$@M

Re: Optimize Data

sat_tok52 — Wed, 24 Feb 2016 09:32:00 GMT

Hi Jagan,

Thanks for your response.

But it is not giving my expect result.

Thanks,

Sateesh