topic How to concatenate data into existing qvd?(memory problem) in QlikView

How to concatenate data into existing qvd?(memory problem)

Thu, 16 Feb 2012 15:52:12 GMT

Hello everyone,

Well here is my problem, I want to concatenate data of one table into an existing qvd, the thing is, its kind of to much data for our server to handle, so if we try to "LOAD" all the data we need to store, the server goes out of ram memory and die.

What we are doing is spliting the content of the table into diferent qvds, so I get for example 4 qvds with data that belongs to the same table, and we want to store all of it into the same qvd.

what I want to do is for example, read data of qvd1, and concatenate it into qvd2 without reading qvd2, is this possible?

this kind of a thing I gotta do before a we get a new server with much more ram memory.

Thanks in advance

-Jorge

How to concatenate data into existing qvd?(memory problem)

jagan — Thu, 16 Feb 2012 16:07:45 GMT

Hi,

First load the data from the QVD to table and concatenate the remaining data into table and finally save the data in Table to QVD.

Regards,

Jagan.

How to concatenate data into existing qvd?(memory problem)

Thu, 16 Feb 2012 16:23:56 GMT

Hello Jagan,

thanks a lot for your answer, I tried this, however when I concatenate data memory still crushes.

I'll keep trying, thanks again

Regards,

Jorge

How to concatenate data into existing qvd?(memory problem)

rajeshvaswani77 — Thu, 16 Feb 2012 16:23:59 GMT

Hi,

Use CONCATENATE keyword to do this,

example

LOAD

field1,

field2

FROM QVDFILE1

CONCATENATE

LOAD

field1,

field2

FROM QVDFILE2

Hope this helps

Thanks,

Rajesh Vaswani

Re: How to concatenate data into existing qvd?(memory problem)

Thu, 16 Feb 2012 16:34:08 GMT

Hello Rajesh,

I did, my script goes like this

table:

LOAD

/*fields*/

FROM

table1.qvd

(qvd);

Concatenate

LOAD

/*fields*/

FROM

table2.qvd

(qvd);

STORE table into finaltable.qvd

When loading data from the second qvd, memory crushes, what I want to do is storing data from table2, into an existing qvd1 file, without having to load it, loading will cause RAM memory to run out.

Is this possible? if not, then the only solution might be getting a suitable server with enough memory

Thanks a lot for your help

regards,

Jorge

Re: How to concatenate data into existing qvd?(memory problem)

Fri, 17 Feb 2012 09:27:24 GMT

Hi,

I believe the only way to do this is by loading all the qvds into a table.

This may be halpful

http://community.qlik.com/ideas/1960

Regards