Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

How to concatenate data into existing qvd?(memory problem)

Hello everyone,

Well here is my problem, I want to concatenate  data of one table into an existing qvd, the thing is, its kind of to much data for our server to handle, so if we try to "LOAD" all the data we need to store, the server goes out of ram memory and die.

What we are doing is spliting the content of the table into diferent qvds, so I get for example 4 qvds with data that belongs to the same table, and we want to store all of it into the same qvd.

what I want to do is for example, read data of qvd1, and concatenate it into qvd2 without reading qvd2, is this possible?

this kind of a thing I gotta do before a we get a new server with much more ram memory.

Thanks in advance

-Jorge

5 Replies
jagan
Luminary Alumni
Luminary Alumni

Hi,

First load the data from the QVD to table and concatenate the remaining data into table and finally save the data in Table to QVD.

Regards,

Jagan.

Not applicable
Author

Hello Jagan,

thanks a lot for your answer, I tried this, however when I concatenate data memory still crushes.

I'll keep trying, thanks again

Regards,

Jorge

rajeshvaswani77
Specialist III
Specialist III

Hi,

Use CONCATENATE keyword to do this,

example

LOAD

field1,

field2

FROM QVDFILE1

CONCATENATE

LOAD

field1,

field2

FROM QVDFILE2

Hope this helps

Thanks,

Rajesh Vaswani

Not applicable
Author

Hello Rajesh,

I did, my script goes like this

table:

LOAD

   /*fields*/

FROM

   table1.qvd

(qvd);

Concatenate

LOAD

     /*fields*/

FROM

table2.qvd

(qvd);

STORE table into finaltable.qvd

When loading data from the second qvd, memory crushes, what I want to do is storing data from table2, into an existing qvd1 file, without having to load it, loading will cause RAM memory to run out.

Is this possible? if not, then the only solution might be getting  a suitable server with enough memory

Thanks a lot for your help

regards,

Jorge

Not applicable
Author

Hi,

I believe the only way to do this is by loading all the qvds into a table.

This may be halpful

http://community.qlik.com/ideas/1960

Regards