Qlik Community

New to QlikView

Discussion board where members can get started with QlikView.

Highlighted
pponyiam
New Contributor

stuck with data load 750M rows with mem768G

Now I have a data 780 Million rows with 15columns.  It stucks when load until 750M rows.

It has a limitation for loading with a huge data or solution to fix the issue.

Tags (2)
10 Replies
oknotsen
Honored Contributor III

Re: stuck with data load 750M rows with mem768G

Qlik doesn't have this limitation.

Maybe your source does not allow for a connection to be open this long or has a maximum rows defined?

May you live in interesting times!
neha_shirsath
Valued Contributor

Re: stuck with data load 750M rows with mem768G

Hi Akira,

Qlikview does not have any such limitation,unless and until you have good ram and space in your qv server.

Thanks,

Neha

pponyiam
New Contributor

Re: stuck with data load 750M rows with mem768G

Time out is set up 6 hrs. But it stuck when load 750M to 3 hours and not loading until time out.

(ram 768G)

neha_shirsath
Valued Contributor

Re: stuck with data load 750M rows with mem768G

Set below-

Set TimeOutBatch=216000;

Set TimeOutFetch=217000;

set your respective time.

Re: stuck with data load 750M rows with mem768G

1) Are you storing this into qvd?

2) May be you don't have space on your machine environment of that Folder.

Can you check those and reply ASAP

Before develop something, think If placed (The Right information | To the right people | At the Right time | In the Right place | With the Right context)
udaykiran
Contributor

Re: stuck with data load 750M rows with mem768G

Hi Akira,

Could you please tell us what kind of a load are you performing or better yet could you post a sample script.

sasiparupudi1
Honored Contributor III

Re: stuck with data load 750M rows with mem768G

please attach your script log to understand better if it has encountered any error

pponyiam
New Contributor

Re: stuck with data load 750M rows with mem768G

1) I load from qvd file separte by month. I want to load data for 2years and 1quarter.

2) I have space about 150GB

pponyiam
New Contributor

Re: stuck with data load 750M rows with mem768G

1) I load from qvd file separte by month. I want to load data for 2years and 1quarter.

2) I have space about 150GB