topic stuck with data load 750M rows with mem768G in QlikView

stuck with data load 750M rows with mem768G

Anonymous — Wed, 25 Nov 2020 16:16:04 GMT

Now I have a data 780 Million rows with 15columns. It stucks when load until 750M rows.

It has a limitation for loading with a huge data or solution to fix the issue.

oknotsen — Thu, 16 Mar 2017 10:01:43 GMT

Qlik doesn't have this limitation.

Maybe your source does not allow for a connection to be open this long or has a maximum rows defined?

neha_shirsath — Thu, 16 Mar 2017 10:14:39 GMT

Hi Akira,

Qlikview does not have any such limitation,unless and until you have good ram and space in your qv server.

Thanks,

Neha

Anonymous — Thu, 16 Mar 2017 10:22:19 GMT

Time out is set up 6 hrs. But it stuck when load 750M to 3 hours and not loading until time out.

(ram 768G)

neha_shirsath — Thu, 16 Mar 2017 10:27:59 GMT

Set below-

Set TimeOutBatch=216000;

Set TimeOutFetch=217000;

set your respective time.

Anil_Babu_Samineni — Thu, 16 Mar 2017 10:30:32 GMT

1) Are you storing this into qvd?

2) May be you don't have space on your machine environment of that Folder.

Can you check those and reply ASAP

Anonymous — Thu, 16 Mar 2017 10:35:12 GMT

Hi Akira,

Could you please tell us what kind of a load are you performing or better yet could you post a sample script.

sasiparupudi1 — Thu, 16 Mar 2017 10:58:30 GMT

please attach your script log to understand better if it has encountered any error

Anonymous — Thu, 16 Mar 2017 11:11:11 GMT

1) I load from qvd file separte by month. I want to load data for 2years and 1quarter.

2) I have space about 150GB

Anonymous — Mon, 20 Mar 2017 04:22:37 GMT

1) I load from qvd file separte by month. I want to load data for 2years and 1quarter.

2) I have space about 150GB

Anil_Babu_Samineni — Mon, 20 Mar 2017 04:47:31 GMT

1) For this Months - 12 Months? What was the file size of each month

2) I am assuming you don't have more that 150 GB data on your Machine where this space showing