6 Replies Latest reply: Feb 26, 2015 8:11 AM by Marco Imperiale RSS

    QlikSense Memory Issues?

    Marco Imperiale

      I try loading 8 qvd files totally 1,2GB, my PC has 8GB with 4GB available. I Can't. I get no errors and no log messages, it simply exits saying "Data are loaded. Correct the error and retry to load" (!!!!??).

      If I reduce qvd files I load correctly to the end.

       

      If I transform, my ETL script in qlikview, I load everything with no errors....

       

      Is there maybe some issue in Qliksense memory management?

        • Re: QlikSense Memory Issues?
          Florian Salfenmoser

          Just guessing

           

          .... Synthetic Keys ??

          Are those QlikView or Qlik Sense QVD´s ?

          How does your Loadscript look ? Example ?

          Are you joining Data in your script ? is there maybe a wrong join which produces a carteasian product ?

          etc. ?

           

          Please Provide more information.

            • Re: QlikSense Memory Issues?
              Marco Imperiale

              Hi and thank you,

              I'm using the script provided by QVSources examples exactly as they give for Google Analitycs Connector.

              There aren't synthetic keys, those QVD are Qlik Sense, the core of the script looks like:

               

              Main:

              Load a,b,c,d,e,f,g from .\filename*.qvd

               

              (after a long series of script lines in order to build those QVDs).

              There aren't cartesian products, and, if I copy the script in QlikView I don't have any issue.

              The mistery is the error message: "Data are loaded. Correct the error and retry to load."

                • Re: QlikSense Memory Issues?
                  Florian Salfenmoser

                  I didn´t have one of those errors in Qlik Sense yet, but i remeber those "cryptic" error messages from QlikView.

                   

                  In most of the times it hat to do with syntax failures which weren´t shown in the error messagen. For example, i didn´t have all necessary fields in a group by statement, problems with nested load statements (called a field by a wrong name etc.). Those failures didn´t produce a nice and readable error message, just an "error" like this.

                   

                  Do you drop all tables after you don´t need them anymore ?  Like tabels for transformations etc.. Did you check with Task Manager or other tools if really the RAM is the Problem ? Because if you don´t get a black screen in the end because you´re RAM is full, i don´t really think so.

              • Re: QlikSense Memory Issues?
                Jonathan Dienst

                Hi

                 

                Your load script may require more memory than the 1.2GB in your source data, depending on what you are doing in the load script. Joins will always require additional memory to construct the join and if your data set is large, this memory might be large. So I cant really much advice apart from reducing the data size (by eliminating unused fields,especially ones with a high cardinality) or reducing the scope (date range, or partitioning the model into one per region) or increasing the memory.

                 

                HTH

                Jonathan