16 Replies Latest reply: Oct 20, 2017 5:15 AM by Robert Dräger RSS

    QlikSense - Load Script - Adding Large XML files

    Arnaldo Sandoval

      mto

      We are experiencing serious issues with QlikSense when trying to add large XML files to its loader script; look at the picture below; with Qlik Sense the looping (busy) cursor (the circle in the middle) sits there, any attempt to do anything is ignored by Qlik Sense, the user frustration is high, and become higher when running the script (the application was originally written in QlikView) when the script freezes.

       

      I just tried the same XML file with QlikView, and we were able to open, select/de-select tables and columns in less that 60 seconds !!! and we generate the QVDs yesterday using the original QlikView QVD Creator; it took less than 40 minutes.

       

      Qlik Sense freezes!

       

      The size of the XML file is 115,367 KB.

       

      Michael, we need assistance with this issue, anything you can suggest will be appreciated; with QlikSense we already change the way the script loads data from these XML files.

      QS_Sample.png

       

      QV_Sample.png

        • Re: QlikSense - Load Script - Adding Large XML files
          Michael Tarallo

          Hello Arnaldo,

           

          • Do you have a support contract with Qlik?
          • Do you get support from a 3rd party partner?

           

          If the above is yes - please contact them directly to get support for this, but I will attempt to help you as well.

           

          What version and edition of Qlik Sense?  - Enterprise Server? September 2017? - Is it the latest version?

           

          If you are using a previous version, can you please download the latest Qlik Sense Desktop and attempt to load the XML file locally on another machine? - Just to rule out any previous known issues that might have been fixed in the September 2017 release.

           

          I will do some research here to see if I come up with anything.

           

           

          When applicable please mark the appropriate replies as CORRECT. This will help community members and Qlik Employees know which discussions have already been addressed and have a possible known solution. Please mark threads as HELPFUL if the provided solution is helpful to the problem, but does not necessarily solve the indicated problem. You can mark multiple threads as HELPFUL if you feel additional info is useful to others.

           

          Regards,

           

          Michael Tarallo (@mtarallo) | Twitter

          Qlik

            • Re: QlikSense - Load Script - Adding Large XML files
              Arnaldo Sandoval

              Update:

               

              1. We created a brand new Qlik Sense Application, selecting the first XML file, and included all its tables into the script (It was not possible to select just the offending table, as it keeps freezing )
              2. We ran the script with all the tables on-board, it freeze.
              3. It worked once we commented out all the tables before/after the offending table!
              4. We added an alias before the LOAD/FROM statement, like RouteVariantPoint: but it did not like it, freezing while loading it.
            • Re: QlikSense - Load Script - Adding Large XML files
              Arnaldo Sandoval

              Hi Michael mto

               

              Thanks for your reply, yes we are receiving assistance from our supplier, their questions are similar to yours!

               

              This is a summary:

              • It is happening in four workstations, e.g. three PCs with the users and my laptop.
              • Those PCs are high level specs, with RAM between 16 and 32 Gb, and plenty of disk space, hosting QS Desktop Jun-2017
              • The data is stored on a network drive, but we already tried on the local C:\Temp folder, no improvement.
              • My laptop is 16 Gb RAM with plenty of disk as well, hosting QS Desktop version Sep-2017 (The latest QS version)
              • We haven't run the Qlik Sense application in the QSE Server.
                • Re: QlikSense - Load Script - Adding Large XML files
                  Michael Tarallo

                  Hi Arnaldo - let me being in daz in on this thread - perhaps he can help us troubleshoot. Also please updated us with what your supplier has found as well. If your supplier is working with someone at Qlik, please let us know so we do not duplicate efforts.

                   

                  Thanks

                   

                  Mike

                    • Re: QlikSense - Load Script - Adding Large XML files
                      Arnaldo Sandoval

                      Thanks Michael,

                       

                      We will keep you posted with our supplier directions.

                       

                      Let's add more info regarding this issue:

                      1. The QVD Creator Application was originally written in QlikView.
                      2. It loops through a folder containing many XML files (32 files at this moment)
                      3. Each XML file contains several tables: 24 tables
                      4. QlikView took 45 minutes (or near 45 minutes) looping through all the XML files, creating 24 QVDs in the process.

                       

                      1. We converted the application to QlikSense (few months ago).
                      2. The application does not have User Interface, it was a matter of converting the script.
                      3. QlikSense struggles started right away. It was unable to build 24 QVDs while looping through 32 XML files.
                      4. By struggles, we mean the QlikSense QVD Creator process was freezing randomly, never on the same file/record.
                      5. We suggested the user/developer to split the LOOP into 24 loops, one per table, it helped, but we are stuck with one of the loops, giving us a hard time.

                       

                      Focusing the offending table (RouteVariantPoint):

                      QV_Offending_Issue.png

                      Commenting the last three columns allowed the process to move further, up to the third or fourth XML table before freezing.

                        • Re: QlikSense - Load Script - Adding Large XML files
                          Rob Wunderlich

                          You show a snippet here, but are you loading multiple xml tables in the script?

                           

                          I notice the fields you are commenting out are the generated keys.  Gererally when using generated keys from multiple xml files in a loop, you need  to use unique Key field names for each file, like this:

                           

                          FileBasename() & %Key_TransPort_operations... as %Key_Transport  //etc

                           

                          I don't know if this will help, but if it's taking 45 minutes for QV I suspect there is a lot of key craziness going on. Can you post the document log?

                           

                           

                          -Rob

                          http://masterssummit.com

                          http://qlikviewcookbook.com

                            • Re: QlikSense - Load Script - Adding Large XML files
                              Arnaldo Sandoval

                              Thanks Rob rwunderlich

                               

                              Nothing is happening before the loop shown in the snippet, everything was commented out; the loop is expected to read 32 XML files, each one of them containing the table: RouteVariantPoint, the process freeze on the first XML file (before commenting the last 3 columns), and on the third XML file after we commented them. NOTE: The process never freeze on the same record.

                               

                              Two log files attached, the first one before commenting %Key columns; second one after commenting them.

                               

                              Sorry: I can't post the log files to this reply, I post w/o attachment, and I will try to attach to the original post.

                                • Re: QlikSense - Load Script - Adding Large XML files
                                  Arnaldo Sandoval

                                  First log file, w/o commenting the %Key columns

                                  2017-10-16 16:40:07      Execution started.

                                  2017-10-16 16:40:07      Qlik Sense Server Version     12.34.11

                                  2017-10-16 16:40:07      CPU Target                    x64

                                  2017-10-16 16:40:07      Operating System              Windows 8.1 Pro with Media Center  (64 bit edition)

                                  2017-10-16 16:40:07      Wow64 mode                    Not using Wow64

                                  2017-10-16 16:40:07      Language                      0c09 English English

                                  2017-10-16 16:40:07      Country                       AUS Australia Australia

                                  2017-10-16 16:40:07      MDAC Version                  6.3.9600.16384

                                  2017-10-16 16:40:07      MDAC Full Install Version     6.3.9600.16384

                                  2017-10-16 16:40:07      PreferredCompression          2

                                  2017-10-16 16:40:07      EnableParallelReload          1

                                  2017-10-16 16:40:07      ParallelizeQvdLoads           1

                                  2017-10-16 16:40:07      EnableFlushLog                0

                                  2017-10-16 16:40:07      UserLogfileCharset            65001

                                  2017-10-16 16:40:07      OdbcLoginTimeout              -1

                                  2017-10-16 16:40:07      OdbcConnectionTimeout         -1

                                  2017-10-16 16:40:07      LongestPossibleLine           1048576

                                  2017-10-16 16:40:07      ScriptWantsDbWrite            false

                                  2017-10-16 16:40:07      ScriptWantsExe                false

                                  2017-10-16 16:40:07      LogFile CodePage Used:        65001

                                  2017-10-16 16:40:07      UseMemoryFillPattern          1

                                  2017-10-16 16:40:07      ScriptMode                    Legacy (gives greater system access) (aka qv11 mode)

                                  2017-10-16 16:40:07      SequentialThreadCount         26

                                  2017-10-16 16:40:07      NumberOfCores (effective)     8

                                  2017-10-16 16:40:07      ReloadCodebase                Bnf

                                  2017-10-16 16:40:07      Reload Executed By            Personal\Me

                                  2017-10-16 16:40:07      Process Executing             Qlik Sense Server

                                  2017-10-16 16:40:07      Process ID                    8764

                                  2017-10-16 16:40:07 0002 SET ThousandSep=','

                                  2017-10-16 16:40:07 0003 SET DecimalSep='.'

                                  2017-10-16 16:40:07 0004 SET MoneyThousandSep=','

                                  2017-10-16 16:40:07 0005 SET MoneyDecimalSep='.'

                                  2017-10-16 16:40:07 0006 SET MoneyFormat='$#,##0.00;-$#,##0.00'

                                  2017-10-16 16:40:07 0007 SET TimeFormat='h:mm:ss TT'

                                  2017-10-16 16:40:07 0008 SET DateFormat='D/M/YYYY'

                                  2017-10-16 16:40:07 0009 SET TimestampFormat='D/M/YYYY h:mm:ss[.fff] TT'

                                  2017-10-16 16:40:07 0010 SET FirstWeekDay=6

                                  2017-10-16 16:40:07 0011 SET BrokenWeeks=1

                                  2017-10-16 16:40:07 0012 SET ReferenceDay=0

                                  2017-10-16 16:40:07 0013 SET FirstMonthOfYear=1

                                  2017-10-16 16:40:07 0014 SET CollationLocale='en-AU'

                                  2017-10-16 16:40:07 0015 SET CreateSearchIndexOnReload=1

                                  2017-10-16 16:40:07 0016 SET MonthNames='Jan.;Feb.;Mar.;Apr.;May;Jun.;Jul.;Aug.;Sep.;Oct.;Nov.;Dec.'

                                  2017-10-16 16:40:07 0017 SET LongMonthNames='January;February;March;April;May;June;July;August;September;October;November;December'

                                  2017-10-16 16:40:07 0018 SET DayNames='Mon.;Tue.;Wed.;Thu.;Fri.;Sat.;Sun.'

                                  2017-10-16 16:40:07 0019 SET LongDayNames='Monday;Tuesday;Wednesday;Thursday;Friday;Saturday;Sunday'

                                  2017-10-16 16:40:07 0228 Set vFolder = 'lib://Ext Data Todis/'

                                  2017-10-16 16:40:07 0230 for each File in filelist('lib://Ext Data Todis/'& '\*.xml')

                                    2017-10-16 16:40:07 0231 trace lib://Ext Data Todis/8896_20130923_1237_R.XML

                                    2017-10-16 16:40:07 0231 lib://Ext Data Todis/8896_20130923_1237_R.XML

                                    2017-10-16 16:40:07 0232

                                    2017-10-16 16:40:07 0232 RouteVariantPoint:

                                    2017-10-16 16:40:07 0233 LOAD

                                    2017-10-16 16:40:07 0234     SeqNumber

                                   

                                   

                                  as SeqNumber_RouteVariantPoint,

                                    2017-10-16 16:40:07 0235     RouteVariantContractId

                                   

                                   

                                  as RouteVariantContractId_RouteVariantPoint,

                                    2017-10-16 16:40:07 0236     RouteVariantRouteId

                                   

                                   

                                  as RouteVariantRouteId_RouteVariantPoint,

                                    2017-10-16 16:40:07 0237     RouteVariantNumber

                                   

                                   

                                  as RouteVariantNumber_RouteVariantPoint,

                                    2017-10-16 16:40:07 0238     ActivationDate

                                   

                                   

                                  as ActivationDate_RouteVariantPoint,

                                    2017-10-16 16:40:07 0239     Distance

                                   

                                   

                                  as Distance_RouteVariantPoint,

                                    2017-10-16 16:40:07 0240     TimingPointId

                                   

                                   

                                  as TimingPointId_RouteVariantPoint,

                                    2017-10-16 16:40:07 0241     TimingPointDataDomainId

                                   

                                   

                                  as TimingPointDataDomainId_RouteVariantPoint,

                                    2017-10-16 16:40:07 0242     TransitStopTSN

                                   

                                   

                                  as TransitStopTSN_RouteVariantPoint,

                                    2017-10-16 16:40:07 0243     WayPointDataDomainId

                                   

                                   

                                  as WayPointDataDomainId_RouteVariantPoint,

                                    2017-10-16 16:40:07 0244     WayPointId

                                   

                                   

                                      as WayPointId_RouteVariantPoint,

                                    2017-10-16 16:40:07 0245     %Key_Transport_Operations_Data_78305DABD99AD219,

                                    2017-10-16 16:40:07 0246     %Key_RouteVariantPoint_7BE54807D4791390,

                                    2017-10-16 16:40:07 0247     'lib://Ext Data Todis/8896_20130923_1237_R.XML'

                                   

                                   

                                  as source_file_RouteVariantPoint

                                    2017-10-16 16:40:07 0248 FROM [lib://Ext Data Todis/8896_20130923_1237_R.XML]

                                    2017-10-16 16:40:07 0249 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

                                  • Re: QlikSense - Load Script - Adding Large XML files
                                    Arnaldo Sandoval

                                    This is the second log file, this one we excluded the columns starting with %Key_

                                     

                                    2017-10-16 17:10:51      Execution started.

                                    2017-10-16 17:10:51      Qlik Sense Server Version     12.34.11

                                    2017-10-16 17:10:51      CPU Target                    x64

                                    2017-10-16 17:10:51      Operating System              Windows 8.1 Pro with Media Center  (64 bit edition)

                                    2017-10-16 17:10:51      Wow64 mode                    Not using Wow64

                                    2017-10-16 17:10:51      Language                      0c09 English English

                                    2017-10-16 17:10:51      Country                       AUS Australia Australia

                                    2017-10-16 17:10:51      MDAC Version                  6.3.9600.16384

                                    2017-10-16 17:10:51      MDAC Full Install Version     6.3.9600.16384

                                    2017-10-16 17:10:51      PreferredCompression          2

                                    2017-10-16 17:10:51      EnableParallelReload          1

                                    2017-10-16 17:10:51      ParallelizeQvdLoads           1

                                    2017-10-16 17:10:51      EnableFlushLog                0

                                    2017-10-16 17:10:51      UserLogfileCharset            65001

                                    2017-10-16 17:10:51      OdbcLoginTimeout              -1

                                    2017-10-16 17:10:51      OdbcConnectionTimeout         -1

                                    2017-10-16 17:10:51      LongestPossibleLine           1048576

                                    2017-10-16 17:10:51      ScriptWantsDbWrite            false

                                    2017-10-16 17:10:51      ScriptWantsExe                false

                                    2017-10-16 17:10:51      LogFile CodePage Used:        65001

                                    2017-10-16 17:10:51      UseMemoryFillPattern          1

                                    2017-10-16 17:10:51      ScriptMode                    Legacy (gives greater system access) (aka qv11 mode)

                                    2017-10-16 17:10:51      SequentialThreadCount         26

                                    2017-10-16 17:10:51      NumberOfCores (effective)     8

                                    2017-10-16 17:10:51      ReloadCodebase                Bnf

                                    2017-10-16 17:10:51      Reload Executed By            Personal\Me

                                    2017-10-16 17:10:51      Process Executing             Qlik Sense Server

                                    2017-10-16 17:10:51      Process ID                    8764

                                    2017-10-16 17:10:51 0002 SET ThousandSep=','

                                    2017-10-16 17:10:51 0003 SET DecimalSep='.'

                                    2017-10-16 17:10:51 0004 SET MoneyThousandSep=','

                                    2017-10-16 17:10:51 0005 SET MoneyDecimalSep='.'

                                    2017-10-16 17:10:51 0006 SET MoneyFormat='$#,##0.00;-$#,##0.00'

                                    2017-10-16 17:10:51 0007 SET TimeFormat='h:mm:ss TT'

                                    2017-10-16 17:10:51 0008 SET DateFormat='D/M/YYYY'

                                    2017-10-16 17:10:51 0009 SET TimestampFormat='D/M/YYYY h:mm:ss[.fff] TT'

                                    2017-10-16 17:10:51 0010 SET FirstWeekDay=6

                                    2017-10-16 17:10:51 0011 SET BrokenWeeks=1

                                    2017-10-16 17:10:51 0012 SET ReferenceDay=0

                                    2017-10-16 17:10:51 0013 SET FirstMonthOfYear=1

                                    2017-10-16 17:10:51 0014 SET CollationLocale='en-AU'

                                    2017-10-16 17:10:51 0015 SET CreateSearchIndexOnReload=1

                                    2017-10-16 17:10:51 0016 SET MonthNames='Jan.;Feb.;Mar.;Apr.;May;Jun.;Jul.;Aug.;Sep.;Oct.;Nov.;Dec.'

                                    2017-10-16 17:10:51 0017 SET LongMonthNames='January;February;March;April;May;June;July;August;September;October;November;December'

                                    2017-10-16 17:10:51 0018 SET DayNames='Mon.;Tue.;Wed.;Thu.;Fri.;Sat.;Sun.'

                                    2017-10-16 17:10:51 0019 SET LongDayNames='Monday;Tuesday;Wednesday;Thursday;Friday;Saturday;Sunday'

                                    2017-10-16 17:10:51 0228 Set vFolder = 'lib://Ext Data Todis/'

                                    2017-10-16 17:10:51 0230 for each File in filelist('lib://Ext Data Todis/'& '\*.xml')

                                      2017-10-16 17:10:51 0231 trace lib://Ext Data Todis/8896_20130923_1237_R.XML

                                      2017-10-16 17:10:51 0231 lib://Ext Data Todis/8896_20130923_1237_R.XML

                                      2017-10-16 17:10:51 0232

                                      2017-10-16 17:10:51 0232 RouteVariantPoint:

                                      2017-10-16 17:10:51 0233 LOAD

                                      2017-10-16 17:10:51 0234     SeqNumber

                                     

                                     

                                    as SeqNumber_RouteVariantPoint,

                                      2017-10-16 17:10:51 0235     RouteVariantContractId

                                     

                                     

                                    as RouteVariantContractId_RouteVariantPoint,

                                      2017-10-16 17:10:51 0236     RouteVariantRouteId

                                     

                                     

                                    as RouteVariantRouteId_RouteVariantPoint,

                                      2017-10-16 17:10:51 0237     RouteVariantNumber

                                     

                                     

                                    as RouteVariantNumber_RouteVariantPoint,

                                      2017-10-16 17:10:51 0238     ActivationDate

                                     

                                     

                                    as ActivationDate_RouteVariantPoint,

                                      2017-10-16 17:10:51 0239     Distance

                                     

                                     

                                    as Distance_RouteVariantPoint,

                                      2017-10-16 17:10:51 0240     TimingPointId

                                     

                                     

                                    as TimingPointId_RouteVariantPoint,

                                      2017-10-16 17:10:51 0241     TimingPointDataDomainId

                                     

                                     

                                    as TimingPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:10:51 0242     TransitStopTSN

                                     

                                     

                                    as TransitStopTSN_RouteVariantPoint,

                                      2017-10-16 17:10:51 0243     WayPointDataDomainId

                                     

                                     

                                    as WayPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:10:51 0244     WayPointId

                                     

                                     

                                        as WayPointId_RouteVariantPoint,

                                      2017-10-16 17:10:51 0245     'lib://Ext Data Todis/8896_20130923_1237_R.XML'

                                     

                                     

                                    as source_file_RouteVariantPoint

                                      2017-10-16 17:10:51 0246 FROM [lib://Ext Data Todis/8896_20130923_1237_R.XML]

                                      2017-10-16 17:10:51 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

                                      2017-10-16 17:10:59      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

                                     

                                     

                                    RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

                                     

                                     

                                    TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

                                     

                                     

                                    WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

                                      2017-10-16 17:10:59      325,003 lines fetched

                                      2017-10-16 17:10:59 0250 trace done

                                      2017-10-16 17:10:59 0250 done

                                      2017-10-16 17:10:59 0251

                                    2017-10-16 17:10:59 0251 next File

                                      2017-10-16 17:10:59 0231 trace lib://Ext Data Todis/8896_20130923_1243_S.XML

                                      2017-10-16 17:10:59 0231 lib://Ext Data Todis/8896_20130923_1243_S.XML

                                      2017-10-16 17:10:59 0232

                                      2017-10-16 17:10:59 0232 RouteVariantPoint:

                                      2017-10-16 17:10:59 0233 LOAD

                                      2017-10-16 17:10:59 0234     SeqNumber

                                     

                                     

                                    as SeqNumber_RouteVariantPoint,

                                      2017-10-16 17:10:59 0235     RouteVariantContractId

                                     

                                     

                                    as RouteVariantContractId_RouteVariantPoint,

                                      2017-10-16 17:10:59 0236     RouteVariantRouteId

                                     

                                     

                                    as RouteVariantRouteId_RouteVariantPoint,

                                      2017-10-16 17:10:59 0237     RouteVariantNumber

                                     

                                     

                                    as RouteVariantNumber_RouteVariantPoint,

                                      2017-10-16 17:10:59 0238     ActivationDate

                                     

                                     

                                    as ActivationDate_RouteVariantPoint,

                                      2017-10-16 17:10:59 0239     Distance

                                     

                                     

                                    as Distance_RouteVariantPoint,

                                      2017-10-16 17:10:59 0240     TimingPointId

                                     

                                     

                                    as TimingPointId_RouteVariantPoint,

                                      2017-10-16 17:10:59 0241     TimingPointDataDomainId

                                     

                                     

                                    as TimingPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:10:59 0242     TransitStopTSN

                                     

                                     

                                    as TransitStopTSN_RouteVariantPoint,

                                      2017-10-16 17:10:59 0243     WayPointDataDomainId

                                     

                                     

                                    as WayPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:10:59 0244     WayPointId

                                     

                                     

                                        as WayPointId_RouteVariantPoint,

                                      2017-10-16 17:10:59 0245     'lib://Ext Data Todis/8896_20130923_1243_S.XML'

                                     

                                     

                                    as source_file_RouteVariantPoint

                                      2017-10-16 17:10:59 0246 FROM [lib://Ext Data Todis/8896_20130923_1243_S.XML]

                                      2017-10-16 17:10:59 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

                                      2017-10-16 17:10:59      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

                                     

                                     

                                    RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

                                     

                                     

                                    TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

                                     

                                     

                                    WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

                                      2017-10-16 17:10:59      325,003 lines fetched

                                      2017-10-16 17:10:59 0250 trace done

                                      2017-10-16 17:10:59 0250 done

                                      2017-10-16 17:10:59 0251

                                    2017-10-16 17:10:59 0251 next File

                                      2017-10-16 17:10:59 0231 trace lib://Ext Data Todis/8896_20131012_1142_R.XML

                                      2017-10-16 17:10:59 0231 lib://Ext Data Todis/8896_20131012_1142_R.XML

                                      2017-10-16 17:10:59 0232

                                      2017-10-16 17:10:59 0232 RouteVariantPoint:

                                      2017-10-16 17:10:59 0233 LOAD

                                      2017-10-16 17:10:59 0234     SeqNumber

                                     

                                     

                                    as SeqNumber_RouteVariantPoint,

                                      2017-10-16 17:10:59 0235     RouteVariantContractId

                                     

                                     

                                    as RouteVariantContractId_RouteVariantPoint,

                                      2017-10-16 17:10:59 0236     RouteVariantRouteId

                                     

                                     

                                    as RouteVariantRouteId_RouteVariantPoint,

                                      2017-10-16 17:10:59 0237     RouteVariantNumber

                                     

                                     

                                    as RouteVariantNumber_RouteVariantPoint,

                                      2017-10-16 17:10:59 0238     ActivationDate

                                     

                                     

                                    as ActivationDate_RouteVariantPoint,

                                      2017-10-16 17:10:59 0239     Distance

                                     

                                     

                                    as Distance_RouteVariantPoint,

                                      2017-10-16 17:10:59 0240     TimingPointId

                                     

                                     

                                    as TimingPointId_RouteVariantPoint,

                                      2017-10-16 17:10:59 0241     TimingPointDataDomainId

                                     

                                     

                                    as TimingPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:10:59 0242     TransitStopTSN

                                     

                                     

                                    as TransitStopTSN_RouteVariantPoint,

                                      2017-10-16 17:10:59 0243     WayPointDataDomainId

                                     

                                     

                                    as WayPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:10:59 0244     WayPointId

                                     

                                     

                                        as WayPointId_RouteVariantPoint,

                                      2017-10-16 17:10:59 0245     'lib://Ext Data Todis/8896_20131012_1142_R.XML'

                                     

                                     

                                    as source_file_RouteVariantPoint

                                      2017-10-16 17:10:59 0246 FROM [lib://Ext Data Todis/8896_20131012_1142_R.XML]

                                      2017-10-16 17:10:59 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

                                      2017-10-16 17:11:06      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

                                     

                                     

                                    RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

                                     

                                     

                                    TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

                                     

                                     

                                    WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

                                      2017-10-16 17:11:06      648,865 lines fetched

                                      2017-10-16 17:11:06 0250 trace done

                                      2017-10-16 17:11:06 0250 done

                                      2017-10-16 17:11:06 0251

                                    2017-10-16 17:11:06 0251 next File

                                      2017-10-16 17:11:06 0231 trace lib://Ext Data Todis/8896_20131012_1150_S.XML

                                      2017-10-16 17:11:06 0231 lib://Ext Data Todis/8896_20131012_1150_S.XML

                                      2017-10-16 17:11:06 0232

                                      2017-10-16 17:11:06 0232 RouteVariantPoint:

                                      2017-10-16 17:11:06 0233 LOAD

                                      2017-10-16 17:11:06 0234     SeqNumber

                                     

                                     

                                    as SeqNumber_RouteVariantPoint,

                                      2017-10-16 17:11:06 0235     RouteVariantContractId

                                     

                                     

                                    as RouteVariantContractId_RouteVariantPoint,

                                      2017-10-16 17:11:06 0236     RouteVariantRouteId

                                     

                                     

                                    as RouteVariantRouteId_RouteVariantPoint,

                                      2017-10-16 17:11:06 0237     RouteVariantNumber

                                     

                                     

                                    as RouteVariantNumber_RouteVariantPoint,

                                      2017-10-16 17:11:06 0238     ActivationDate

                                     

                                     

                                    as ActivationDate_RouteVariantPoint,

                                      2017-10-16 17:11:06 0239     Distance

                                     

                                     

                                    as Distance_RouteVariantPoint,

                                      2017-10-16 17:11:06 0240     TimingPointId

                                     

                                     

                                    as TimingPointId_RouteVariantPoint,

                                      2017-10-16 17:11:06 0241     TimingPointDataDomainId

                                     

                                     

                                    as TimingPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:11:06 0242     TransitStopTSN

                                     

                                     

                                    as TransitStopTSN_RouteVariantPoint,

                                      2017-10-16 17:11:06 0243     WayPointDataDomainId

                                     

                                     

                                    as WayPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:11:06 0244     WayPointId

                                     

                                     

                                        as WayPointId_RouteVariantPoint,

                                      2017-10-16 17:11:06 0245     'lib://Ext Data Todis/8896_20131012_1150_S.XML'

                                     

                                     

                                    as source_file_RouteVariantPoint

                                      2017-10-16 17:11:06 0246 FROM [lib://Ext Data Todis/8896_20131012_1150_S.XML]

                                      2017-10-16 17:11:06 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

                                      2017-10-16 17:11:07      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

                                     

                                     

                                    RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

                                     

                                     

                                    TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

                                     

                                     

                                    WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

                                      2017-10-16 17:11:07      648,865 lines fetched

                                      2017-10-16 17:11:07 0250 trace done

                                      2017-10-16 17:11:07 0250 done

                                      2017-10-16 17:11:07 0251

                                    2017-10-16 17:11:07 0251 next File

                                      2017-10-16 17:11:07 0231 trace lib://Ext Data Todis/8896_20131212_1930_R.XML

                                      2017-10-16 17:11:07 0231 lib://Ext Data Todis/8896_20131212_1930_R.XML

                                      2017-10-16 17:11:07 0232

                                      2017-10-16 17:11:07 0232 RouteVariantPoint:

                                      2017-10-16 17:11:07 0233 LOAD

                                      2017-10-16 17:11:07 0234     SeqNumber

                                     

                                     

                                    as SeqNumber_RouteVariantPoint,

                                      2017-10-16 17:11:07 0235     RouteVariantContractId

                                     

                                     

                                    as RouteVariantContractId_RouteVariantPoint,

                                      2017-10-16 17:11:07 0236     RouteVariantRouteId

                                     

                                     

                                    as RouteVariantRouteId_RouteVariantPoint,

                                      2017-10-16 17:11:07 0237     RouteVariantNumber

                                     

                                     

                                    as RouteVariantNumber_RouteVariantPoint,

                                      2017-10-16 17:11:07 0238     ActivationDate

                                     

                                     

                                    as ActivationDate_RouteVariantPoint,

                                      2017-10-16 17:11:07 0239     Distance

                                     

                                     

                                    as Distance_RouteVariantPoint,

                                      2017-10-16 17:11:07 0240     TimingPointId

                                     

                                     

                                    as TimingPointId_RouteVariantPoint,

                                      2017-10-16 17:11:07 0241     TimingPointDataDomainId

                                     

                                     

                                    as TimingPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:11:07 0242     TransitStopTSN

                                     

                                     

                                    as TransitStopTSN_RouteVariantPoint,

                                      2017-10-16 17:11:07 0243     WayPointDataDomainId

                                     

                                     

                                    as WayPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:11:07 0244     WayPointId

                                     

                                     

                                        as WayPointId_RouteVariantPoint,

                                      2017-10-16 17:11:07 0245     'lib://Ext Data Todis/8896_20131212_1930_R.XML'

                                     

                                     

                                    as source_file_RouteVariantPoint

                                      2017-10-16 17:11:07 0246 FROM [lib://Ext Data Todis/8896_20131212_1930_R.XML]

                                      2017-10-16 17:11:07 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

                                      2017-10-16 17:11:11      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

                                     

                                     

                                    RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

                                     

                                     

                                    TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

                                     

                                     

                                    WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

                                      2017-10-16 17:11:11      763,885 lines fetched

                                      2017-10-16 17:11:11 0250 trace done

                                      2017-10-16 17:11:11 0250 done

                                      2017-10-16 17:11:11 0251

                                    2017-10-16 17:11:11 0251 next File

                                      2017-10-16 17:11:11 0231 trace lib://Ext Data Todis/8896_20131212_1945_S.XML

                                      2017-10-16 17:11:11 0231 lib://Ext Data Todis/8896_20131212_1945_S.XML

                                      2017-10-16 17:11:11 0232

                                      2017-10-16 17:11:11 0232 RouteVariantPoint:

                                      2017-10-16 17:11:11 0233 LOAD

                                      2017-10-16 17:11:11 0234     SeqNumber

                                     

                                     

                                    as SeqNumber_RouteVariantPoint,

                                      2017-10-16 17:11:11 0235     RouteVariantContractId

                                     

                                     

                                    as RouteVariantContractId_RouteVariantPoint,

                                      2017-10-16 17:11:11 0236     RouteVariantRouteId

                                     

                                     

                                    as RouteVariantRouteId_RouteVariantPoint,

                                      2017-10-16 17:11:11 0237     RouteVariantNumber

                                     

                                     

                                    as RouteVariantNumber_RouteVariantPoint,

                                      2017-10-16 17:11:11 0238     ActivationDate

                                     

                                     

                                    as ActivationDate_RouteVariantPoint,

                                      2017-10-16 17:11:11 0239     Distance

                                     

                                     

                                    as Distance_RouteVariantPoint,

                                      2017-10-16 17:11:11 0240     TimingPointId

                                     

                                     

                                    as TimingPointId_RouteVariantPoint,

                                      2017-10-16 17:11:11 0241     TimingPointDataDomainId

                                     

                                     

                                    as TimingPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:11:11 0242     TransitStopTSN

                                     

                                     

                                    as TransitStopTSN_RouteVariantPoint,

                                      2017-10-16 17:11:11 0243     WayPointDataDomainId

                                     

                                     

                                    as WayPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:11:11 0244     WayPointId

                                     

                                     

                                        as WayPointId_RouteVariantPoint,

                                      2017-10-16 17:11:11 0245     'lib://Ext Data Todis/8896_20131212_1945_S.XML'

                                     

                                     

                                    as source_file_RouteVariantPoint

                                      2017-10-16 17:11:11 0246 FROM [lib://Ext Data Todis/8896_20131212_1945_S.XML]

                                      2017-10-16 17:11:11 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

                                      2017-10-16 17:11:11      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

                                     

                                     

                                    RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

                                     

                                     

                                    TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

                                     

                                     

                                    WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

                                      2017-10-16 17:11:11      763,885 lines fetched

                                      2017-10-16 17:11:11 0250 trace done

                                      2017-10-16 17:11:11 0250 done

                                      2017-10-16 17:11:11 0251

                                    2017-10-16 17:11:11 0251 next File

                                      2017-10-16 17:11:11 0231 trace lib://Ext Data Todis/8896_20131219_1920_R.XML

                                      2017-10-16 17:11:11 0231 lib://Ext Data Todis/8896_20131219_1920_R.XML

                                      2017-10-16 17:11:11 0232

                                      2017-10-16 17:11:11 0232 RouteVariantPoint:

                                      2017-10-16 17:11:11 0233 LOAD

                                      2017-10-16 17:11:11 0234     SeqNumber

                                     

                                     

                                    as SeqNumber_RouteVariantPoint,

                                      2017-10-16 17:11:11 0235     RouteVariantContractId

                                     

                                     

                                    as RouteVariantContractId_RouteVariantPoint,

                                      2017-10-16 17:11:11 0236     RouteVariantRouteId

                                     

                                     

                                    as RouteVariantRouteId_RouteVariantPoint,

                                      2017-10-16 17:11:11 0237     RouteVariantNumber

                                     

                                     

                                    as RouteVariantNumber_RouteVariantPoint,

                                      2017-10-16 17:11:11 0238     ActivationDate

                                     

                                     

                                    as ActivationDate_RouteVariantPoint,

                                      2017-10-16 17:11:11 0239     Distance

                                     

                                     

                                    as Distance_RouteVariantPoint,

                                      2017-10-16 17:11:11 0240     TimingPointId

                                     

                                     

                                    as TimingPointId_RouteVariantPoint,

                                      2017-10-16 17:11:11 0241     TimingPointDataDomainId

                                     

                                     

                                    as TimingPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:11:11 0242     TransitStopTSN

                                     

                                     

                                    as TransitStopTSN_RouteVariantPoint,

                                      2017-10-16 17:11:11 0243     WayPointDataDomainId

                                     

                                     

                                    as WayPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:11:11 0244     WayPointId

                                     

                                     

                                        as WayPointId_RouteVariantPoint,

                                      2017-10-16 17:11:11 0245     'lib://Ext Data Todis/8896_20131219_1920_R.XML'

                                     

                                     

                                    as source_file_RouteVariantPoint

                                      2017-10-16 17:11:11 0246 FROM [lib://Ext Data Todis/8896_20131219_1920_R.XML]

                                      2017-10-16 17:11:11 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

                                      2017-10-16 17:11:15      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

                                     

                                     

                                    RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

                                     

                                     

                                    TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

                                     

                                     

                                    WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

                                      2017-10-16 17:11:15      878,905 lines fetched

                                      2017-10-16 17:11:15 0250 trace done

                                      2017-10-16 17:11:15 0250 done

                                      2017-10-16 17:11:15 0251

                                    2017-10-16 17:11:15 0251 next File

                                      2017-10-16 17:11:15 0231 trace lib://Ext Data Todis/8896_20131219_1939_S.XML

                                      2017-10-16 17:11:15 0231 lib://Ext Data Todis/8896_20131219_1939_S.XML

                                      2017-10-16 17:11:15 0232

                                      2017-10-16 17:11:15 0232 RouteVariantPoint:

                                      2017-10-16 17:11:15 0233 LOAD

                                      2017-10-16 17:11:15 0234     SeqNumber

                                     

                                     

                                    as SeqNumber_RouteVariantPoint,

                                      2017-10-16 17:11:15 0235     RouteVariantContractId

                                     

                                     

                                    as RouteVariantContractId_RouteVariantPoint,

                                      2017-10-16 17:11:15 0236     RouteVariantRouteId

                                     

                                     

                                    as RouteVariantRouteId_RouteVariantPoint,

                                      2017-10-16 17:11:15 0237     RouteVariantNumber

                                     

                                     

                                    as RouteVariantNumber_RouteVariantPoint,

                                      2017-10-16 17:11:15 0238     ActivationDate

                                     

                                     

                                    as ActivationDate_RouteVariantPoint,

                                      2017-10-16 17:11:15 0239     Distance

                                     

                                     

                                    as Distance_RouteVariantPoint,

                                      2017-10-16 17:11:15 0240     TimingPointId

                                     

                                     

                                    as TimingPointId_RouteVariantPoint,

                                      2017-10-16 17:11:15 0241     TimingPointDataDomainId

                                     

                                     

                                    as TimingPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:11:15 0242     TransitStopTSN

                                     

                                     

                                    as TransitStopTSN_RouteVariantPoint,

                                      2017-10-16 17:11:15 0243     WayPointDataDomainId

                                     

                                     

                                    as WayPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:11:15 0244     WayPointId

                                     

                                     

                                        as WayPointId_RouteVariantPoint,

                                      2017-10-16 17:11:15 0245     'lib://Ext Data Todis/8896_20131219_1939_S.XML'

                                     

                                     

                                    as source_file_RouteVariantPoint

                                      2017-10-16 17:11:15 0246 FROM [lib://Ext Data Todis/8896_20131219_1939_S.XML]

                                      2017-10-16 17:11:15 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

                                      2017-10-16 17:11:15      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

                                     

                                     

                                    RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

                                     

                                     

                                    TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

                                     

                                     

                                    WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

                                      2017-10-16 17:11:15      878,905 lines fetched

                                      2017-10-16 17:11:15 0250 trace done

                                      2017-10-16 17:11:15 0250 done

                                      2017-10-16 17:11:15 0251

                                    2017-10-16 17:11:15 0251 next File

                                      2017-10-16 17:11:15 0231 trace lib://Ext Data Todis/8896_20140314_0305_R.XML

                                      2017-10-16 17:11:15 0231 lib://Ext Data Todis/8896_20140314_0305_R.XML

                                      2017-10-16 17:11:15 0232

                                      2017-10-16 17:11:15 0232 RouteVariantPoint:

                                      2017-10-16 17:11:15 0233 LOAD

                                      2017-10-16 17:11:15 0234     SeqNumber

                                     

                                     

                                    as SeqNumber_RouteVariantPoint,

                                      2017-10-16 17:11:15 0235     RouteVariantContractId

                                     

                                     

                                    as RouteVariantContractId_RouteVariantPoint,

                                      2017-10-16 17:11:15 0236     RouteVariantRouteId

                                     

                                     

                                    as RouteVariantRouteId_RouteVariantPoint,

                                      2017-10-16 17:11:15 0237     RouteVariantNumber

                                     

                                     

                                    as RouteVariantNumber_RouteVariantPoint,

                                      2017-10-16 17:11:15 0238     ActivationDate

                                     

                                     

                                    as ActivationDate_RouteVariantPoint,

                                      2017-10-16 17:11:15 0239     Distance

                                     

                                     

                                    as Distance_RouteVariantPoint,

                                      2017-10-16 17:11:15 0240     TimingPointId

                                     

                                     

                                    as TimingPointId_RouteVariantPoint,

                                      2017-10-16 17:11:15 0241     TimingPointDataDomainId

                                     

                                     

                                    as TimingPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:11:15 0242     TransitStopTSN

                                     

                                     

                                    as TransitStopTSN_RouteVariantPoint,

                                      2017-10-16 17:11:15 0243     WayPointDataDomainId

                                     

                                     

                                    as WayPointDataDomainId_RouteVariantPoint,

                                      2017-10-16 17:11:15 0244     WayPointId

                                     

                                     

                                        as WayPointId_RouteVariantPoint,

                                      2017-10-16 17:11:15 0245     'lib://Ext Data Todis/8896_20140314_0305_R.XML'

                                     

                                     

                                    as source_file_RouteVariantPoint

                                      2017-10-16 17:11:15 0246 FROM [lib://Ext Data Todis/8896_20140314_0305_R.XML]

                                      2017-10-16 17:11:15 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

                                    • Re: QlikSense - Load Script - Adding Large XML files
                                      Arnaldo Sandoval

                                      This is an update:

                                       

                                      G’Day All,

                                       

                                      This is an update regarding this issue that could shed some light:

                                       

                                      1. I create a brand new QlikSense application, selecting all the tables from the first XML file (QS did not allow to select a single table)
                                      2. The script does not have a LOOP.
                                      3. Its first run freeze at the offending table: RouteVariantPoint
                                      4. We commented out everything before and after the section loading RouteVariantPoint, no dramas.
                                      5. Then, we added an alias before the LOAD, like this:

                                       

                                      RouteVariantPoint:

                                      LOAD

                                       

                                      The process froze!!!

                                       

                                      • It seems the alias has something to do with the issue, but it breaks when the for/loop is re-introduced.
                                        • Re: QlikSense - Load Script - Adding Large XML files
                                          Robert Dräger

                                          Arnaldo,

                                           

                                          I have created a tiny test application and can confirm that the error occurs later if the table doesn't have an alias. It does, however, still occur.

                                           

                                          This is my script:

                                          set a = 1;
                                          
                                          do while a < 5000
                                          
                                          
                                          [Content]:
                                          LOAD [Line]
                                           FROM [lib://Source/test.xml]
                                          (XmlSimple, table is Content);
                                          
                                          let a= a+1;
                                          
                                          loop

                                          and this my xml-file:

                                          <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
                                          <Content>
                                               <Line>Hello World</Line>
                                          </Content>
                                          

                                          whith the Alias, the script stops within the first 300 records, without within the first 3000 records.

                                           

                                          I guess, we'll have to wait for a bug fix by Qlik.

                                           

                                          Cheers,

                                          Robert

                                            • Re: QlikSense - Load Script - Adding Large XML files
                                              Rob Wunderlich

                                              Hi Robert,

                                               

                                              I ran your test script without problem in QS Desktop Sept 2017 release.  Did you test in desktop or server?

                                               

                                              -Rob

                                              • Re: QlikSense - Load Script - Adding Large XML files
                                                Arnaldo Sandoval

                                                Hi Robert,

                                                 

                                                I ran the test 31 times, it failed 3 times (I uploaded my test notes); I am using: Qlik Sense Desktop September 2017: 11.14.3; Its first run was a failure but I did not record the number of loops done, it failed again after adding a simple UI, 24 tests later it failed by the third time, this time I was running Outlook Rules and dragging XL to the second screen. The reason to be running Outlook Rules is because I was running them earlier, near the time I started these tests.

                                                 

                                                My laptop is running Windows 8, with 16 GB RAM, Intel i7 @ 2.50 GHz

                                                QS-XML-File-Robert-Tests.png

                                                  • Re: QlikSense - Load Script - Adding Large XML files
                                                    Rob Wunderlich

                                                    I ran it a few more times and got it to hang intermittently.  Can't see what the pattern may be yet.

                                                     

                                                    -Rob

                                                      • Re: QlikSense - Load Script - Adding Large XML files
                                                        Robert Dräger

                                                        I can't see a pattern, either. Originally, we encountered the issue using the Qlik Deployment Framework (QDF), which relies heavily on reading QVD-metadata. On some development machines the process stopped every other run and on others the issue only occured a few times.

                                                        At first I thought, that it was some type of deadlock, because of something like that:

                                                        [$(vL.QDF.QVTableName)]:
                                                        LOAD 
                                                            ...
                                                            QvdTableName('$(vL.QDF.filelist)')   as QVTableName,
                                                            ...
                                                            [CreatorDoc] as QVTableCreator
                                                            FROM [$(vL.QDF.filelist)] (XmlSimple, Table is [QvdTableHeader]);     
                                                        

                                                        because QvdTableName also reads the file that the load statement loads. Therefore I refactored those statements but the error still occured.

                                                         

                                                        The support told me that there is a new XML Parser being developed for the next release and hopefully the issue will be solved then.

                                                         

                                                        Cheers,

                                                        Robert

                                                    • Re: QlikSense - Load Script - Adding Large XML files
                                                      Arnaldo Sandoval

                                                      Keeping everyone up to date.

                                                       

                                                      Tests Done Yesterday:

                                                      • Our local Qlik Supplier suggested to disable the ProhibitDTD parameter in the Settings.ini file, so we added the line:

                                                              ProhibitDTD=0;

                                                       

                                                      • The QlikSense Application loading the tables from just the first XML is now loading the first 12 tables before the one causing the freeze, which is also loaded, the approach has been re-introducing a table to the script, running the script between 5 to 10 times; sometimes the process hang, forcing us to close QlikSense, if the process keep hanging at a particular place we play with the alias until all work fine, and we keep going with the next table. It peculiar that once a table loads, it no longer freeze the process.