Re: QlikSense - Load Script - Adding Large XML fil... - Qlik Community

ArnadoSandoval · ‎2017-10-13

We are experiencing serious issues with QlikSense when trying to add large XML files to its loader script; look at the picture below; with Qlik Sense the looping (busy) cursor (the circle in the middle) sits there, any attempt to do anything is ignored by Qlik Sense, the user frustration is high, and become higher when running the script (the application was originally written in QlikView) when the script freezes.

I just tried the same XML file with QlikView, and we were able to open, select/de-select tables and columns in less that 60 seconds !!! and we generate the QVDs yesterday using the original QlikView QVD Creator; it took less than 40 minutes.

Qlik Sense freezes!

The size of the XML file is 115,367 KB.

Michael, we need assistance with this issue, anything you can suggest will be appreciated; with QlikSense we already change the way the script loads data from these XML files.

Arnaldo Sandoval
A journey of a thousand miles begins with a single step.

Michael_Tarallo · ‎2017-10-13

Hello Arnaldo,

Do you have a support contract with Qlik?
Do you get support from a 3rd party partner?

If the above is yes - please contact them directly to get support for this, but I will attempt to help you as well.

What version and edition of Qlik Sense? - Enterprise Server? September 2017? - Is it the latest version?

If you are using a previous version, can you please download the latest Qlik Sense Desktop and attempt to load the XML file locally on another machine? - Just to rule out any previous known issues that might have been fixed in the September 2017 release.

I will do some research here to see if I come up with anything.

When applicable please mark the appropriate replies as CORRECT. This will help community members and Qlik Employees know which discussions have already been addressed and have a possible known solution. Please mark threads as HELPFUL if the provided solution is helpful to the problem, but does not necessarily solve the indicated problem. You can mark multiple threads as HELPFUL if you feel additional info is useful to others.

Regards,

Michael Tarallo (@mtarallo) | Twitter

Qlik

Regards,
Mike Tarallo
Qlik

ArnadoSandoval · ‎2017-10-16

Hi Michael mto‌

Thanks for your reply, yes we are receiving assistance from our supplier, their questions are similar to yours!

This is a summary:

It is happening in four workstations, e.g. three PCs with the users and my laptop.
Those PCs are high level specs, with RAM between 16 and 32 Gb, and plenty of disk space, hosting QS Desktop Jun-2017
The data is stored on a network drive, but we already tried on the local C:\Temp folder, no improvement.
My laptop is 16 Gb RAM with plenty of disk as well, hosting QS Desktop version Sep-2017 (The latest QS version)
We haven't run the Qlik Sense application in the QSE Server.

Arnaldo Sandoval
A journey of a thousand miles begins with a single step.

Michael_Tarallo · ‎2017-10-16

Hi Arnaldo - let me being in daz‌ in on this thread - perhaps he can help us troubleshoot. Also please updated us with what your supplier has found as well. If your supplier is working with someone at Qlik, please let us know so we do not duplicate efforts.

Thanks

Mike

Regards,
Mike Tarallo
Qlik

ArnadoSandoval · ‎2017-10-16

Thanks Michael,

We will keep you posted with our supplier directions.

Let's add more info regarding this issue:

The QVD Creator Application was originally written in QlikView.
It loops through a folder containing many XML files (32 files at this moment)
Each XML file contains several tables: 24 tables
QlikView took 45 minutes (or near 45 minutes) looping through all the XML files, creating 24 QVDs in the process.

We converted the application to QlikSense (few months ago).
The application does not have User Interface, it was a matter of converting the script.
QlikSense struggles started right away. It was unable to build 24 QVDs while looping through 32 XML files.
By struggles, we mean the QlikSense QVD Creator process was freezing randomly, never on the same file/record.
We suggested the user/developer to split the LOOP into 24 loops, one per table, it helped, but we are stuck with one of the loops, giving us a hard time.

Focusing the offending table (RouteVariantPoint):

Commenting the last three columns allowed the process to move further, up to the third or fourth XML table before freezing.

Arnaldo Sandoval
A journey of a thousand miles begins with a single step.

rwunderlich · ‎2017-10-16

You show a snippet here, but are you loading multiple xml tables in the script?

I notice the fields you are commenting out are the generated keys. Gererally when using generated keys from multiple xml files in a loop, you need to use unique Key field names for each file, like this:

FileBasename() & %Key_TransPort_operations... as %Key_Transport //etc

I don't know if this will help, but if it's taking 45 minutes for QV I suspect there is a lot of key craziness going on. Can you post the document log?

-Rob

http://masterssummit.com

http://qlikviewcookbook.com

ArnadoSandoval · ‎2017-10-16

Thanks Rob rwunderlich‌

Nothing is happening before the loop shown in the snippet, everything was commented out; the loop is expected to read 32 XML files, each one of them containing the table: RouteVariantPoint, the process freeze on the first XML file (before commenting the last 3 columns), and on the third XML file after we commented them. NOTE: The process never freeze on the same record.

Two log files attached, the first one before commenting %Key columns; second one after commenting them.

Sorry: I can't post the log files to this reply, I post w/o attachment, and I will try to attach to the original post.

Arnaldo Sandoval
A journey of a thousand miles begins with a single step.

ArnadoSandoval · ‎2017-10-16

First log file, w/o commenting the %Key columns

2017-10-16 16:40:07      Execution started.

2017-10-16 16:40:07      Qlik Sense Server Version     12.34.11

2017-10-16 16:40:07      CPU Target                    x64

2017-10-16 16:40:07      Operating System              Windows 8.1 Pro with Media Center (64 bit edition)

2017-10-16 16:40:07      Wow64 mode                    Not using Wow64

2017-10-16 16:40:07      Language                      0c09 English English

2017-10-16 16:40:07      Country                       AUS Australia Australia

2017-10-16 16:40:07      MDAC Version                  6.3.9600.16384

2017-10-16 16:40:07      MDAC Full Install Version     6.3.9600.16384

2017-10-16 16:40:07      PreferredCompression          2

2017-10-16 16:40:07      EnableParallelReload          1

2017-10-16 16:40:07      ParallelizeQvdLoads           1

2017-10-16 16:40:07      EnableFlushLog                0

2017-10-16 16:40:07      UserLogfileCharset            65001

2017-10-16 16:40:07      OdbcLoginTimeout              -1

2017-10-16 16:40:07      OdbcConnectionTimeout         -1

2017-10-16 16:40:07      LongestPossibleLine           1048576

2017-10-16 16:40:07      ScriptWantsDbWrite            false

2017-10-16 16:40:07      ScriptWantsExe                false

2017-10-16 16:40:07      LogFile CodePage Used:        65001

2017-10-16 16:40:07      UseMemoryFillPattern          1

2017-10-16 16:40:07      ScriptMode                    Legacy (gives greater system access) (aka qv11 mode)

2017-10-16 16:40:07      SequentialThreadCount         26

2017-10-16 16:40:07      NumberOfCores (effective)     8

2017-10-16 16:40:07      ReloadCodebase                Bnf

2017-10-16 16:40:07      Reload Executed By            Personal\Me

2017-10-16 16:40:07      Process Executing             Qlik Sense Server

2017-10-16 16:40:07      Process ID                    8764

2017-10-16 16:40:07 0002 SET ThousandSep=','

2017-10-16 16:40:07 0003 SET DecimalSep='.'

2017-10-16 16:40:07 0004 SET MoneyThousandSep=','

2017-10-16 16:40:07 0005 SET MoneyDecimalSep='.'

2017-10-16 16:40:07 0006 SET MoneyFormat='$#,##0.00;-$#,##0.00'

2017-10-16 16:40:07 0007 SET TimeFormat='h:mm:ss TT'

2017-10-16 16:40:07 0008 SET DateFormat='D/M/YYYY'

2017-10-16 16:40:07 0009 SET TimestampFormat='D/M/YYYY h:mm:ss[.fff] TT'

2017-10-16 16:40:07 0010 SET FirstWeekDay=6

2017-10-16 16:40:07 0011 SET BrokenWeeks=1

2017-10-16 16:40:07 0012 SET ReferenceDay=0

2017-10-16 16:40:07 0013 SET FirstMonthOfYear=1

2017-10-16 16:40:07 0014 SET CollationLocale='en-AU'

2017-10-16 16:40:07 0015 SET CreateSearchIndexOnReload=1

2017-10-16 16:40:07 0016 SET MonthNames='Jan.;Feb.;Mar.;Apr.;May;Jun.;Jul.;Aug.;Sep.;Oct.;Nov.;Dec.'

2017-10-16 16:40:07 0017 SET LongMonthNames='January;February;March;April;May;June;July;August;September;October;November;December'

2017-10-16 16:40:07 0018 SET DayNames='Mon.;Tue.;Wed.;Thu.;Fri.;Sat.;Sun.'

2017-10-16 16:40:07 0019 SET LongDayNames='Monday;Tuesday;Wednesday;Thursday;Friday;Saturday;Sunday'

2017-10-16 16:40:07 0228 Set vFolder = 'lib://Ext Data Todis/'

2017-10-16 16:40:07 0230 for each File in filelist('lib://Ext Data Todis/'& '\*.xml')

2017-10-16 16:40:07 0231 trace lib://Ext Data Todis/8896_20130923_1237_R.XML

2017-10-16 16:40:07 0231 lib://Ext Data Todis/8896_20130923_1237_R.XML

2017-10-16 16:40:07 0232

2017-10-16 16:40:07 0232 RouteVariantPoint:

2017-10-16 16:40:07 0233 LOAD

2017-10-16 16:40:07 0234     SeqNumber

as SeqNumber_RouteVariantPoint,

2017-10-16 16:40:07 0235     RouteVariantContractId

as RouteVariantContractId_RouteVariantPoint,

2017-10-16 16:40:07 0236     RouteVariantRouteId

as RouteVariantRouteId_RouteVariantPoint,

2017-10-16 16:40:07 0237     RouteVariantNumber

as RouteVariantNumber_RouteVariantPoint,

2017-10-16 16:40:07 0238     ActivationDate

as ActivationDate_RouteVariantPoint,

2017-10-16 16:40:07 0239     Distance

as Distance_RouteVariantPoint,

2017-10-16 16:40:07 0240     TimingPointId

as TimingPointId_RouteVariantPoint,

2017-10-16 16:40:07 0241     TimingPointDataDomainId

as TimingPointDataDomainId_RouteVariantPoint,

2017-10-16 16:40:07 0242     TransitStopTSN

as TransitStopTSN_RouteVariantPoint,

2017-10-16 16:40:07 0243     WayPointDataDomainId

as WayPointDataDomainId_RouteVariantPoint,

2017-10-16 16:40:07 0244     WayPointId

    as WayPointId_RouteVariantPoint,

2017-10-16 16:40:07 0245     %Key_Transport_Operations_Data_78305DABD99AD219,

2017-10-16 16:40:07 0246     %Key_RouteVariantPoint_7BE54807D4791390,

2017-10-16 16:40:07 0247     'lib://Ext Data Todis/8896_20130923_1237_R.XML'

as source_file_RouteVariantPoint

2017-10-16 16:40:07 0248 FROM [lib://Ext Data Todis/8896_20130923_1237_R.XML]

2017-10-16 16:40:07 0249 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

Arnaldo Sandoval
A journey of a thousand miles begins with a single step.

ArnadoSandoval · ‎2017-10-16

This is the second log file, this one we excluded the columns starting with %Key_

2017-10-16 17:10:51      Execution started.

2017-10-16 17:10:51      Qlik Sense Server Version     12.34.11

2017-10-16 17:10:51      CPU Target                    x64

2017-10-16 17:10:51      Operating System              Windows 8.1 Pro with Media Center (64 bit edition)

2017-10-16 17:10:51      Wow64 mode                    Not using Wow64

2017-10-16 17:10:51      Language                      0c09 English English

2017-10-16 17:10:51      Country                       AUS Australia Australia

2017-10-16 17:10:51      MDAC Version                  6.3.9600.16384

2017-10-16 17:10:51      MDAC Full Install Version     6.3.9600.16384

2017-10-16 17:10:51      PreferredCompression          2

2017-10-16 17:10:51      EnableParallelReload          1

2017-10-16 17:10:51      ParallelizeQvdLoads           1

2017-10-16 17:10:51      EnableFlushLog                0

2017-10-16 17:10:51      UserLogfileCharset            65001

2017-10-16 17:10:51      OdbcLoginTimeout              -1

2017-10-16 17:10:51      OdbcConnectionTimeout         -1

2017-10-16 17:10:51      LongestPossibleLine           1048576

2017-10-16 17:10:51      ScriptWantsDbWrite            false

2017-10-16 17:10:51      ScriptWantsExe                false

2017-10-16 17:10:51      LogFile CodePage Used:        65001

2017-10-16 17:10:51      UseMemoryFillPattern          1

2017-10-16 17:10:51      ScriptMode                    Legacy (gives greater system access) (aka qv11 mode)

2017-10-16 17:10:51      SequentialThreadCount         26

2017-10-16 17:10:51      NumberOfCores (effective)     8

2017-10-16 17:10:51      ReloadCodebase                Bnf

2017-10-16 17:10:51      Reload Executed By            Personal\Me

2017-10-16 17:10:51      Process Executing             Qlik Sense Server

2017-10-16 17:10:51      Process ID                    8764

2017-10-16 17:10:51 0002 SET ThousandSep=','

2017-10-16 17:10:51 0003 SET DecimalSep='.'

2017-10-16 17:10:51 0004 SET MoneyThousandSep=','

2017-10-16 17:10:51 0005 SET MoneyDecimalSep='.'

2017-10-16 17:10:51 0006 SET MoneyFormat='$#,##0.00;-$#,##0.00'

2017-10-16 17:10:51 0007 SET TimeFormat='h:mm:ss TT'

2017-10-16 17:10:51 0008 SET DateFormat='D/M/YYYY'

2017-10-16 17:10:51 0009 SET TimestampFormat='D/M/YYYY h:mm:ss[.fff] TT'

2017-10-16 17:10:51 0010 SET FirstWeekDay=6

2017-10-16 17:10:51 0011 SET BrokenWeeks=1

2017-10-16 17:10:51 0012 SET ReferenceDay=0

2017-10-16 17:10:51 0013 SET FirstMonthOfYear=1

2017-10-16 17:10:51 0014 SET CollationLocale='en-AU'

2017-10-16 17:10:51 0015 SET CreateSearchIndexOnReload=1

2017-10-16 17:10:51 0016 SET MonthNames='Jan.;Feb.;Mar.;Apr.;May;Jun.;Jul.;Aug.;Sep.;Oct.;Nov.;Dec.'

2017-10-16 17:10:51 0017 SET LongMonthNames='January;February;March;April;May;June;July;August;September;October;November;December'

2017-10-16 17:10:51 0018 SET DayNames='Mon.;Tue.;Wed.;Thu.;Fri.;Sat.;Sun.'

2017-10-16 17:10:51 0019 SET LongDayNames='Monday;Tuesday;Wednesday;Thursday;Friday;Saturday;Sunday'

2017-10-16 17:10:51 0228 Set vFolder = 'lib://Ext Data Todis/'

2017-10-16 17:10:51 0230 for each File in filelist('lib://Ext Data Todis/'& '\*.xml')

2017-10-16 17:10:51 0231 trace lib://Ext Data Todis/8896_20130923_1237_R.XML

2017-10-16 17:10:51 0231 lib://Ext Data Todis/8896_20130923_1237_R.XML

2017-10-16 17:10:51 0232

2017-10-16 17:10:51 0232 RouteVariantPoint:

2017-10-16 17:10:51 0233 LOAD

2017-10-16 17:10:51 0234     SeqNumber

as SeqNumber_RouteVariantPoint,

2017-10-16 17:10:51 0235     RouteVariantContractId

as RouteVariantContractId_RouteVariantPoint,

2017-10-16 17:10:51 0236     RouteVariantRouteId

as RouteVariantRouteId_RouteVariantPoint,

2017-10-16 17:10:51 0237     RouteVariantNumber

as RouteVariantNumber_RouteVariantPoint,

2017-10-16 17:10:51 0238     ActivationDate

as ActivationDate_RouteVariantPoint,

2017-10-16 17:10:51 0239     Distance

as Distance_RouteVariantPoint,

2017-10-16 17:10:51 0240     TimingPointId

as TimingPointId_RouteVariantPoint,

2017-10-16 17:10:51 0241     TimingPointDataDomainId

as TimingPointDataDomainId_RouteVariantPoint,

2017-10-16 17:10:51 0242     TransitStopTSN

as TransitStopTSN_RouteVariantPoint,

2017-10-16 17:10:51 0243     WayPointDataDomainId

as WayPointDataDomainId_RouteVariantPoint,

2017-10-16 17:10:51 0244     WayPointId

    as WayPointId_RouteVariantPoint,

2017-10-16 17:10:51 0245     'lib://Ext Data Todis/8896_20130923_1237_R.XML'

as source_file_RouteVariantPoint

2017-10-16 17:10:51 0246 FROM [lib://Ext Data Todis/8896_20130923_1237_R.XML]

2017-10-16 17:10:51 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

2017-10-16 17:10:59      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

2017-10-16 17:10:59      325,003 lines fetched

2017-10-16 17:10:59 0250 trace done

2017-10-16 17:10:59 0250 done

2017-10-16 17:10:59 0251

2017-10-16 17:10:59 0251 next File

2017-10-16 17:10:59 0231 trace lib://Ext Data Todis/8896_20130923_1243_S.XML

2017-10-16 17:10:59 0231 lib://Ext Data Todis/8896_20130923_1243_S.XML

2017-10-16 17:10:59 0232

2017-10-16 17:10:59 0232 RouteVariantPoint:

2017-10-16 17:10:59 0233 LOAD

2017-10-16 17:10:59 0234     SeqNumber

as SeqNumber_RouteVariantPoint,

2017-10-16 17:10:59 0235     RouteVariantContractId

as RouteVariantContractId_RouteVariantPoint,

2017-10-16 17:10:59 0236     RouteVariantRouteId

as RouteVariantRouteId_RouteVariantPoint,

2017-10-16 17:10:59 0237     RouteVariantNumber

as RouteVariantNumber_RouteVariantPoint,

2017-10-16 17:10:59 0238     ActivationDate

as ActivationDate_RouteVariantPoint,

2017-10-16 17:10:59 0239     Distance

as Distance_RouteVariantPoint,

2017-10-16 17:10:59 0240     TimingPointId

as TimingPointId_RouteVariantPoint,

2017-10-16 17:10:59 0241     TimingPointDataDomainId

as TimingPointDataDomainId_RouteVariantPoint,

2017-10-16 17:10:59 0242     TransitStopTSN

as TransitStopTSN_RouteVariantPoint,

2017-10-16 17:10:59 0243     WayPointDataDomainId

as WayPointDataDomainId_RouteVariantPoint,

2017-10-16 17:10:59 0244     WayPointId

    as WayPointId_RouteVariantPoint,

2017-10-16 17:10:59 0245     'lib://Ext Data Todis/8896_20130923_1243_S.XML'

as source_file_RouteVariantPoint

2017-10-16 17:10:59 0246 FROM [lib://Ext Data Todis/8896_20130923_1243_S.XML]

2017-10-16 17:10:59 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

2017-10-16 17:10:59      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

2017-10-16 17:10:59      325,003 lines fetched

2017-10-16 17:10:59 0250 trace done

2017-10-16 17:10:59 0250 done

2017-10-16 17:10:59 0251

2017-10-16 17:10:59 0251 next File

2017-10-16 17:10:59 0231 trace lib://Ext Data Todis/8896_20131012_1142_R.XML

2017-10-16 17:10:59 0231 lib://Ext Data Todis/8896_20131012_1142_R.XML

2017-10-16 17:10:59 0232

2017-10-16 17:10:59 0232 RouteVariantPoint:

2017-10-16 17:10:59 0233 LOAD

2017-10-16 17:10:59 0234     SeqNumber

as SeqNumber_RouteVariantPoint,

2017-10-16 17:10:59 0235     RouteVariantContractId

as RouteVariantContractId_RouteVariantPoint,

2017-10-16 17:10:59 0236     RouteVariantRouteId

as RouteVariantRouteId_RouteVariantPoint,

2017-10-16 17:10:59 0237     RouteVariantNumber

as RouteVariantNumber_RouteVariantPoint,

2017-10-16 17:10:59 0238     ActivationDate

as ActivationDate_RouteVariantPoint,

2017-10-16 17:10:59 0239     Distance

as Distance_RouteVariantPoint,

2017-10-16 17:10:59 0240     TimingPointId

as TimingPointId_RouteVariantPoint,

2017-10-16 17:10:59 0241     TimingPointDataDomainId

as TimingPointDataDomainId_RouteVariantPoint,

2017-10-16 17:10:59 0242     TransitStopTSN

as TransitStopTSN_RouteVariantPoint,

2017-10-16 17:10:59 0243     WayPointDataDomainId

as WayPointDataDomainId_RouteVariantPoint,

2017-10-16 17:10:59 0244     WayPointId

    as WayPointId_RouteVariantPoint,

2017-10-16 17:10:59 0245     'lib://Ext Data Todis/8896_20131012_1142_R.XML'

as source_file_RouteVariantPoint

2017-10-16 17:10:59 0246 FROM [lib://Ext Data Todis/8896_20131012_1142_R.XML]

2017-10-16 17:10:59 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

2017-10-16 17:11:06      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

2017-10-16 17:11:06      648,865 lines fetched

2017-10-16 17:11:06 0250 trace done

2017-10-16 17:11:06 0250 done

2017-10-16 17:11:06 0251

2017-10-16 17:11:06 0251 next File

2017-10-16 17:11:06 0231 trace lib://Ext Data Todis/8896_20131012_1150_S.XML

2017-10-16 17:11:06 0231 lib://Ext Data Todis/8896_20131012_1150_S.XML

2017-10-16 17:11:06 0232

2017-10-16 17:11:06 0232 RouteVariantPoint:

2017-10-16 17:11:06 0233 LOAD

2017-10-16 17:11:06 0234     SeqNumber

as SeqNumber_RouteVariantPoint,

2017-10-16 17:11:06 0235     RouteVariantContractId

as RouteVariantContractId_RouteVariantPoint,

2017-10-16 17:11:06 0236     RouteVariantRouteId

as RouteVariantRouteId_RouteVariantPoint,

2017-10-16 17:11:06 0237     RouteVariantNumber

as RouteVariantNumber_RouteVariantPoint,

2017-10-16 17:11:06 0238     ActivationDate

as ActivationDate_RouteVariantPoint,

2017-10-16 17:11:06 0239     Distance

as Distance_RouteVariantPoint,

2017-10-16 17:11:06 0240     TimingPointId

as TimingPointId_RouteVariantPoint,

2017-10-16 17:11:06 0241     TimingPointDataDomainId

as TimingPointDataDomainId_RouteVariantPoint,

2017-10-16 17:11:06 0242     TransitStopTSN

as TransitStopTSN_RouteVariantPoint,

2017-10-16 17:11:06 0243     WayPointDataDomainId

as WayPointDataDomainId_RouteVariantPoint,

2017-10-16 17:11:06 0244     WayPointId

    as WayPointId_RouteVariantPoint,

2017-10-16 17:11:06 0245     'lib://Ext Data Todis/8896_20131012_1150_S.XML'

as source_file_RouteVariantPoint

2017-10-16 17:11:06 0246 FROM [lib://Ext Data Todis/8896_20131012_1150_S.XML]

2017-10-16 17:11:06 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

2017-10-16 17:11:07      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

2017-10-16 17:11:07      648,865 lines fetched

2017-10-16 17:11:07 0250 trace done

2017-10-16 17:11:07 0250 done

2017-10-16 17:11:07 0251

2017-10-16 17:11:07 0251 next File

2017-10-16 17:11:07 0231 trace lib://Ext Data Todis/8896_20131212_1930_R.XML

2017-10-16 17:11:07 0231 lib://Ext Data Todis/8896_20131212_1930_R.XML

2017-10-16 17:11:07 0232

2017-10-16 17:11:07 0232 RouteVariantPoint:

2017-10-16 17:11:07 0233 LOAD

2017-10-16 17:11:07 0234     SeqNumber

as SeqNumber_RouteVariantPoint,

2017-10-16 17:11:07 0235     RouteVariantContractId

as RouteVariantContractId_RouteVariantPoint,

2017-10-16 17:11:07 0236     RouteVariantRouteId

as RouteVariantRouteId_RouteVariantPoint,

2017-10-16 17:11:07 0237     RouteVariantNumber

as RouteVariantNumber_RouteVariantPoint,

2017-10-16 17:11:07 0238     ActivationDate

as ActivationDate_RouteVariantPoint,

2017-10-16 17:11:07 0239     Distance

as Distance_RouteVariantPoint,

2017-10-16 17:11:07 0240     TimingPointId

as TimingPointId_RouteVariantPoint,

2017-10-16 17:11:07 0241     TimingPointDataDomainId

as TimingPointDataDomainId_RouteVariantPoint,

2017-10-16 17:11:07 0242     TransitStopTSN

as TransitStopTSN_RouteVariantPoint,

2017-10-16 17:11:07 0243     WayPointDataDomainId

as WayPointDataDomainId_RouteVariantPoint,

2017-10-16 17:11:07 0244     WayPointId

    as WayPointId_RouteVariantPoint,

2017-10-16 17:11:07 0245     'lib://Ext Data Todis/8896_20131212_1930_R.XML'

as source_file_RouteVariantPoint

2017-10-16 17:11:07 0246 FROM [lib://Ext Data Todis/8896_20131212_1930_R.XML]

2017-10-16 17:11:07 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

2017-10-16 17:11:11      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

2017-10-16 17:11:11      763,885 lines fetched

2017-10-16 17:11:11 0250 trace done

2017-10-16 17:11:11 0250 done

2017-10-16 17:11:11 0251

2017-10-16 17:11:11 0251 next File

2017-10-16 17:11:11 0231 trace lib://Ext Data Todis/8896_20131212_1945_S.XML

2017-10-16 17:11:11 0231 lib://Ext Data Todis/8896_20131212_1945_S.XML

2017-10-16 17:11:11 0232

2017-10-16 17:11:11 0232 RouteVariantPoint:

2017-10-16 17:11:11 0233 LOAD

2017-10-16 17:11:11 0234     SeqNumber

as SeqNumber_RouteVariantPoint,

2017-10-16 17:11:11 0235     RouteVariantContractId

as RouteVariantContractId_RouteVariantPoint,

2017-10-16 17:11:11 0236     RouteVariantRouteId

as RouteVariantRouteId_RouteVariantPoint,

2017-10-16 17:11:11 0237     RouteVariantNumber

as RouteVariantNumber_RouteVariantPoint,

2017-10-16 17:11:11 0238     ActivationDate

as ActivationDate_RouteVariantPoint,

2017-10-16 17:11:11 0239     Distance

as Distance_RouteVariantPoint,

2017-10-16 17:11:11 0240     TimingPointId

as TimingPointId_RouteVariantPoint,

2017-10-16 17:11:11 0241     TimingPointDataDomainId

as TimingPointDataDomainId_RouteVariantPoint,

2017-10-16 17:11:11 0242     TransitStopTSN

as TransitStopTSN_RouteVariantPoint,

2017-10-16 17:11:11 0243     WayPointDataDomainId

as WayPointDataDomainId_RouteVariantPoint,

2017-10-16 17:11:11 0244     WayPointId

    as WayPointId_RouteVariantPoint,

2017-10-16 17:11:11 0245     'lib://Ext Data Todis/8896_20131212_1945_S.XML'

as source_file_RouteVariantPoint

2017-10-16 17:11:11 0246 FROM [lib://Ext Data Todis/8896_20131212_1945_S.XML]

2017-10-16 17:11:11 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

2017-10-16 17:11:11      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

2017-10-16 17:11:11      763,885 lines fetched

2017-10-16 17:11:11 0250 trace done

2017-10-16 17:11:11 0250 done

2017-10-16 17:11:11 0251

2017-10-16 17:11:11 0251 next File

2017-10-16 17:11:11 0231 trace lib://Ext Data Todis/8896_20131219_1920_R.XML

2017-10-16 17:11:11 0231 lib://Ext Data Todis/8896_20131219_1920_R.XML

2017-10-16 17:11:11 0232

2017-10-16 17:11:11 0232 RouteVariantPoint:

2017-10-16 17:11:11 0233 LOAD

2017-10-16 17:11:11 0234     SeqNumber

as SeqNumber_RouteVariantPoint,

2017-10-16 17:11:11 0235     RouteVariantContractId

as RouteVariantContractId_RouteVariantPoint,

2017-10-16 17:11:11 0236     RouteVariantRouteId

as RouteVariantRouteId_RouteVariantPoint,

2017-10-16 17:11:11 0237     RouteVariantNumber

as RouteVariantNumber_RouteVariantPoint,

2017-10-16 17:11:11 0238     ActivationDate

as ActivationDate_RouteVariantPoint,

2017-10-16 17:11:11 0239     Distance

as Distance_RouteVariantPoint,

2017-10-16 17:11:11 0240     TimingPointId

as TimingPointId_RouteVariantPoint,

2017-10-16 17:11:11 0241     TimingPointDataDomainId

as TimingPointDataDomainId_RouteVariantPoint,

2017-10-16 17:11:11 0242     TransitStopTSN

as TransitStopTSN_RouteVariantPoint,

2017-10-16 17:11:11 0243     WayPointDataDomainId

as WayPointDataDomainId_RouteVariantPoint,

2017-10-16 17:11:11 0244     WayPointId

    as WayPointId_RouteVariantPoint,

2017-10-16 17:11:11 0245     'lib://Ext Data Todis/8896_20131219_1920_R.XML'

as source_file_RouteVariantPoint

2017-10-16 17:11:11 0246 FROM [lib://Ext Data Todis/8896_20131219_1920_R.XML]

2017-10-16 17:11:11 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

2017-10-16 17:11:15      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

2017-10-16 17:11:15      878,905 lines fetched

2017-10-16 17:11:15 0250 trace done

2017-10-16 17:11:15 0250 done

2017-10-16 17:11:15 0251

2017-10-16 17:11:15 0251 next File

2017-10-16 17:11:15 0231 trace lib://Ext Data Todis/8896_20131219_1939_S.XML

2017-10-16 17:11:15 0231 lib://Ext Data Todis/8896_20131219_1939_S.XML

2017-10-16 17:11:15 0232

2017-10-16 17:11:15 0232 RouteVariantPoint:

2017-10-16 17:11:15 0233 LOAD

2017-10-16 17:11:15 0234     SeqNumber

as SeqNumber_RouteVariantPoint,

2017-10-16 17:11:15 0235     RouteVariantContractId

as RouteVariantContractId_RouteVariantPoint,

2017-10-16 17:11:15 0236     RouteVariantRouteId

as RouteVariantRouteId_RouteVariantPoint,

2017-10-16 17:11:15 0237     RouteVariantNumber

as RouteVariantNumber_RouteVariantPoint,

2017-10-16 17:11:15 0238     ActivationDate

as ActivationDate_RouteVariantPoint,

2017-10-16 17:11:15 0239     Distance

as Distance_RouteVariantPoint,

2017-10-16 17:11:15 0240     TimingPointId

as TimingPointId_RouteVariantPoint,

2017-10-16 17:11:15 0241     TimingPointDataDomainId

as TimingPointDataDomainId_RouteVariantPoint,

2017-10-16 17:11:15 0242     TransitStopTSN

as TransitStopTSN_RouteVariantPoint,

2017-10-16 17:11:15 0243     WayPointDataDomainId

as WayPointDataDomainId_RouteVariantPoint,

2017-10-16 17:11:15 0244     WayPointId

    as WayPointId_RouteVariantPoint,

2017-10-16 17:11:15 0245     'lib://Ext Data Todis/8896_20131219_1939_S.XML'

as source_file_RouteVariantPoint

2017-10-16 17:11:15 0246 FROM [lib://Ext Data Todis/8896_20131219_1939_S.XML]

2017-10-16 17:11:15 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

2017-10-16 17:11:15      12 fields found: SeqNumber_RouteVariantPoint, RouteVariantContractId_RouteVariantPoint,

RouteVariantRouteId_RouteVariantPoint, RouteVariantNumber_RouteVariantPoint, ActivationDate_RouteVariantPoint, Distance_RouteVariantPoint,

TimingPointId_RouteVariantPoint, TimingPointDataDomainId_RouteVariantPoint, TransitStopTSN_RouteVariantPoint,

WayPointDataDomainId_RouteVariantPoint, WayPointId_RouteVariantPoint, source_file_RouteVariantPoint,

2017-10-16 17:11:15      878,905 lines fetched

2017-10-16 17:11:15 0250 trace done

2017-10-16 17:11:15 0250 done

2017-10-16 17:11:15 0251

2017-10-16 17:11:15 0251 next File

2017-10-16 17:11:15 0231 trace lib://Ext Data Todis/8896_20140314_0305_R.XML

2017-10-16 17:11:15 0231 lib://Ext Data Todis/8896_20140314_0305_R.XML

2017-10-16 17:11:15 0232

2017-10-16 17:11:15 0232 RouteVariantPoint:

2017-10-16 17:11:15 0233 LOAD

2017-10-16 17:11:15 0234     SeqNumber

as SeqNumber_RouteVariantPoint,

2017-10-16 17:11:15 0235     RouteVariantContractId

as RouteVariantContractId_RouteVariantPoint,

2017-10-16 17:11:15 0236     RouteVariantRouteId

as RouteVariantRouteId_RouteVariantPoint,

2017-10-16 17:11:15 0237     RouteVariantNumber

as RouteVariantNumber_RouteVariantPoint,

2017-10-16 17:11:15 0238     ActivationDate

as ActivationDate_RouteVariantPoint,

2017-10-16 17:11:15 0239     Distance

as Distance_RouteVariantPoint,

2017-10-16 17:11:15 0240     TimingPointId

as TimingPointId_RouteVariantPoint,

2017-10-16 17:11:15 0241     TimingPointDataDomainId

as TimingPointDataDomainId_RouteVariantPoint,

2017-10-16 17:11:15 0242     TransitStopTSN

as TransitStopTSN_RouteVariantPoint,

2017-10-16 17:11:15 0243     WayPointDataDomainId

as WayPointDataDomainId_RouteVariantPoint,

2017-10-16 17:11:15 0244     WayPointId

    as WayPointId_RouteVariantPoint,

2017-10-16 17:11:15 0245     'lib://Ext Data Todis/8896_20140314_0305_R.XML'

as source_file_RouteVariantPoint

2017-10-16 17:11:15 0246 FROM [lib://Ext Data Todis/8896_20140314_0305_R.XML]

2017-10-16 17:11:15 0247 (XmlSimple, table is [Transport_Operations_Data/RouteVariantPoints/RouteVariantPoint])

Arnaldo Sandoval
A journey of a thousand miles begins with a single step.

ArnadoSandoval · ‎2017-10-16

Update:

We created a brand new Qlik Sense Application, selecting the first XML file, and included all its tables into the script (It was not possible to select just the offending table, as it keeps freezing )
We ran the script with all the tables on-board, it freeze.
It worked once we commented out all the tables before/after the offending table!
We added an alias before the LOAD/FROM statement, like RouteVariantPoint: but it did not like it, freezing while loading it.

Arnaldo Sandoval
A journey of a thousand miles begins with a single step.

QlikSense - Load Script - Adding Large XML files