4 Replies Latest reply: Oct 18, 2017 6:41 PM by Arnaldo Sandoval RSS

    Working with XML files June-2017 version

    Arnaldo Sandoval

      Hello Qlik Community,

       

      We are experiencing very annoying behavior trying to load "large" XML files with QlikSense version June-2017, as describe:

       

      We are trying to load 30 XML files, each one of these XML contains several tables, our script loops through each one of these XML files, triggering the LOAD statement targeting just one of the tables in the XML file; as we illustrate below, our target table is Tx, we loop over all the XML file loading Tx.

       

      The names of the columns within these XML are very verbose (e.g. very long names, 10-20 characters long).

       

      Our issue is the load script, stops at a random row when loading Tx from the File-01.XML (first file on the list), we renamed it to File-01.XM (just for the loop to exclude it), the load script managed to process 5 or 6 File-0x.XML then stop again!

       

      The load script is not stopping at the same row each time.

       

      The workstation running the process has 32 Gb RAM. The file Tx in this particular scenario has on average 300K rows

       

      We are open to suggestions!!!!

       

      NOTE:

      This load script was running beautifully with QlikView, we do not have QlikView any more as we upgrade to QlikSense a while back.

       

      A Generic way to visually our load script:

      File-01.XML ==> t1, t2, t3, t4, t5, ... .Tx.. ... t19

      File-02.XML ==> t1, t2, t3, t4, t5, ... .Tx. ... t19

      File-03.XML ==> t1, t2, t3, t4, t5, ... .Tx.. ... t19

      ..

      ..

      FILE-2x.XML ==> t1, t2, t3, t4, t5, ... ... ... t19

       

      We hope somebody could help us, we cannot change the structure of these XML files as they are a requirement.

       

      Thanks in advance!