topic Loading XML field into Qlikview from external database taking very long time in QlikView https://community.qlik.com/t5/QlikView/Loading-XML-field-into-Qlikview-from-external-database-taking/m-p/953933#M327989 <HTML><HEAD></HEAD><BODY><P>Hi,</P><P></P><P>I am trying to extract an XML field from external database.</P><P>And the extraction step takes around 1.5 hours to extract around &gt;1,580,000 rows and one column which has data in XML format.</P><P>We need only one tag's value from the XML field.</P><P>How can the reload time be reduced?</P><P>And how can we extract only the field that we are interested in (enQty tag in the below XML)?</P><P></P><P></P><P>The content of the XML field is below :</P><P>//&lt;postVEE&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;dvcIdN&gt;747237099405&lt;/dvcIdN&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;mcm&gt;1.000000&lt;/mcm&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;tz&gt;GMT&lt;/tz&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;stDt&gt;2014-08-01-00.00.00&lt;/stDt&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;stQty&gt;23.485&lt;/stQty&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;enDt&gt;2014-09-01-00.00.00&lt;/enDt&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;enQty&gt;37.512&lt;/enQty&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -- VALUE TO&nbsp; READ</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;ccond&gt;501000&lt;/ccond&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;sts/&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;msrs&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;mL&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;s&gt;1&lt;/s&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;dt&gt;2014-09-01-00.00.00&lt;/dt&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;q&gt;14.027&lt;/q&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;fc&gt;501000&lt;/fc&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;sts/&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;/mL&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;/msrs&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmwprn&gt;2284182&lt;/cmwprn&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmmiu_serial&gt;04384341&lt;/cmmiu_serial&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmmeterserial&gt;H14AU213541&lt;/cmmeterserial&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmspecial_read_flag&gt;N&lt;/cmspecial_read_flag&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmfield_investigation_flag&gt;N&lt;/cmfield_investigation_flag&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmfa_cancel_flag&gt;N&lt;/cmfa_cancel_flag&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmunit_of_measure&gt;m3&lt;/cmunit_of_measure&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmreading_datetime&gt;2014-09-01T01:00:00.000+01:00&lt;/cmreading_datetime&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmmeter_reading&gt;37.512&lt;/cmmeter_reading&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmmeter_multiplier&gt;8.3&lt;/cmmeter_multiplier&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmmeasurment_condition&gt;D1RG&lt;/cmmeasurment_condition&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmfa_remarks&gt;Successful&lt;/cmfa_remarks&gt;</P><P>//&lt;/postVEE&gt; </P></BODY></HTML> Wed, 19 Aug 2015 12:28:51 GMT mugdhaojha 2015-08-19T12:28:51Z Loading XML field into Qlikview from external database taking very long time https://community.qlik.com/t5/QlikView/Loading-XML-field-into-Qlikview-from-external-database-taking/m-p/953933#M327989 <HTML><HEAD></HEAD><BODY><P>Hi,</P><P></P><P>I am trying to extract an XML field from external database.</P><P>And the extraction step takes around 1.5 hours to extract around &gt;1,580,000 rows and one column which has data in XML format.</P><P>We need only one tag's value from the XML field.</P><P>How can the reload time be reduced?</P><P>And how can we extract only the field that we are interested in (enQty tag in the below XML)?</P><P></P><P></P><P>The content of the XML field is below :</P><P>//&lt;postVEE&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;dvcIdN&gt;747237099405&lt;/dvcIdN&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;mcm&gt;1.000000&lt;/mcm&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;tz&gt;GMT&lt;/tz&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;stDt&gt;2014-08-01-00.00.00&lt;/stDt&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;stQty&gt;23.485&lt;/stQty&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;enDt&gt;2014-09-01-00.00.00&lt;/enDt&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;enQty&gt;37.512&lt;/enQty&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -- VALUE TO&nbsp; READ</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;ccond&gt;501000&lt;/ccond&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;sts/&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;msrs&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;mL&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;s&gt;1&lt;/s&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;dt&gt;2014-09-01-00.00.00&lt;/dt&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;q&gt;14.027&lt;/q&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;fc&gt;501000&lt;/fc&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;sts/&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;/mL&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;/msrs&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmwprn&gt;2284182&lt;/cmwprn&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmmiu_serial&gt;04384341&lt;/cmmiu_serial&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmmeterserial&gt;H14AU213541&lt;/cmmeterserial&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmspecial_read_flag&gt;N&lt;/cmspecial_read_flag&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmfield_investigation_flag&gt;N&lt;/cmfield_investigation_flag&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmfa_cancel_flag&gt;N&lt;/cmfa_cancel_flag&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmunit_of_measure&gt;m3&lt;/cmunit_of_measure&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmreading_datetime&gt;2014-09-01T01:00:00.000+01:00&lt;/cmreading_datetime&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmmeter_reading&gt;37.512&lt;/cmmeter_reading&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmmeter_multiplier&gt;8.3&lt;/cmmeter_multiplier&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmmeasurment_condition&gt;D1RG&lt;/cmmeasurment_condition&gt;</P><P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; //&lt;cmfa_remarks&gt;Successful&lt;/cmfa_remarks&gt;</P><P>//&lt;/postVEE&gt; </P></BODY></HTML> Wed, 19 Aug 2015 12:28:51 GMT https://community.qlik.com/t5/QlikView/Loading-XML-field-into-Qlikview-from-external-database-taking/m-p/953933#M327989 mugdhaojha 2015-08-19T12:28:51Z Re: Loading XML field into Qlikview from external database taking very long time https://community.qlik.com/t5/QlikView/Loading-XML-field-into-Qlikview-from-external-database-taking/m-p/953934#M327990 <HTML><HEAD></HEAD><BODY><P>Where does this database reside? Is it retrieving the values that takes time or is it QlikView's parsing that is the bottleneck here?</P><P></P><P>If it is the communication between the database and QlikView that is your bottleneck then there is little you can do from a QlikView perspective to speed the read.</P></BODY></HTML> Wed, 19 Aug 2015 14:26:43 GMT https://community.qlik.com/t5/QlikView/Loading-XML-field-into-Qlikview-from-external-database-taking/m-p/953934#M327990 petter 2015-08-19T14:26:43Z