15 Replies Latest reply: Sep 15, 2012 2:30 AM by MOHAMMED IRFAN GHOURI PERVEZ RSS

    Unable to add Dataflow to Development package

      Hello Community,

       

      I was trying to add SampleDataflow2 to Development package which leads me to an error message as follows:

       

      this dataflow failed to compile . please open the dataflow to fix the error

       

      please find the attached too.

       

      So, I try to run it and find it compile succeeded but failed at execution as follows    :

       

       

       

      Compile Succeeded!

       

      Executable: etask.exe

       

      Arguments:  -x SampleDataflow2 -d 1 -i 1

       

      Working Directory: C:\Users\IrfanGhori\Documents\expressor\Workspaces\Expressor_Integrate_Qlikview_Demo\Metadata\E_I_QV_Demo.0\dfp\SampleDataflow2\external

       

       

      __compat_layer = ElevateCreateProcess

      allusersprofile = C:\ProgramData

      appdata = C:\Users\IrfanGhori\AppData\Roaming

      commonprogramfiles = C:\Program Files (x86)\Common Files

      commonprogramfiles(x86) = C:\Program Files (x86)\Common Files

      commonprogramw6432 = C:\Program Files\Common Files

      computername = IRFANGHORI-PC

      comspec = C:\Windows\system32\cmd.exe

      exp_home = C:\Program Files (x86)\expressor\expressor3\

      exp_studio_running_version = 3.7.1

      exp_token = FNkerJPNUC2hwIXNiEQzAUesgnYOM6SZNrv0XM6D358=

      fp_no_host_check = NO

      homedrive = C:

      homepath = \Users\IrfanGhori

      localappdata = C:\Users\IrfanGhori\AppData\Local

      logonserver = \\IRFANGHORI-PC

      number_of_processors = 2

      os = Windows_NT

      path = C:\Program Files (x86)\expressor\expressor3\usr\lib;C:\Program Files (x86)\expressor\expressor3\lib;C:\Program Files (x86)\expressor\expressor3\usr\local\bin;C:\Program Files (x86)\expressor\expressor3\usr\bin;C:\Program Files (x86)\expressor\expressor3\bin;C:\Program Files (x86)\expressor\expressor3\Studio;C:\Program Files (x86)\expressor\expressor3\Repository\bin;C:\Program Files (x86)\expressor\expressor3\Studio\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\DTS\Binn\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Binn\;C:\Users\IrfanGhori\AppData\Local\Smartbar\Application\

      pathext = .COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC

      processor_architecture = x86

      processor_architew6432 = AMD64

      processor_identifier = Intel64 Family 6 Model 23 Stepping 10, GenuineIntel

      processor_level = 6

      processor_revision = 170a

      programdata = C:\ProgramData

      programfiles = C:\Program Files (x86)

      programfiles(x86) = C:\Program Files (x86)

      programw6432 = C:\Program Files

      psmodulepath = C:\Windows\system32\WindowsPowerShell\v1.0\Modules\

      public = C:\Users\Public

      sessionname = Console

      systemdrive = C:

      systemroot = C:\Windows

      temp = C:\Users\IRFANG~1\AppData\Local\Temp

      tmp = C:\Users\IRFANG~1\AppData\Local\Temp

      userdomain = IrfanGhori-PC

      username = IrfanGhori

      userprofile = C:\Users\IrfanGhori

      windir = C:\Windows

      windows_tracing_flags = 3

      windows_tracing_logfile = C:\BVTBin\Tests\installpackage\csilogfile.log

       

      dataflow controller - ETASK-0017-N: Using Desktop license for an unknown expressor product; resource utilization limited. (etask.controller)

      expressor dataflow execution utility (etask) 3.7.1.22531 n (Build 22531) Aug 15 2012

      <task dataflow="SampleDataflow2">

      <!-- project.home[(null)], project[..] -->

      <step id="0" step_name="Step_1" process="9648" run="0" status="ok" start="2012-09-09T14:14:27">

      Read Header File - OPERATOR-0050-F: toolId 1.0, name 'Read Header File' - Exception 'ChannelIOException' occurred in the 'initialize' function. (SampleDataflow2.Step_1)

      Read Header File - CHANNELIO-0011-A: Open failed for file 'D:\New_Demo\salesOrderHeader.txt'  - 2 (The system cannot find the file specified.). (SampleDataflow2.Step_1)

      Read Header File - OPERATOR-0003-F: toolId 1.0, name 'Read Header File' - the 'initialize' function failed. (SampleDataflow2.Step_1)

      Read Header File - ETOOL-0006-F: operator 1.0, type in-file, name 'Read Header File': etool failed, phase runInitialize. (SampleDataflow2.Step_1)

      Read Header File - ETOOL-0016-A: operator 1.0, type in-file, pid 7432 - initialize() failed. (SampleDataflow2.Step_1)

        <status>failed</status>

      </step>

      <statistic>3.380</statistic>

      </task>

      dataflow controller - ETASK-0038-F: Processing has completed abnormally. (SampleDataflow2.controller)

       

       

       

      Is it the issue because of license?

        • Re: Unable to add Dataflow to Development package
          Hugo Sheng

          The reason the dataflow failed is because it could not open the file

           

          Read Header File - CHANNELIO-0011-A: Open failed for file 'D:\New_Demo\salesOrderHeader.txt' -2 (The system cannot find the file specified.). (SampleDataflow2.Step_1)

            • Re: Unable to add Dataflow to Development package

              thanks Hugo , I fixed the issue you pin point on, But still i am unable to execute it.

               

              Now the following error occurs

               

               

              Read Header File - IN_FILE_OP-0044-N: The parsing thread was interrupted. (SampleDataflow2.Step_1)

               

              Read Header File - OPERATOR-0016-F: toolId 1.0, name 'Read Header File' - Exception 'InFileOpException' occurred in the 'process' function for thread 0. (SampleDataflow2.Step_1)

               

              Read Header File - IN_FILE_OP-0007-A: Input processing for file 'D:\New_Demo\salesOrderHeaders.txt' aborted on record 2 due to a data error. (SampleDataflow2.Step_1)

               

              Read Header File - TRANSLITERATE-1007-A: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

               

              Read Header File - OPERATOR-0005-F: toolId 1.0, name 'Read Header File' - the 'process' function failed for thread 0. (SampleDataflow2.Step_1)

               

              help me out.

                • Re: Unable to add Dataflow to Development package
                  Hugo Sheng

                  The error below suggests that your schema does not match the data it's trying to read in. 

                   

                  Read Header File - TRANSLITERATE-1007-A: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                   

                  Your SalesOrderID should be an integer, but it found what looks to be a date instead.  If the your schema is correct and the data is not, you can use the reject option in Read File to capture these offending records.  Here's a tutorial on how:

                   

                  http://community.qlik.com/docs/DOC-3333

                  http://community.qlik.com/docs/DOC-3344

                    • Re: Unable to add Dataflow to Development package

                      Hi  Hugo,

                       

                      please find the attached files.

                       

                      I try to perform the rejection process as you mention, but it leads me to the following issues:

                       

                      Read Header File - IN_FILE_OP-0009-N: Input record 2 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 3 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 4 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 5 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 6 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 7 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 8 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 9 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Details File - IN_FILE_OP-0044-N: The parsing thread was interrupted. (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 10 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 11 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 12 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 13 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 14 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 15 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 16 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 17 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 18 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 19 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 20 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Header File - IN_FILE_OP-0009-N: Input record 21 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

                      Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Details File - OPERATOR-0016-F: toolId 2.0, name 'Read Details File' - Exception 'InFileOpException' occurred in the 'process' function for thread 0. (SampleDataflow2.Step_1)

                      Read Details File - IN_FILE_OP-0007-A: Input processing for file 'D:\New_Demo\salesOrderDetail.txt' aborted on record 2 due to a data error. (SampleDataflow2.Step_1)

                      Read Details File - TRANSLITERATE-1007-A: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/01/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                      Read Details File - OPERATOR-0005-F: toolId 2.0, name 'Read Details File' - the 'process' function failed for thread 0. (SampleDataflow2.Step_1)

                        • Re: Unable to add Dataflow to Development package

                          The project files are not attached.

                            • Re: Unable to add Dataflow to Development package

                              Hi John,

                               

                               

                              I am trying to start the run the the dataflow, as illustrated bellow

                               

                              df.JPG

                               

                               

                              And get the following error message :

                               

                               

                              Compile Succeeded!

                               

                              Executable: etask.exe

                               

                              Arguments:  -x SampleDataflow2 -d 1 -i 1

                               

                              Working Directory: C:\Users\IrfanGhori\Documents\expressor\Workspaces\Expressor_Integrate_Qlikview_Demo\Metadata\E_I_QV_Demo.0\dfp\SampleDataflow2\external

                               

                               

                              __compat_layer = ElevateCreateProcess

                              allusersprofile = C:\ProgramData

                              appdata = C:\Users\IrfanGhori\AppData\Roaming

                              commonprogramfiles = C:\Program Files (x86)\Common Files

                              commonprogramfiles(x86) = C:\Program Files (x86)\Common Files

                              commonprogramw6432 = C:\Program Files\Common Files

                              computername = IRFANGHORI-PC

                              comspec = C:\Windows\system32\cmd.exe

                              exp_home = C:\Program Files (x86)\expressor\expressor3\

                              exp_studio_running_version = 3.7.1

                              exp_token = hQLtu9+fa47zGMTAl9SMRZQ44NX4wGkunDtX4Wz6gyw=

                              fp_no_host_check = NO

                              homedrive = C:

                              homepath = \Users\IrfanGhori

                              localappdata = C:\Users\IrfanGhori\AppData\Local

                              logonserver = \\IRFANGHORI-PC

                              number_of_processors = 2

                              os = Windows_NT

                              path = C:\Program Files (x86)\expressor\expressor3\usr\lib;C:\Program Files (x86)\expressor\expressor3\lib;C:\Program Files (x86)\expressor\expressor3\usr\local\bin;C:\Program Files (x86)\expressor\expressor3\usr\bin;C:\Program Files (x86)\expressor\expressor3\bin;C:\Program Files (x86)\expressor\expressor3\Studio;C:\Program Files (x86)\expressor\expressor3\Repository\bin;C:\Program Files (x86)\expressor\expressor3\Studio\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\DTS\Binn\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Binn\;C:\Users\IrfanGhori\AppData\Local\Smartbar\Application\

                              pathext = .COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC

                              processor_architecture = x86

                              processor_architew6432 = AMD64

                              processor_identifier = Intel64 Family 6 Model 23 Stepping 10, GenuineIntel

                              processor_level = 6

                              processor_revision = 170a

                              programdata = C:\ProgramData

                              programfiles = C:\Program Files (x86)

                              programfiles(x86) = C:\Program Files (x86)

                              programw6432 = C:\Program Files

                              psmodulepath = C:\Windows\system32\WindowsPowerShell\v1.0\Modules\

                              public = C:\Users\Public

                              sessionname = Console

                              systemdrive = C:

                              systemroot = C:\Windows

                              temp = C:\Users\IRFANG~1\AppData\Local\Temp

                              tmp = C:\Users\IRFANG~1\AppData\Local\Temp

                              userdomain = IrfanGhori-PC

                              username = IrfanGhori

                              userprofile = C:\Users\IrfanGhori

                              windir = C:\Windows

                              windows_tracing_flags = 3

                              windows_tracing_logfile = C:\BVTBin\Tests\installpackage\csilogfile.log

                               

                              dataflow controller - ETASK-0017-N: Using Desktop license for an unknown expressor product; resource utilization limited. (etask.controller)

                              expressor dataflow execution utility (etask) 3.7.1.22531 n (Build 22531) Aug 15 2012

                              <task dataflow="SampleDataflow2">

                              <!-- project.home[(null)], project[..] -->

                              <step id="0" step_name="Step_1" process="4084" run="0" status="ok" start="2012-09-10T15:24:55">

                              Read Details File - IN_FILE_OP-0044-N: The parsing thread was interrupted. (SampleDataflow2.Step_1)

                               

                              Read Details File - OPERATOR-0016-F: toolId 2.0, name 'Read Details File' - Exception 'InFileOpException' occurred in the 'process' function for thread 0. (SampleDataflow2.Step_1)

                               

                              Read Details File - IN_FILE_OP-0007-A: Input processing for file 'D:\New_Demo\salesOrderDetail.txt' aborted on record 2 due to a data error. (SampleDataflow2.Step_1)

                               

                              Read Details File - TRANSLITERATE-1007-A: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/01/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

                               

                              Read Details File - OPERATOR-0005-F: toolId 2.0, name 'Read Details File' - the 'process' function failed for thread 0. (SampleDataflow2.Step_1)

                               

                                <status>failed</status>

                              </step>

                              <statistic>0.595</statistic>

                              </task>

                              dataflow controller - ETASK-0038-F: Processing has completed abnormally. (SampleDataflow2.controller)

                               

                               

                              Do am I suppose to change the mapping dataformate?

                               

                              If  So then let me understand the parameters suppose to be change in the below setting.

                               

                              df1.JPG