Skip to main content
Announcements
Have questions about Qlik Connect? Join us live on April 10th, at 11 AM ET: SIGN UP NOW
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Unable to add Dataflow to Development package

Hello Community,

I was trying to add SampleDataflow2 to Development package which leads me to an error message as follows:

this dataflow failed to compile . please open the dataflow to fix the error

please find the attached too.

So, I try to run it and find it compile succeeded but failed at execution as follows    :

Compile Succeeded!

Executable: etask.exe

Arguments:  -x SampleDataflow2 -d 1 -i 1

Working Directory: C:\Users\IrfanGhori\Documents\expressor\Workspaces\Expressor_Integrate_Qlikview_Demo\Metadata\E_I_QV_Demo.0\dfp\SampleDataflow2\external

__compat_layer = ElevateCreateProcess

allusersprofile = C:\ProgramData

appdata = C:\Users\IrfanGhori\AppData\Roaming

commonprogramfiles = C:\Program Files (x86)\Common Files

commonprogramfiles(x86) = C:\Program Files (x86)\Common Files

commonprogramw6432 = C:\Program Files\Common Files

computername = IRFANGHORI-PC

comspec = C:\Windows\system32\cmd.exe

exp_home = C:\Program Files (x86)\expressor\expressor3\

exp_studio_running_version = 3.7.1

exp_token = FNkerJPNUC2hwIXNiEQzAUesgnYOM6SZNrv0XM6D358=

fp_no_host_check = NO

homedrive = C:

homepath = \Users\IrfanGhori

localappdata = C:\Users\IrfanGhori\AppData\Local

logonserver = \\IRFANGHORI-PC

number_of_processors = 2

os = Windows_NT

path = C:\Program Files (x86)\expressor\expressor3\usr\lib;C:\Program Files (x86)\expressor\expressor3\lib;C:\Program Files (x86)\expressor\expressor3\usr\local\bin;C:\Program Files (x86)\expressor\expressor3\usr\bin;C:\Program Files (x86)\expressor\expressor3\bin;C:\Program Files (x86)\expressor\expressor3\Studio;C:\Program Files (x86)\expressor\expressor3\Repository\bin;C:\Program Files (x86)\expressor\expressor3\Studio\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\DTS\Binn\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Binn\;C:\Users\IrfanGhori\AppData\Local\Smartbar\Application\

pathext = .COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC

processor_architecture = x86

processor_architew6432 = AMD64

processor_identifier = Intel64 Family 6 Model 23 Stepping 10, GenuineIntel

processor_level = 6

processor_revision = 170a

programdata = C:\ProgramData

programfiles = C:\Program Files (x86)

programfiles(x86) = C:\Program Files (x86)

programw6432 = C:\Program Files

psmodulepath = C:\Windows\system32\WindowsPowerShell\v1.0\Modules\

public = C:\Users\Public

sessionname = Console

systemdrive = C:

systemroot = C:\Windows

temp = C:\Users\IRFANG~1\AppData\Local\Temp

tmp = C:\Users\IRFANG~1\AppData\Local\Temp

userdomain = IrfanGhori-PC

username = IrfanGhori

userprofile = C:\Users\IrfanGhori

windir = C:\Windows

windows_tracing_flags = 3

windows_tracing_logfile = C:\BVTBin\Tests\installpackage\csilogfile.log

dataflow controller - ETASK-0017-N: Using Desktop license for an unknown expressor product; resource utilization limited. (etask.controller)

expressor dataflow execution utility (etask) 3.7.1.22531 n (Build 22531) Aug 15 2012

<task dataflow="SampleDataflow2">

<!-- project.home[(null)], project[..] -->

<step id="0" step_name="Step_1" process="9648" run="0" status="ok" start="2012-09-09T14:14:27">

Read Header File - OPERATOR-0050-F: toolId 1.0, name 'Read Header File' - Exception 'ChannelIOException' occurred in the 'initialize' function. (SampleDataflow2.Step_1)

Read Header File - CHANNELIO-0011-A: Open failed for file 'D:\New_Demo\salesOrderHeader.txt'  - 2 (The system cannot find the file specified.). (SampleDataflow2.Step_1)

Read Header File - OPERATOR-0003-F: toolId 1.0, name 'Read Header File' - the 'initialize' function failed. (SampleDataflow2.Step_1)

Read Header File - ETOOL-0006-F: operator 1.0, type in-file, name 'Read Header File': etool failed, phase runInitialize. (SampleDataflow2.Step_1)

Read Header File - ETOOL-0016-A: operator 1.0, type in-file, pid 7432 - initialize() failed. (SampleDataflow2.Step_1)

  <status>failed</status>

</step>

<statistic>3.380</statistic>

</task>

dataflow controller - ETASK-0038-F: Processing has completed abnormally. (SampleDataflow2.controller)

Is it the issue because of license?

1 Solution

Accepted Solutions
Not applicable
Author

This is not your error.

I've confirmed your issue and it appears that with a single attribute in the composite type, the incoming data is not being properly read.

To run the example, open the schemas used by both Read File operators and add a second attribute to the Local2 type.  It really doesn't matter what the attribute's name is, but it's easiest to simply name it the same as the second incoming field.  Leave its type as string.

schema.png

Now the dataflow will run.

View solution in original post

15 Replies
Hugo_Sheng
Employee
Employee

The reason the dataflow failed is because it could not open the file

Read Header File - CHANNELIO-0011-A: Open failed for file 'D:\New_Demo\salesOrderHeader.txt' -2 (The system cannot find the file specified.). (SampleDataflow2.Step_1)

Not applicable
Author

thanks Hugo , I fixed the issue you pin point on, But still i am unable to execute it.

Now the following error occurs

Read Header File - IN_FILE_OP-0044-N: The parsing thread was interrupted. (SampleDataflow2.Step_1)

Read Header File - OPERATOR-0016-F: toolId 1.0, name 'Read Header File' - Exception 'InFileOpException' occurred in the 'process' function for thread 0. (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0007-A: Input processing for file 'D:\New_Demo\salesOrderHeaders.txt' aborted on record 2 due to a data error. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-A: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - OPERATOR-0005-F: toolId 1.0, name 'Read Header File' - the 'process' function failed for thread 0. (SampleDataflow2.Step_1)

help me out.

Hugo_Sheng
Employee
Employee

The error below suggests that your schema does not match the data it's trying to read in. 

Read Header File - TRANSLITERATE-1007-A: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Your SalesOrderID should be an integer, but it found what looks to be a date instead.  If the your schema is correct and the data is not, you can use the reject option in Read File to capture these offending records.  Here's a tutorial on how:

http://community.qlik.com/docs/DOC-3333

http://community.qlik.com/docs/DOC-3344

Not applicable
Author

Hi  Hugo,

please find the attached files.

I try to perform the rejection process as you mention, but it leads me to the following issues:

Read Header File - IN_FILE_OP-0009-N: Input record 2 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 3 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 4 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 5 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 6 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 7 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 8 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 9 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Details File - IN_FILE_OP-0044-N: The parsing thread was interrupted. (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 10 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 11 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 12 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 13 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 14 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 15 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 16 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 17 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 18 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 19 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 20 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Header File - IN_FILE_OP-0009-N: Input record 21 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)

Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Details File - OPERATOR-0016-F: toolId 2.0, name 'Read Details File' - Exception 'InFileOpException' occurred in the 'process' function for thread 0. (SampleDataflow2.Step_1)

Read Details File - IN_FILE_OP-0007-A: Input processing for file 'D:\New_Demo\salesOrderDetail.txt' aborted on record 2 due to a data error. (SampleDataflow2.Step_1)

Read Details File - TRANSLITERATE-1007-A: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/01/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Details File - OPERATOR-0005-F: toolId 2.0, name 'Read Details File' - the 'process' function failed for thread 0. (SampleDataflow2.Step_1)

Not applicable
Author

The project files are not attached.

Not applicable
Author

Hi John,

I am trying to start the run the the dataflow, as illustrated bellow

df.JPG

And get the following error message :

 

Compile Succeeded!

Executable: etask.exe

Arguments:  -x SampleDataflow2 -d 1 -i 1

Working Directory: C:\Users\IrfanGhori\Documents\expressor\Workspaces\Expressor_Integrate_Qlikview_Demo\Metadata\E_I_QV_Demo.0\dfp\SampleDataflow2\external

__compat_layer = ElevateCreateProcess

allusersprofile = C:\ProgramData

appdata = C:\Users\IrfanGhori\AppData\Roaming

commonprogramfiles = C:\Program Files (x86)\Common Files

commonprogramfiles(x86) = C:\Program Files (x86)\Common Files

commonprogramw6432 = C:\Program Files\Common Files

computername = IRFANGHORI-PC

comspec = C:\Windows\system32\cmd.exe

exp_home = C:\Program Files (x86)\expressor\expressor3\

exp_studio_running_version = 3.7.1

exp_token = hQLtu9+fa47zGMTAl9SMRZQ44NX4wGkunDtX4Wz6gyw=

fp_no_host_check = NO

homedrive = C:

homepath = \Users\IrfanGhori

localappdata = C:\Users\IrfanGhori\AppData\Local

logonserver = \\IRFANGHORI-PC

number_of_processors = 2

os = Windows_NT

path = C:\Program Files (x86)\expressor\expressor3\usr\lib;C:\Program Files (x86)\expressor\expressor3\lib;C:\Program Files (x86)\expressor\expressor3\usr\local\bin;C:\Program Files (x86)\expressor\expressor3\usr\bin;C:\Program Files (x86)\expressor\expressor3\bin;C:\Program Files (x86)\expressor\expressor3\Studio;C:\Program Files (x86)\expressor\expressor3\Repository\bin;C:\Program Files (x86)\expressor\expressor3\Studio\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\DTS\Binn\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Binn\;C:\Users\IrfanGhori\AppData\Local\Smartbar\Application\

pathext = .COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC

processor_architecture = x86

processor_architew6432 = AMD64

processor_identifier = Intel64 Family 6 Model 23 Stepping 10, GenuineIntel

processor_level = 6

processor_revision = 170a

programdata = C:\ProgramData

programfiles = C:\Program Files (x86)

programfiles(x86) = C:\Program Files (x86)

programw6432 = C:\Program Files

psmodulepath = C:\Windows\system32\WindowsPowerShell\v1.0\Modules\

public = C:\Users\Public

sessionname = Console

systemdrive = C:

systemroot = C:\Windows

temp = C:\Users\IRFANG~1\AppData\Local\Temp

tmp = C:\Users\IRFANG~1\AppData\Local\Temp

userdomain = IrfanGhori-PC

username = IrfanGhori

userprofile = C:\Users\IrfanGhori

windir = C:\Windows

windows_tracing_flags = 3

windows_tracing_logfile = C:\BVTBin\Tests\installpackage\csilogfile.log

dataflow controller - ETASK-0017-N: Using Desktop license for an unknown expressor product; resource utilization limited. (etask.controller)

expressor dataflow execution utility (etask) 3.7.1.22531 n (Build 22531) Aug 15 2012

<task dataflow="SampleDataflow2">

<!-- project.home[(null)], project[..] -->

<step id="0" step_name="Step_1" process="4084" run="0" status="ok" start="2012-09-10T15:24:55">

Read Details File - IN_FILE_OP-0044-N: The parsing thread was interrupted. (SampleDataflow2.Step_1)

Read Details File - OPERATOR-0016-F: toolId 2.0, name 'Read Details File' - Exception 'InFileOpException' occurred in the 'process' function for thread 0. (SampleDataflow2.Step_1)

Read Details File - IN_FILE_OP-0007-A: Input processing for file 'D:\New_Demo\salesOrderDetail.txt' aborted on record 2 due to a data error. (SampleDataflow2.Step_1)

Read Details File - TRANSLITERATE-1007-A: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/01/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)

Read Details File - OPERATOR-0005-F: toolId 2.0, name 'Read Details File' - the 'process' function failed for thread 0. (SampleDataflow2.Step_1)

  <status>failed</status>

</step>

<statistic>0.595</statistic>

</task>

dataflow controller - ETASK-0038-F: Processing has completed abnormally. (SampleDataflow2.controller)

Do am I suppose to change the mapping dataformate?

If  So then let me understand the parameters suppose to be change in the below setting.

df1.JPG

Not applicable
Author

This is not your error.

I've confirmed your issue and it appears that with a single attribute in the composite type, the incoming data is not being properly read.

To run the example, open the schemas used by both Read File operators and add a second attribute to the Local2 type.  It really doesn't matter what the attribute's name is, but it's easiest to simply name it the same as the second incoming field.  Leave its type as string.

schema.png

Now the dataflow will run.

Not applicable
Author

Thanks John,

It worked.

Not applicable
Author

Hi John,

I am facing the issue, so i attach the zip folder with this.

Please cross check it and help me out.