Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hello Community,
I was trying to add SampleDataflow2 to Development package which leads me to an error message as follows:
this dataflow failed to compile . please open the dataflow to fix the error
please find the attached too.
So, I try to run it and find it compile succeeded but failed at execution as follows :
Compile Succeeded!
Executable: etask.exe
Arguments: -x SampleDataflow2 -d 1 -i 1
Working Directory: C:\Users\IrfanGhori\Documents\expressor\Workspaces\Expressor_Integrate_Qlikview_Demo\Metadata\E_I_QV_Demo.0\dfp\SampleDataflow2\external
__compat_layer = ElevateCreateProcess
allusersprofile = C:\ProgramData
appdata = C:\Users\IrfanGhori\AppData\Roaming
commonprogramfiles = C:\Program Files (x86)\Common Files
commonprogramfiles(x86) = C:\Program Files (x86)\Common Files
commonprogramw6432 = C:\Program Files\Common Files
computername = IRFANGHORI-PC
comspec = C:\Windows\system32\cmd.exe
exp_home = C:\Program Files (x86)\expressor\expressor3\
exp_studio_running_version = 3.7.1
exp_token = FNkerJPNUC2hwIXNiEQzAUesgnYOM6SZNrv0XM6D358=
fp_no_host_check = NO
homedrive = C:
homepath = \Users\IrfanGhori
localappdata = C:\Users\IrfanGhori\AppData\Local
logonserver = \\IRFANGHORI-PC
number_of_processors = 2
os = Windows_NT
path = C:\Program Files (x86)\expressor\expressor3\usr\lib;C:\Program Files (x86)\expressor\expressor3\lib;C:\Program Files (x86)\expressor\expressor3\usr\local\bin;C:\Program Files (x86)\expressor\expressor3\usr\bin;C:\Program Files (x86)\expressor\expressor3\bin;C:\Program Files (x86)\expressor\expressor3\Studio;C:\Program Files (x86)\expressor\expressor3\Repository\bin;C:\Program Files (x86)\expressor\expressor3\Studio\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\DTS\Binn\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Binn\;C:\Users\IrfanGhori\AppData\Local\Smartbar\Application\
pathext = .COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC
processor_architecture = x86
processor_architew6432 = AMD64
processor_identifier = Intel64 Family 6 Model 23 Stepping 10, GenuineIntel
processor_level = 6
processor_revision = 170a
programdata = C:\ProgramData
programfiles = C:\Program Files (x86)
programfiles(x86) = C:\Program Files (x86)
programw6432 = C:\Program Files
psmodulepath = C:\Windows\system32\WindowsPowerShell\v1.0\Modules\
public = C:\Users\Public
sessionname = Console
systemdrive = C:
systemroot = C:\Windows
temp = C:\Users\IRFANG~1\AppData\Local\Temp
tmp = C:\Users\IRFANG~1\AppData\Local\Temp
userdomain = IrfanGhori-PC
username = IrfanGhori
userprofile = C:\Users\IrfanGhori
windir = C:\Windows
windows_tracing_flags = 3
windows_tracing_logfile = C:\BVTBin\Tests\installpackage\csilogfile.log
dataflow controller - ETASK-0017-N: Using Desktop license for an unknown expressor product; resource utilization limited. (etask.controller)
expressor dataflow execution utility (etask) 3.7.1.22531 n (Build 22531) Aug 15 2012
<task dataflow="SampleDataflow2">
<!-- project.home[(null)], project[..] -->
<step id="0" step_name="Step_1" process="9648" run="0" status="ok" start="2012-09-09T14:14:27">
Read Header File - OPERATOR-0050-F: toolId 1.0, name 'Read Header File' - Exception 'ChannelIOException' occurred in the 'initialize' function. (SampleDataflow2.Step_1)
Read Header File - CHANNELIO-0011-A: Open failed for file 'D:\New_Demo\salesOrderHeader.txt' - 2 (The system cannot find the file specified.). (SampleDataflow2.Step_1)
Read Header File - OPERATOR-0003-F: toolId 1.0, name 'Read Header File' - the 'initialize' function failed. (SampleDataflow2.Step_1)
Read Header File - ETOOL-0006-F: operator 1.0, type in-file, name 'Read Header File': etool failed, phase runInitialize. (SampleDataflow2.Step_1)
Read Header File - ETOOL-0016-A: operator 1.0, type in-file, pid 7432 - initialize() failed. (SampleDataflow2.Step_1)
<status>failed</status>
</step>
<statistic>3.380</statistic>
</task>
dataflow controller - ETASK-0038-F: Processing has completed abnormally. (SampleDataflow2.controller)
Is it the issue because of license?
This is not your error.
I've confirmed your issue and it appears that with a single attribute in the composite type, the incoming data is not being properly read.
To run the example, open the schemas used by both Read File operators and add a second attribute to the Local2 type. It really doesn't matter what the attribute's name is, but it's easiest to simply name it the same as the second incoming field. Leave its type as string.
Now the dataflow will run.
The reason the dataflow failed is because it could not open the file
Read Header File - CHANNELIO-0011-A: Open failed for file 'D:\New_Demo\salesOrderHeader.txt' -2 (The system cannot find the file specified.). (SampleDataflow2.Step_1)
thanks Hugo , I fixed the issue you pin point on, But still i am unable to execute it.
Now the following error occurs
Read Header File - IN_FILE_OP-0044-N: The parsing thread was interrupted. (SampleDataflow2.Step_1)
Read Header File - OPERATOR-0016-F: toolId 1.0, name 'Read Header File' - Exception 'InFileOpException' occurred in the 'process' function for thread 0. (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0007-A: Input processing for file 'D:\New_Demo\salesOrderHeaders.txt' aborted on record 2 due to a data error. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-A: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - OPERATOR-0005-F: toolId 1.0, name 'Read Header File' - the 'process' function failed for thread 0. (SampleDataflow2.Step_1)
help me out.
The error below suggests that your schema does not match the data it's trying to read in.
Read Header File - TRANSLITERATE-1007-A: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Your SalesOrderID should be an integer, but it found what looks to be a date instead. If the your schema is correct and the data is not, you can use the reject option in Read File to capture these offending records. Here's a tutorial on how:
Hi Hugo,
please find the attached files.
I try to perform the rejection process as you mention, but it leads me to the following issues:
Read Header File - IN_FILE_OP-0009-N: Input record 2 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 3 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 4 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 5 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 6 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 7 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 8 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 9 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Details File - IN_FILE_OP-0044-N: The parsing thread was interrupted. (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 10 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 11 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 12 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 13 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 14 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 15 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 16 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 17 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 18 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 19 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 20 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Header File - IN_FILE_OP-0009-N: Input record 21 from file 'D:\New_Demo\salesOrderHeaders.txt' is being rejected due to the following problem. (SampleDataflow2.Step_1)
Read Header File - TRANSLITERATE-1007-N: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/08/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Details File - OPERATOR-0016-F: toolId 2.0, name 'Read Details File' - Exception 'InFileOpException' occurred in the 'process' function for thread 0. (SampleDataflow2.Step_1)
Read Details File - IN_FILE_OP-0007-A: Input processing for file 'D:\New_Demo\salesOrderDetail.txt' aborted on record 2 due to a data error. (SampleDataflow2.Step_1)
Read Details File - TRANSLITERATE-1007-A: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/01/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Details File - OPERATOR-0005-F: toolId 2.0, name 'Read Details File' - the 'process' function failed for thread 0. (SampleDataflow2.Step_1)
The project files are not attached.
Hi John,
I am trying to start the run the the dataflow, as illustrated bellow
And get the following error message :
Compile Succeeded!
Executable: etask.exe
Arguments: -x SampleDataflow2 -d 1 -i 1
Working Directory: C:\Users\IrfanGhori\Documents\expressor\Workspaces\Expressor_Integrate_Qlikview_Demo\Metadata\E_I_QV_Demo.0\dfp\SampleDataflow2\external
__compat_layer = ElevateCreateProcess
allusersprofile = C:\ProgramData
appdata = C:\Users\IrfanGhori\AppData\Roaming
commonprogramfiles = C:\Program Files (x86)\Common Files
commonprogramfiles(x86) = C:\Program Files (x86)\Common Files
commonprogramw6432 = C:\Program Files\Common Files
computername = IRFANGHORI-PC
comspec = C:\Windows\system32\cmd.exe
exp_home = C:\Program Files (x86)\expressor\expressor3\
exp_studio_running_version = 3.7.1
exp_token = hQLtu9+fa47zGMTAl9SMRZQ44NX4wGkunDtX4Wz6gyw=
fp_no_host_check = NO
homedrive = C:
homepath = \Users\IrfanGhori
localappdata = C:\Users\IrfanGhori\AppData\Local
logonserver = \\IRFANGHORI-PC
number_of_processors = 2
os = Windows_NT
path = C:\Program Files (x86)\expressor\expressor3\usr\lib;C:\Program Files (x86)\expressor\expressor3\lib;C:\Program Files (x86)\expressor\expressor3\usr\local\bin;C:\Program Files (x86)\expressor\expressor3\usr\bin;C:\Program Files (x86)\expressor\expressor3\bin;C:\Program Files (x86)\expressor\expressor3\Studio;C:\Program Files (x86)\expressor\expressor3\Repository\bin;C:\Program Files (x86)\expressor\expressor3\Studio\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\DTS\Binn\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Binn\;C:\Users\IrfanGhori\AppData\Local\Smartbar\Application\
pathext = .COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC
processor_architecture = x86
processor_architew6432 = AMD64
processor_identifier = Intel64 Family 6 Model 23 Stepping 10, GenuineIntel
processor_level = 6
processor_revision = 170a
programdata = C:\ProgramData
programfiles = C:\Program Files (x86)
programfiles(x86) = C:\Program Files (x86)
programw6432 = C:\Program Files
psmodulepath = C:\Windows\system32\WindowsPowerShell\v1.0\Modules\
public = C:\Users\Public
sessionname = Console
systemdrive = C:
systemroot = C:\Windows
temp = C:\Users\IRFANG~1\AppData\Local\Temp
tmp = C:\Users\IRFANG~1\AppData\Local\Temp
userdomain = IrfanGhori-PC
username = IrfanGhori
userprofile = C:\Users\IrfanGhori
windir = C:\Windows
windows_tracing_flags = 3
windows_tracing_logfile = C:\BVTBin\Tests\installpackage\csilogfile.log
dataflow controller - ETASK-0017-N: Using Desktop license for an unknown expressor product; resource utilization limited. (etask.controller)
expressor dataflow execution utility (etask) 3.7.1.22531 n (Build 22531) Aug 15 2012
<task dataflow="SampleDataflow2">
<!-- project.home[(null)], project[..] -->
<step id="0" step_name="Step_1" process="4084" run="0" status="ok" start="2012-09-10T15:24:55">
Read Details File - IN_FILE_OP-0044-N: The parsing thread was interrupted. (SampleDataflow2.Step_1)
Read Details File - OPERATOR-0016-F: toolId 2.0, name 'Read Details File' - Exception 'InFileOpException' occurred in the 'process' function for thread 0. (SampleDataflow2.Step_1)
Read Details File - IN_FILE_OP-0007-A: Input processing for file 'D:\New_Demo\salesOrderDetail.txt' aborted on record 2 due to a data error. (SampleDataflow2.Step_1)
Read Details File - TRANSLITERATE-1007-A: Error converting field 'SalesOrderID' into attribute 'SalesOrderID': The input string '07/01/01' could not be converted to a type of 'integer'. The formatting parameters are 'unformatted' (SampleDataflow2.Step_1)
Read Details File - OPERATOR-0005-F: toolId 2.0, name 'Read Details File' - the 'process' function failed for thread 0. (SampleDataflow2.Step_1)
<status>failed</status>
</step>
<statistic>0.595</statistic>
</task>
dataflow controller - ETASK-0038-F: Processing has completed abnormally. (SampleDataflow2.controller)
Do am I suppose to change the mapping dataformate?
If So then let me understand the parameters suppose to be change in the below setting.
This is not your error.
I've confirmed your issue and it appears that with a single attribute in the composite type, the incoming data is not being properly read.
To run the example, open the schemas used by both Read File operators and add a second attribute to the Local2 type. It really doesn't matter what the attribute's name is, but it's easiest to simply name it the same as the second incoming field. Leave its type as string.
Now the dataflow will run.
Thanks John,
It worked.
Hi John,
I am facing the issue, so i attach the zip folder with this.
Please cross check it and help me out.