topic Re: Connection with Infobright enterprise edition supporting DLP in Talend Studio

Connection with Infobright enterprise edition supporting DLP

_AnonymousUser — Tue, 22 Oct 2013 13:15:14 GMT

Hi ,
I have a job which contains 2 components
tfilelist------>iterate------->tssh
the file path is got from tfilelist and the below command is executed and DLP is in same server as tool and loading into another server having infobright database

im getting following error:
Starting job DLP_SCRIPT at 17:52 22/10/2013.

connecting to socket on port 3392
connected
Last login: Tue Oct 22 16:13:48 2013 from 172.20.0.248
/opt/infobright/tools/distributed-load-processor/dataprocessor -H 172.20.0.230 -L etl -p etl --database=TDA --table=TDA_CDR_TYPE --input-path=/opt/etl/manjuinput/Cdr_Type.txt --fields-terminated-by=',' --data-format=txt_variable --data-charset=utf8 --execute-load
exit
# /opt/infobright/tools/distributed-load-processor/dataprocessor
<ht/tools/distributed-load-processor/dataprocessor - H 172.20.0.230 -L etl -p
<processor/dataprocessor -H 172.20.0.230 -L etl -p e tl --database=TDA --table
< 172.20.0.230 -L etl -p etl --database=TDA --table= TDA_CDR_TYPE --input-pat
<l --database=TDA --table=TDA_CDR_TYPE --input-path =/opt/etl/manjuinput/Cdr_
<DA_CDR_TYPE --input-path=/opt/etl/manjuinput/Cdr_T ype.txt --fields-termina
</opt/etl/manjuinput/Cdr_Type.txt --fields-terminat ed-by=',' --data-format=t
<pe.txt --fields-terminated-by=',' --data-format=tx t_variable --data-charset
<d-by=',' --data-format=txt_variable --data-charset= utf8 --execute-load
Error: input path does not exist or has wrong type: /opt/etl/manjuinput/Cdr_Type.txt
# exit
logout
821 milliseconds
disconnected
Job DLP_SCRIPT ended at 17:52 22/10/2013.

But if i execute the command generated from tssh component "/opt/infobright/tools/distributed-load-processor/dataprocessor -H 172.20.0.230 -L etl -p etl --database=TDA --table=TDA_CDR_TYPE --input-path=/opt/etl/manjuinput/Cdr_Type.txt --fields-terminated-by=',' --data-format=txt_variable --data-charset=utf8 --execute-load " its getting inserted to table

Re: Connection with Infobright enterprise edition supporting DLP

Anonymous — Thu, 24 Oct 2013 07:11:15 GMT

Hi,

But if i execute the command generated from tssh component "/opt/infobright/tools/distributed-load-processor/dataprocessor -H 172.20.0.230 -L etl -p etl --database=TDA --table=TDA_CDR_TYPE --input-path=/opt/etl/manjuinput/Cdr_Type.txt --fields-terminated-by=',' --data-format=txt_variable --data-charset=utf8 --execute-load " its getting inserted to table

It means it is OK with tssh only but not tfilelist------>iterate------->tssh ?
Best regards
Sabrina

Re: Connection with Infobright enterprise edition supporting DLP

_AnonymousUser — Thu, 24 Oct 2013 07:53:06 GMT

hi,
Yes, its okay with tSSH ,directly executing the command i meant in the shell (server) where DLP is installed the above command is working but from tool the same command is not working for the job flow which i have posted earlier

Re: Connection with Infobright enterprise edition supporting DLP

_AnonymousUser — Thu, 24 Oct 2013 10:00:59 GMT

hi ,
i am getting error in the below command while using tFileList_1_CURRENT_FILE variable in tssh .
Where /root/LIVE_CISDATA/Sample_comverse_cdr_2530404/February is a folder containing many files
"/opt/infobright/tools/distributed-load-processor/dataprocessor -H 172.20.0.230 -L etl -p etl --database=TDA --table=ip_bill_cdr_Directload --input-path= "+/root/LIVE_CISDATA/Sample_comverse_cdr_2530404/February/((String)globalMap.get("tFileList_1_CURRENT_FILE"))+" --fields-terminated-by='|' --data-format=txt_variable --data-charset=utf8 --execute-load -v"
how to use global variable here?