Job is falling from TAC

[Anonymous]

Hi All,

I have build job from studio and unable to run job from TAC and nexus as well.

Not able to generate spark-submmit commands or command not placing file into HDFS.

tsystem--->subok--->thdfslist -->no file-->tdie(messgae: file not found)

tsystem: we are calling spark-summit command

Functionalities of spark-commands--> place file into hdfs. 

But i am able run job in jobserver using below command its working fine. Let us know any parameter need to set in TAC or job level.

commands: sh jobname.sh 

Thanks in advance

[Anonymous]

Hello,

What's error message are you facing?

Best regards

Sabrina

[Anonymous]

Hi Sabrina,

No error message such. using tSystem_1 component will hit Saprk-summit commands to hortonworks cluster.

May i know anything to add cluster ipaddressort add in TAC ?

Thanks

[Anonymous]

Hello,

No error message in log? Is your Studio/TAC the same operating system type? Maybe a difference regarding system variables such as Path or user rights (probably not the same for the Studio and for the TAC).

Best regards

Sabrina

[Anonymous]

Hi Sabrina,

Error message is "Filenot found." Same code work for old hadoop cluster but not working in new cluster.

We checked with admin there no change in old and new cluster.

May i know anything add cluster in TAC or jobserver.

Thanks

[Anonymous]

Hi,

   Could you please do the echo command in tsystem and see whether its working while running through TAC?

    I would echo hostname, current directory, PATH variable etc. to see whether there is any issue due to relative path for job name.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂