Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi All,
I have build job from studio and unable to run job from TAC and nexus as well.
Not able to generate spark-submmit commands or command not placing file into HDFS.
tsystem--->subok--->thdfslist -->no file-->tdie(messgae: file not found)
tsystem: we are calling spark-summit command
Functionalities of spark-commands--> place file into hdfs.
But i am able run job in jobserver using below command its working fine. Let us know any parameter need to set in TAC or job level.
commands: sh jobname.sh
Thanks in advance
Hello,
What's error message are you facing?
Best regards
Sabrina
Hi Sabrina,
No error message such. using tSystem_1 component will hit Saprk-summit commands to hortonworks cluster.
May i know anything to add cluster ipaddressort add in TAC ?
Thanks
Hello,
No error message in log? Is your Studio/TAC the same operating system type? Maybe a difference regarding system variables such as Path or user rights (probably not the same for the Studio and for the TAC).
Best regards
Sabrina
Hi Sabrina,
Error message is "Filenot found." Same code work for old hadoop cluster but not working in new cluster.
We checked with admin there no change in old and new cluster.
May i know anything add cluster in TAC or jobserver.
Thanks
Hi,
Could you please do the echo command in tsystem and see whether its working while running through TAC?
I would echo hostname, current directory, PATH variable etc. to see whether there is any issue due to relative path for job name.
Warm Regards,
Nikhil Thampi
Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂