Talend ETL Development and Deployment (Remote Engine Error)
Hi Talend Experts,
We are using talend cloud data integration 7.3.1 tool to develop our ETL programs, the jobs are managing using talent management console running in remote engine (Talend Version: 2.8.4) openjdk version "1.8.0_252", OpenJDK Runtime Environment (build 1.8.0_252-b09) , OpenJDK 64-Bit Server VM (build 25.252-b09, mixed mode) .
We have scheduled jobs to run on a daily basis , now our jobs are failing due to a permission related error usually occurred after the 10th or 15th day of deployment of jobs. To be clear, we created a plan in TMC in order to run our jobs in sequential order one after another ,some times there may have enhancements for existing jobs or newly created jobs deployed to the existing plan ,this is what we follow for our deployment process. Here the problem is suddenly the successful running job are failing when it cross >10 days deployment time with the following error.
Step e054ec7f-ab17-4b33-b924-cd34758683b7 failed with code -1 and
Remote server has encountered an error: , messageType=SERVER_ERROR,
idRequestResponsePair=null,
message=java.io.FileNotFoundException:
/opt/talend/ipaas/remote-engine-client/./TalendJobServersFiles/repository/jobname*_run.sh (No such file or directory)
If anybody face these kind of issues before then please share you thoughts.
and if you feel the remote engine we used is legacy then please suggest me the precautions to be taken care to upgrade the remote engine to a higher version, specifically I am looking for some support about how to handle the existing jobs during remote engine migration. I want the remote engine to be migrated to a higher version with out impacting the existing jobs .
Can you raise a support request for this one please? They will be able to work with you on inspecting your configuration to see what could be causing this. I don't think you will be able to provide enough info for us to help here.
