Skip to main content
Announcements
Introducing a new Enhanced File Management feature in Qlik Cloud! GET THE DETAILS!
cancel
Showing results for 
Search instead for 
Did you mean: 
Safus
Creator
Creator

tSSH-Talend blockes job from continuing Run

Hi all,
I use a tSSH Component to call a docker-image which is on a remote Server. This docker image will create a Json File which will indicate the end of the process. However in my job, I have also a parallel process to check the availability of the file to be copied to the local Talend machine with SCP. It is simple, I wrote a script on the same machine as the docker-image, this script will check if the file is available and it will write something like that when I call it with Talend :

Like I mentioned, note that this test is running in parallel to the main script.

0683p000009MI9B.png

My joblet (it is a joblet because I have many scripts to run this way) :

0683p000009MI61.png

0683p000009MI4z.png

as you can see, a tParallelize is there to run both processes at the same time.

As I said, I have many scripts to run this way with the same logic each time and it works fine unless the main script does not take too long to execute.

The tSSh freezes and blocks the hole java job. Bottom part of parallelize responds and will copy the json file to the local machine but not the upper part.

0683p000009MIA7.png

No timeout is configured, and both "errors" and "stdout" are redirected to a FullLogFile by triggering the OnComponentOK link.

If it can help, the main script(which causes the problem) execution can last 100hours in worst cases and a few (7,8, or 9) hours in best cases. Other scripts take only few minutes to execute, this is why I never had a problem executing them.

The server logs can reach 3Mo (but this time the log size on server is only 0,7Mo and it blockes) assuming that the freeze comes out from the redirection of "errors" and "stdout" ? who knows ?

Searching on the internet I did found that I am not the only person who faces this trouble :

https://community.talend.com/t5/Design-and-Development/tssh-timeout-process-blocked/td-p/60402

https://community.talend.com/t5/Design-and-Development/tSSH-component-is-not-ending-and-keeps-on-run...

Any help or same experience share will be much appreciated.

Thank you.

 

Labels (5)
0 Replies