Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
I am trying to connect to Azure HD insights using an SSH connection from Talend job. This SSH connection then sends a sqoop command to the HD Insights cluster. The sqoop command takes about 30 mins for data retrieval. The issue is that the tSSH component is getting disconnected even before the sqoop command finishes its execution. Please see the error below.
[INFO ] 02:18:32 org.apache.sshd.client.session.ClientSessionImpl- Disconnecting(ClientSessionImpl[sshuser@XXXX-ssh.azurehdinsight.net/XXXX]): SSH2_DISCONNECT_PROTOCOL_ERROR - Detected IdleTimeout after 600170/600000 ms.
How do I keep the SSH connection alive? I don't see any setting on the talend component to do so.
On the Azure HD insights, we have tried changing the
ClientAliveCountMax to 10 and ClientAliveInterval is 0
Hello,
Could you please have a look at it?
With tSSH component, there is one checkbox called Use timeout/timeout in seconds. You can increase the timeout value.
For more details please go through the given below document which will help you to configure the tSSH component:
https://help.talend.com/r/en-US/8.0/system/tssh-standard-properties
Best regards
Pooja Patel