topic Re: how to access directory situated on different server through TDF ? in Talend Studio

how to access directory situated on different server through TDF ?

Anonymous — Fri, 26 May 2017 06:36:44 GMT

Hi,

I have a job in TDF 6.3.1 which contains following design -

So I am fetching parameters from tFileInputdelimited_1and store in Global variable and pushed it into tFileOutputRaw_1,to create a output file.

But I want to create this output file to the directory situated on another server,but i have not access to that server by my credentials .

That's why I uses the output file path with Username who has the access to that server like this

"file:\\\\Servername\\c$\\Talend\\6.3.1\\cmdline\\studio\\out.txt"

But I am unable to create or access that direcotry.

Can any one suggest me what i have missed? Suggest me the solution pls..

Any how I want to access that directory otherwise I will not able to call commandline.bat file reside on that Server through tSystem_1 component.

Kindly reply soon....!

Thanks,

Vaibhav

Re: how to access directory situated on different server through TDF ?

vapukov — Fri, 26 May 2017 07:21:28 GMT

where You want execute this commandline.bat file?

on Your machine or on remote?

Re: how to access directory situated on different server through TDF ?

Anonymous — Fri, 26 May 2017 07:51:01 GMT

Hi,

thanks for your quick response..!

I want to execute .bat file through my machine but the problem is it is resides on different server. Commandline.bat file requires its all related files they are also resides on that server.

That's why I want to push my output file on that server and call it from Commandline.bat file by specifying its name in command in Commandline.bat.

Thanks,

Vaibhav

Re: how to access directory situated on different server through TDF ?

vapukov — Fri, 26 May 2017 08:41:41 GMT

Still not 100% clean

1) if this .bat file could be executed from remote disk, but on local machine (did You test this?), You can:

- map network drive

- just make a local copy of files

2) But if as usual - dependencies more serious, like dll or other libraries - file will not work properly

in this case remote disk not help

in any case - tSystem - call file for execute only on local machine with all local folders, so ev en if You put file on remote server and run bat file - it will look for Disk C: as local Disk C: on Your machine, but not on remote sever as You expect (same for all dependencies - it will search all path on Your machine)

Normal way, if You want call remote Job - install on remote server ssh and sftp services, in this case Talend will and upload file and call remote command

Re: how to access directory situated on different server through TDF ?

Anonymous — Fri, 26 May 2017 11:47:08 GMT

Hi Vap,

Thanks for your Prompt response....!

I mapped the network drive as you suggested,it works for me.

Now I can Push my output file on that server ,but I am worried about tSystem component to call Commandline.bat file .

I get Following Error in tSystem-

'\\Servername\c$\Talend\6.3.1\cmdline\studio'
CMD.EXE was started with the above path as the current directory.
UNC paths are not supported. Defaulting to Windows directory.
'commandline_test.bat' is not recognized as an internal or external command,
operable program or batch file.

I am very close to achieve my target if tSystem works fine for me. Is there any different way to do this?

Kindly reply to solve this query if possible ....!

Thanks,

Vaibhav

Re: how to access directory situated on different server through TDF ?

vapukov — Fri, 26 May 2017 13:47:22 GMT

may be (but not sure) it could be done as You want ...

I can't suggest nothing, because always go by other way (from my point of view more proper)

I suggest on my projects (when windows) for clients - https://www.bitvise.com/ssh-server, or analogs from IBM (part of some product) or cygwin and etc

Some clients prefer native windows

just install one of this .. .and use standard ssh tools like - ssh, scp, sftp ... all what Talend need for do all what You need

Re: how to access directory situated on different server through TDF ?

cterenzi — Sat, 27 May 2017 19:17:36 GMT

Windows is telling you the problem. You can't use a UNC path (i.e. paths in the form \\server\sharename\directory) when invoking CMD. If you mapped the share to a drive letter, refer to the drive letter instead.

Re: how to access directory situated on different server through TDF ?

vapukov — Sun, 28 May 2017 03:54:03 GMT

@cterenzi wrote:

Windows is telling you the problem. You can't use a UNC path (i.e. paths in the form \\server\sharename\directory) when invoking CMD. If you mapped the share to a drive letter, refer to the drive letter instead.

I agree with You about UNC error (and when I mean map - I mean map as local drive T:\ for example), just personal opinion - this is wrong way

even if You map network drive and try for example run excel - it will not work

Re: how to access directory situated on different server through TDF ?

Anonymous — Mon, 29 May 2017 13:09:54 GMT

Hi,

I get following Error while using tSSH component-

java.io.IOException: There was a problem while connecting <ServerName> 22

I am confused while set up of SSH2 option in Network tab of Talend Studio-->Windows-->Preferences.

Is it mandatory to install Putty.exe on my local machine to connect remote server by SSH protocol?

Kindly reply..!

Re: how to access directory situated on different server through TDF ?

vapukov — Mon, 29 May 2017 13:15:33 GMT

don't touch Talend 🙂

for work tSSH - You must have enabled SSH on target server, by default it not installed on windows server, and as well could be closed by firewall

Re: how to access directory situated on different server through TDF ?

Anonymous — Mon, 05 Jun 2017 08:24:22 GMT

Hi ,

You mean to say I have to install Putty on My local machine so that ,I can connect to Remote server and run the .bat file there?

I have downloaded the putty setup successfully installed also but when click "open" gives "Network Error:Connection Refused" . I enter Hostname as my Remote Server Name.

But Tell me Is it required to install openSSH or Tectia SSH on my Remote server.

Even Remote server doesn't have SSHD service in services.msc.

Can you please help me?

Thanks...!

Re: how to access directory situated on different server through TDF ?

cterenzi — Mon, 05 Jun 2017 21:49:03 GMT

The destination server has to be configured to accept connections of this type.

Would it not make more sense to set up this batch file on the host running the Talend job? Or else compile the Talend job and set it up to run on the host with the batch file?

Re: how to access directory situated on different server through TDF ?

Anonymous — Tue, 06 Jun 2017 08:14:05 GMT

Hi ,

I want to run my talend job from my local machine but want trigger or call .bat file which is on Remote server.

We have tSSH component to do this task but I am unable to connect Remote server even after installing Putty in my local machine and freeSSHd on my Remote server.

I get status on my Remote server as follows-

But when I Double click on Putty in My Local machine,I get this error-

Even if it recognises my remote Hostname then also it gives above error.

Is there any extra settings I have to Make in freesshd or Putty ?

Kindly Suggest...!

Thanks,

Vaibhav

Re: how to access directory situated on different server through TDF ?

vapukov — Tue, 06 Jun 2017 09:55:13 GMT

@cterenzi - You are could be right, but some time we could have other restrictions - such as we have 2 different network(offices in same organisation) in process

we finish process in one office, upload file, then call remote job.

Of course - there are many other ways how to resolve same problem

@vaibhav - do not forget about windows firewall, it close all what not enabled by default

Re: how to access directory situated on different server through TDF ?

Anonymous — Wed, 07 Jun 2017 11:45:22 GMT

Hi ,

I am not using freeSShd right now to get rid of "Access denied " error in when I enter my Username and after giving password ,it gives me access denied error.

Now I installed KpyM telnet ssh server setup on my Remote server to which I want to connect from my local machine.

Now I am able to login by my local machine using Putty,but problem with tSSh component in my talend job .I have provided all necessary info like Host,Username,Password etc. even job executed successfully, no error comes .

But changes which I have expected from talend job is not reflected . Don't know why this is happened ?

Reply with your valuable suggestions please...!

Re: how to access directory situated on different server through TDF ?

Anonymous — Wed, 07 Jun 2017 11:53:22 GMT

I am using following settings in my tSSh component-

kindly reply ...!

Re: how to access directory situated on different server through TDF ?

vapukov — Wed, 07 Jun 2017 11:59:16 GMT

You can first easy check - just login to ssh and run command

You do not need any CALL and exit, just run it as normal command (in tSSH the same - just a command), and see result

this is shh session to windows server:

Re: how to access directory situated on different server through TDF ?

Anonymous — Thu, 08 Jun 2017 03:26:09 GMT

Hi Vap,

I m trying to run my commandline.bat file through putty like below

but before command executes ,it give pop up window like connection closed by remote host. Ideally on remote Server idle timeout is 5 min ,i explicitly set it as 0 i.e. no timeout. I also set keepalive timeout in Putty as 11 minutes.

This will not serve my problem even though my changes are not reflected whatever I want .

There are two active sessions files appeared in my SSh server folder.

I also tried to run .bat file in tSSh but same happens, the job runs for so long and not closed then also I don't get the output that I expected.

Is anything I missed because even Event logger also shows I am able to login and excutes shell command as shown in above attached figure.

Kindly reply...!

Re: how to access directory situated on different server through TDF ?

vapukov — Thu, 08 Jun 2017 03:30:47 GMT

Hi,

I don't know (and more important - do not want to know 🙂 ) all possible tools in a world

I use - https://www.bitvise.com/ssh-server, it work (of course by default it also timeout)

We have Jobs which run 3.5Hr month by month - stop and start new iteration, so ask Your sysadmin (or hire one) for setup it to You once properly, and then just use .

Re: how to access directory situated on different server through TDF ?

Anonymous — Thu, 08 Jun 2017 12:30:16 GMT

Hi,

Yes of course no one is expert in all tools in the world

I really appreciate your help ,and for our discussion of the current topic ,now I am able to execute my .bat file by putty after some changes in .ini file on server.

Now I am trying to execute same .bat file through talend job by tSSh using Target execution as Local but same thing job doesn't response ,stuck somewhere don't know why but same credentials worked in putty .

It not even give error if there is problem in syntax only running continuously.

There is another way also in which we start putty from another batch file,by tSystem component but I want to execute this from tSSH if possible.

Does it belong to Port number ,bcz putty uses port number 22 and when I started Talend job It shows - [statistics] connecting to socket on port 3357.

Reply if its relevant for you...!

Thanks & Regards,

Vaibhav