how to push the file from sftp to Data lake without getting the file to local

[vikramk]

Guys,

I have a scenario to push the file from sftp to data lake due to privacy I don't want to get the file to a local drive, can I push file directly to data lake if yes, could you please help me with the same

[manodwhb]

@rchinta , I think you can use unix command to get the file from ftp to data lake. which you can use in tsystem component.

what is your data lake?

[akumar2301]

Tfileftech support ftp and smb protocol. This can open input stream .I am not sure if sftp will work.

Otherwise create some java routines

https://stackoverflow.com/questions/25657603/how-to-use-java-jsch-library-to-read-remote-file-line-b...

[manodwhb · Accepted solution]

@rchinta , I have used curl command to get file from FTP to S3 .so you can write script to get the files from SFTP to data lake.which you can use in tsystem component.