Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Independent validation for trusted, AI-ready data integration. See why IDC named Qlik a Leader: Read the Excerpt!
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

How to process a file stored on remote server, without copying it?

Hi

 

Is it possible to process a file stored on a remote server without copying it?

I'm working on very large files and would prefer not to store the data locally.

 

Thanks

Labels (3)
12 Replies
Anonymous
Not applicable
Author

It's a weigh off (I guess) between real security implications (or legal implications) and ease of use. You can always simply leave a job you have built on that server and schedule it to run using a scheduling tool (I'm assuming you are using the Open Source tool and not the Enterprise Edition of Talend). There are other options but to give you a solution we will need to know what servers you are using (is SSH available, for example?), what version of Talend you are using, network accessibility, etc.  

Anonymous
Not applicable
Author

It's Linux servers. Yes SSH is available and I'm using 6.4.1(Open studio)

Anonymous
Not applicable
Author

Well linux makes it a bit easier. You can easily make use of SSH manually or as part of a Talend job. In its simplest form, this job could be built on your Studio, moved to the machine with the files, extracted from the zip and then you would just need to initialise the script file using SSH. Alternatively, if you want a job on your local machine to trigger the job on the remote machine (maybe even send it there and extract it), you can use tFTP components and the tSSH component.