Talend Cloud Studio : performance question with a lot of files treatment

[romain_f]

Hello,

I have a question about performance.

I have a job that will do two mass copy pastes then create a witness file to indicate that the operation is finished.

The problem is that this job will have to process thousands of files per day.

The server has 30 GB of RAM and there will be other jobs even if they are less greedy, they do around the same work but with less files.

So I ask the question, is Talend the right solution to absorb this load?

Should the job be set aside as a background task via a Windows scheduled task?

What solution would you have to absorb this load?

Thanks for your help,

Best regards

[Anonymous]

Hello,

Could you please post your job design screenshots here which will be helpful for us to get more information for your performance use case?

Best regards

Sabrina