Optimize the execution time of the job for loading data

[elsaaa]

Hey everyone ,

My job is loading data from an mysql table to postgresql table , so it copy 27 Go ( 46 millions of rows ) of data from one table to another .

The job run 8 hours to do that ( Exportation of the job on linux script and execution on the server ) which is not satisfying for me .Any solution to minimize the 8 hours ?

Ps : I use talend open studio for data integration

Thank you

[Anonymous]

Hello

Refer to this page about Performance Optimization Tips, like allocating more memory to job execution, using database bulk components.

Regards

Shong