topic Re: Opening/Closing of multiple MySQL connections in parallel in Talend Studio

Opening/Closing of multiple MySQL connections in parallel

Anonymous — Fri, 09 Jun 2017 11:43:52 GMT

Hi,

I have a job that takes in data from sql server and puts them in mysql. I have used tmysqlconnection, tmysqlcommit and tmysqlrollback.

Similar to the above I have 15+ jobs. All these jobs must run in parallel

What problems might I face if the opening/closing of mysql connection happens 15+ times simultaneously?

Thanks in advance

Rathi

Re: Opening/Closing of multiple MySQL connections in parallel

Anonymous — Sat, 10 Jun 2017 06:49:03 GMT

No problems at all, unless you are restricted by the number of connections that your MySQL database allow. You must tweak your mysql database to allow the number of connections you have per job X the number of jobs you are running.

Look also at the performance of your DB when you have 15+ jobs trying to insert/update/delete data to your DB. Your DB can become the bottleneck if it cannot cope with the throughput thrown at it.

Re: Opening/Closing of multiple MySQL connections in parallel

Anonymous — Mon, 12 Jun 2017 00:27:47 GMT

It depends on your mysql configuration. You can check with your dba. how many parallel connection allowed. Also at the same time you have to consider connections opened by other jobs/process.
you can use connection name as your jobName, so it is common per your job and at last you can close the connection.

Re: Opening/Closing of multiple MySQL connections in parallel

Anonymous — Tue, 13 Jun 2017 15:05:25 GMT

Thank you !! That answers my question !