topic Executing multiple update at the same time (Parallel execution) in Talend Studio

Executing multiple update at the same time (Parallel execution)

RA6 — Fri, 15 Nov 2024 22:49:41 GMT

Hello everyone,

I have a file with only one column and each line of the column is an update query; approx 10000 update statement.

The problem is that it is taking too much time to execute each query => more than 6 hours.

The database is mySql and i am using the component tDBRow, but as you can see below the option is greyed out in talend and unable to check.

My question is that: is there another way how i can launch multiple query at the same time ?

Or is there a way to enable the parallel execution or any other component which i can use?

Best regards,

Re: Executing multiple update at the same time (Parallel execution)

Anonymous — Thu, 16 Jun 2022 07:53:58 GMT

if you just need better performance, I'd start with changing select to "SELECT DISTINCT user_id" instead of selecting a lot of duplicates and extra columns.

choiceadvantage

Re: Executing multiple update at the same time (Parallel execution)

RA6 — Thu, 16 Jun 2022 09:01:14 GMT

i am not using any select statement in my update query; this option is not applicable in my case.

All the updates are in a 1 file that 10 rows means 10 update statement and besides they are simple and straight updates, no subquery at all. 😕