topic Re: wait for many subjobs in Talend Studio

wait for many subjobs

Anonymous — Sat, 16 Nov 2024 05:11:13 GMT

Hello,

after the tMap, I got a couple of things that I want to be sure they are done before proceeding to the next sub job

how do I do that ?

regards

Re: wait for many subjobs

lennelei — Wed, 24 Jul 2019 08:08:08 GMT

Hi,

you can try this :

1) remove the OnComponentOk between the tLogRow_9 and the tDBLastInsertId_1 (number 1 in the screenshot)

2) change the OnSubjobOk before the users read with a OnComponentOk (number 2)

3) add an OnSubjobOk link between the component we don't see at the beginning and the tDBLastInsertId_1 (number 3)

This way, you are sure that the whole block (from the users to the outputs after the tMap) will be processed before the OnSubjobOk link you just add in 3.

Apart from that: are you sure you cannot change the process? Iterations of iterations of iterations of db reads is not very efficient (you use an existing connection here?); maybe you could use some db join to do the same thing more efficiently?

Regards.

Re: wait for many subjobs

Anonymous — Wed, 24 Jul 2019 13:15:22 GMT

thanks, I'll try that

yeah my process really needs to be improved, but when I first tried to get "new users" and "new products" values to link them to a tMap for joining, no data was defined

so I found that using iteration was doing the trick

yet I could try left joining users/orders and order details but I'll end up with huge records

sheers