topic Job design with rollbacks at parent job in Talend Studio

Job design with rollbacks at parent job

Anonymous — Thu, 03 May 2018 16:54:38 GMT

Hello,

I have 3 jobs sons and 1 parent to insert data in the the same database. Job1, Job2, Job3 and JobParent. Each job's got more than one output

Here I want to do in JobParent:

tRun(Job1) ---on sub job ok--> tRun(Job2)----on sub job ok---> tRun(Job3)

| on error | on error | on error

rollback rollback Job2 and Job1 rollback Job3, Job2 and Job1

The problem is that when the rollbacks have to execute they don't work and as a consequence the integration fails.

Any idea of how can I resolve my problem with the rollbacks?

Thanks for your help!

Re: Job design with rollbacks at parent job

vapukov — Fri, 04 May 2018 03:25:00 GMT

You can try to define connection in parent Job and use this connection from Child Jobs (I not test this)

You can re-design it as single Job with all logic inside.

But in any case - seriously think. All look like You are will have very long transaction and this is direct way to deadlocks and database errors (like out of memory and etc).

Make transactions as much smaller as possible.
Manage transaction inside single Job
Check status of previous operation in next Job and finish work if previous transaction no successful.