topic Re: Buffer the changed data and commit in one time and re-use in another job in Talend Studio

Buffer the changed data and commit in one time and re-use in another job

JayQueue — Fri, 15 Nov 2024 22:58:50 GMT

Hello,

I'm working on a sync between our HR software and LDAP/EXO/....

Looking for changes and updating them works but I want to keep those changes and then push them to LDAP.

Now I check for a telephonenumber, after that check I commit those changes to LDAP. And the same for mobile, for manager...

Is there a way I can just combine all the changes and commit them all at once? And so I can re-use that data to update Graph API.

I tried with tHashOutput but the schema's are not the same. Then I thought of creating a csv....

Is this a good way or are their better components/methods? 🙂

Thanks!

Jonathan

Re: Buffer the changed data and commit in one time and re-use in another job

Anonymous — Thu, 28 Apr 2022 06:28:16 GMT

You can try the way: storing the changed data in file or DB, create a type column stored different action like 'updating', 'inserting' and 'deleting' that can be used to filter different action for later. Create an entity column to store different object, like 'mobile', 'manager'.

When doing the synchronization, read all these changed data from file or DB, filter the data by entity value and update them into

corresponding target object.

Regards

Shong

Re: Buffer the changed data and commit in one time and re-use in another job

JayQueue — Thu, 28 Apr 2022 08:11:40 GMT

I went for another way.

Storing the changes in hashOutput and using them as LookUps with a tMap.

But thank you 🙂

Re: Buffer the changed data and commit in one time and re-use in another job

Anonymous — Fri, 29 Apr 2022 00:15:30 GMT

Great, glad to see you achieve it!

Regards

Shong