topic Re: TWO DATABASES SYNC PROCESS in Talend Studio

TWO DATABASES SYNC PROCESS

turboboost — Sat, 16 Nov 2024 01:23:30 GMT

Hi all,

How to two differents databases automatically SYNC process.

Exemple:

1)MYSQL

2)Postgresql

if one row inserted into customer table in mysql database then automatically inserted into customer table in Postgresql database and vice versa.

Re: TWO DATABASES SYNC PROCESS

Anonymous — Fri, 25 Sep 2020 07:22:22 GMT

Hello,

You can capture the changed data and only load these changed data into target table to achieve table sync.

The work flow should be:

Target DB-->tMap(make inner join on your input and set the "Catch lookup inner join reject" as true)-->output

Source DB-->(lookup)

The output will be the changed data.

Let us know if it is what you are looking for.

Best regards

Sabrina

Re: TWO DATABASES SYNC PROCESS

turboboost — Fri, 25 Sep 2020 12:51:06 GMT

Hello sabrina,

I'm a beginner in talend. can you more explain with ss...

i transfer my data from Mysql DB to Postgresql DB like this:

Now i hope :

1- if one row inserted into customer table in mysql database then automatically inserted into customer table in Postgresql database

and 2- if one row inserted into customer table in Postgres database then automatically inserted into customer table in Mysql database

Thnx.

Re: TWO DATABASES SYNC PROCESS

Anonymous — Sun, 27 Sep 2020 06:42:21 GMT

Hello,

There is no automatically SYNC process in talend for two different DBs. If there is not too much data, you might consider using a tMap which inner joins existing data with all data and then have an output which catches the reject of inner join as I mentioned above.

Target DB(Postgres database )-->tMap(inner join,"Catch lookup inner join reject" as true)

Source DB(mysql database)-->(lookup) -->output

The output will be the changed data. And then you can load them to your customer table by manual.

Here is CDC feature in talend which is not applicable for two different DBs.

For more information, please have a look at this online documentation: TalendHelpCenter: Change Data Capture

Best regards

Sabrina