topic Re: Iterate multiple database connections in Talend Studio

Iterate multiple database connections

jftdarr — Sat, 16 Nov 2024 02:09:38 GMT

I have a need to check consistency of data across five database environments. I have a framework for how to do the comparison and output the results but what I would like to know is if there is a way to create a list of MSSQL database connections, and iterate through them so that I can build the comparison once and then the iteration does the following:

Compare system A against system B

Compare system A against system C

Compare system A against system D

....

(System A is considered the source so we can compare all other systems against it). I'm only jjust starting to use iteration connectors and things like tForEach so any ideas would be greatly appreciated.

It should be worth noting that the schemas are identical across systems.

Re: Iterate multiple database connections

manodwhb — Fri, 12 Jun 2020 15:20:05 GMT

@jftdarr , you need to maintain a table for the connection and iterate it .

Re: Iterate multiple database connections

jftdarr — Fri, 12 Jun 2020 16:24:04 GMT

Awesome thank you. Forgive the stupid follow up but is there a particular schema that i should follow for that table/how would I leverage that table?

Re: Iterate multiple database connections

manodwhb — Sun, 14 Jun 2020 00:42:45 GMT

The table schema should be as how you will store and iterate them.

Re: Iterate multiple database connections

jftdarr — Sun, 14 Jun 2020 02:41:41 GMT

Thanks - I wasn't clear on my questions. You say I need to maintain a table of database connections to iterate through. I'm trying to understand what structure that table should be in... db_type, db_name, host, login, password.. or should it be a connection string? how do I then pass those values to a tDBConnection file?

Re: Iterate multiple database connections

manodwhb — Sun, 14 Jun 2020 07:21:35 GMT

You should have source db name, source db host, user name, password, schema, same for target do as well.