Iterate multiple database connections

Anonymous — Sat, 16 Nov 2024 02:03:15 GMT

I have a need to check consistency of data across five database environments. I have a framework for how to do the comparison and output the results but what I would like to know is if there is a way to create a list of MSSQL database connections, and iterate through them so that I can build the comparison once and then the iteration does the following:

Compare system A against system B

Compare system A against system C

Compare system A against system D

....

(System A is considered the source so we can compare all other systems against it). I'm only jjust starting to use iteration connectors and things like tForEach so any ideas would be greatly appreciated.

It should be worth noting that the schemas are identical across systems.

Re: Iterate multiple database connections

JohnRMK — Thu, 25 Jun 2020 17:49:48 GMT

Hello,

Can you tell us more about your need
What do you want to compare? Data from tables, data structures, ...

To start you can open several connections in pre-job and you close them in post-job

In the main flow, you can have a list and iterate with tFlowToIterate to compare like this picture below

If you can tell us more, I can see what you will need as a component and model

topic Iterate multiple database connections in Talend Studio

Iterate multiple database connections

Re: Iterate multiple database connections