SUMMARY
- In a Data Warehouse environment, a common use case is to merge information from multiple sources into a single target
- A special sub case of this is when those multiple sources are identical
- When presented with more than single digits identical sources which are needed to be stored in the DWH it is less maintenance and simpler to process if those are merged from Replicate itself into a single unique set of tables, instead of a separate set of tables per Replicate Task
- But that scenario presents us with its own challenges.
INTRODUCTION
When our sources for the data warehouse are identical tables in different schemas or databases, and we require to merge all that information into a single table we have 2 options. Option 1, create tasks in replicate as usual with a different set of tables for Base and Change tables for each source; or Option 2, use a single set of tables that merge the data from the start. Which then need to be read by Compose in completely different way. This document tries to show the second scenario resolution step by step.
