Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Using Talend for Data Migration Testing

Hi Team,
I want to know what are the options and components available in Talend Open Studio for Data Integration that can be used in testing of data migration. 
Regards,
Asanka. 
Labels (2)
14 Replies
Anonymous
Not applicable
Author

Hi,
The above suggested method to identify missing records in source to target data migration works as expected. But this approach can be used if there are no any source data altering or enriching while migrating to the target db. There can be situations where we need to modify source data as it compatible with the target db schema. Those modifications will be applied to the source data while they are migrated according to the predefined transformation rules. In such situation are there any options available to verify the data migration has carried out properly according to the predefined rules?
Thanks and Regards,
Asanka.   
Anonymous
Not applicable
Author

Hi,
There can be situations where we need to modify source data as it compatible with the target db schema. Those modifications will be applied to the source data while they are migrated according to the predefined transformation rules.

For your use case, could you please set an example? Monitoring data change in DB table synchronously?
Best regards
Sabrina
Anonymous
Not applicable
Author

Hi Sabrina,
Sorry I'm not getting your suggestion. Can you please elaborate more if you don't mind?
Thanks and Regards,
Asanka. 
Anonymous
Not applicable
Author

Hi,
For example,
the CDC functionality can capture the data changes in the source table, and then you are able to synchronize these change data to target application.
Is it what are you looking for?

Best regards
Sabrina
Anonymous
Not applicable
Author

Hi,
Actually we are not changing data of the source tables. Data transformation will be carried out on the fly (while data is migrated to the target tables). What we need is after data is migrated to the target tables the migrated data needs to be compared with the source data while considering the transformation rules. 
Thanks and Regards,
Asanka.