Reconciliation

[shalinim1]

Record count of data fetched in source table should match the record count of target table - (this should be checked)

ETL Process should be capable of recording below details at layer level( this process contains 3 layers, 1st layer has 5 source tables, 2nd layer has 5 source tables, and 1 source table in last layer)

• Source Table name
• Target Table name
• Source Record count
• Target Record count
• Load start time
• Load End time
• Load Status
• Error message
• Load date

Balancing between the Source and Target table records should be published in Excel sheet for the predefined group via email as mentioned in above tabulation.

Could anyone help me with this approach? How to deal with it?

[shalinim1]

Hi @Xiaodi Shi​ ,

Sorry I accidentally deleted your reply.

(Hello,

Could you please elaborate your case with an example with input and expected output values?

Best regards

Sabrina)

The source and target record count should be fetched and compared, if the count value doesn't match mail has to be triggered with the diff of count. The count values for both source and target, source and target name. start and end time of data load, load date, status of the data load, and the error message should be load in a excel file. this excel file should be included in the mail.

This has be done for 3layers which consists of 7 jobs in total.

For example:

the count values for customer source and target has to be fetched and compared. Source Table name, Target Table name, Source Record count, Target Record count, Load start time, Load End time, Load Status, Error message, Load date has to stored in an excel file. if the count of source and target doesn't match. The mail should be triggered with this excel file with the difference.

if the count values matches then the mail should be triggered as successful.

The above mentioned should be done for 7 source tables like vendors, parts, geography and so on.

PFB, This is one of my job.

Thanks,

Shalini