topic Re: How to compare values between two data files in Data Quality

How to compare values between two data files

Anonymous — Sat, 16 Nov 2024 08:39:33 GMT

Hi guys,

I am trying to compare values between two excel files in talend but not too sure how to do it.

I need to compare if the total number of records in file A is equal to a cell with the sum value in file B. Based on this result i need to run a job to insert records into Salesforce.

Does anyone have an idea how the comparison between 2 data files can be done?

Re: How to compare values between two data files

Anonymous — Wed, 21 Feb 2018 03:32:01 GMT

Read all records from file A with tFileExcelInput component, then use tAggregate to count the number of rows. Send the number of rows into a tMap. On your tMap, lookup the value in file B. Compare the 2. And then carry on from there.

There is a possibility here to use data preparation, and recipes in Data Prep. But it will depend on your data and what your logic is.

Re: How to compare values between two data files

Anonymous — Wed, 21 Feb 2018 04:39:19 GMT

Refer attached job which will do what you are expecting.

1) Below flow is just for logging

2) Change tlog (matched) with your salesforce output to write into salesforce

Compare_Values.zip

Re: How to compare values between two data files

Anonymous — Thu, 22 Feb 2018 02:24:24 GMT

Hi thanks guys. @sjain & @iburtally.

I tried using @sjain's flow. however im having trouble with the tMap.

I need to count the number of rows in a particular column of inputExcel1 and check if it matches the value of in a particular cell (B3) in inputExcel2.

Any idea how the mapping/expression can be defined?

Re: How to compare values between two data files

Anonymous — Thu, 22 Feb 2018 03:17:44 GMT

Hi,

Use taggregator to count the records as explain in my job & then use tmap for comparison or join..

Re: How to compare values between two data files

Anonymous — Thu, 22 Feb 2018 12:34:10 GMT

You want to check the int value from the count, matches the int value from file B. Just do an var1 == var2