Matching on multiple fields with OR for data stewardship
Hi,
We receive applications from our Admissions system via a file which we load into a table in our student information system (SIS). For each record in the source file, we need to check if there is a match in the SIS based on name OR ssn OR email address and if there is a potential duplicate, the record is sent to data stewardship for a definitive ruling. The records that do not match on any of the attributes are inserted into the SIS.
Just for the matching logic, I loaded the SIS table 3 times as a lookup table. The table is large and the job runs slow because of this multiple lookup load. I looked at the tRecordMatching component but did not see how it supports this requirement. The tMatchGroup only takes 1 input and therefore can't do a lookup. Is there a better approach to this OR lookup? How would I achieve the matching and how would I send the matches to data stewardship?
