Duplicates, USPS Address Validation, DB Relationship verification
Can OpenProfiler be used in the following ways: 1) Customer or Product duplicate checks based on similar names. There are algorithms that will try and match two words based on their phonetics (soundex) or similar spellings (metaphones). Can the product be extended if I write my own Java coded to perform this analysis of the data? 2)Address validation using a library of address data for the US (provided by the post office ? like Zip+4), find any address that is not considered valid. 3) Relationships between tables / records - Check that relationships between objects / records in the database are valid. For example, how often does an order occur without a valid customer foreign key? Also, orders are often stored in a database in two tables ? lets call them Order Header and Order Item (detail). Can the software find any Order Item records that do not belong to an Order Header record (orphans)?
Hi DBS31,
I reply to your questions hereafter:
1) We'll develop soon a column indicator which uses the Soundex function provided by the databases. See 6307 .
But we do not have yet worked on the other kind of algorithms for TOP (We are currently developping dedicated ETL components for the Talend Data Quality offering.)
I suggest that you create a feature request in the bugtracker so that you can follow the development of this feature.
2) There is no address validation in Talend Open Profiler. This is a feature only available in Talend Data Quality offering. We provide ELT components to validate and correct addresses. These components are based on AddressDoctor (
http://www.addressdoctor.com/en/default.asp) or on QAS (
http://www.qas.com/).
3) This feature is available in 1.2.0M3. see 5322 but there still remains work to do on similar indicators. see 5731
We just released a new milestone version of Talend Open Profiler:
TOP 1.2.0M4 is available at
http://www.talend.com/download.php The final release of TOP should be in April.
