topic Re: How to import different files with same schema in Talend Data Profiling/Talend Data Quality in Data Quality

How to import different files with same schema in Talend Data Profiling/Talend Data Quality

Anonymous — Fri, 31 May 2019 00:39:57 GMT

Hi,

Please find attached screenshot. As you can see, I am able to create metadata schema for a student file on my local system. I am also able to run "Basic Column Analysis" and generate reports. Now my current ask is:

If I have different files in different location/same location with "same schema", how do I run Data Profiling/Data Quality checks using this same metadata schema?

In a traditional Talend Integration job, I can use tFilelist to iterate through the folder, read the files with same schem. On a similar note, how do I perform Talend Data Profiling/Data Quality check?

Re: How to import different files with same schema in Talend Data Profiling/Talend Data Quality

Anonymous — Wed, 05 Jun 2019 10:38:41 GMT

Hello,

Are you trying to analysis metadata schema? Could you please give us more description about your expected result?

Best regards

Sabrina

Re: How to import different files with same schema in Talend Data Profiling/Talend Data Quality

Anonymous — Wed, 05 Jun 2019 17:45:40 GMT

Hi,

Thank you for your response. I am trying to run "Basic Column Analysis" on different files with same schema.

In my previous post, I have attached a screenshot of a sample student file schema metadata I have created in my Repository.

So, essentially I have done the following steps:

1) Import a sample file and created metdata schema in my repository

2) I have selected this schema through "Profiling" perspective and ran "Basic Column Analysis" and able to generate pdf through reports.

Now my question is:

If I have various sample files for my student use case with "exact schema", how do I run profiling on all of them without the need to create schemas for each file individually in my repository?

Hope I have detailed enough for your understanding? Please let me know, and I can send more screenshots with even more detailed explanations