Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi,
Please find attached screenshot. As you can see, I am able to create metadata schema for a student file on my local system. I am also able to run "Basic Column Analysis" and generate reports. Now my current ask is:
If I have different files in different location/same location with "same schema", how do I run Data Profiling/Data Quality checks using this same metadata schema?
In a traditional Talend Integration job, I can use tFilelist to iterate through the folder, read the files with same schem. On a similar note, how do I perform Talend Data Profiling/Data Quality check?
Hello,
Are you trying to analysis metadata schema? Could you please give us more description about your expected result?
Best regards
Sabrina
Hi,
Thank you for your response. I am trying to run "Basic Column Analysis" on different files with same schema.
In my previous post, I have attached a screenshot of a sample student file schema metadata I have created in my Repository.
So, essentially I have done the following steps:
1) Import a sample file and created metdata schema in my repository
2) I have selected this schema through "Profiling" perspective and ran "Basic Column Analysis" and able to generate pdf through reports.
Now my question is:
If I have various sample files for my student use case with "exact schema", how do I run profiling on all of them without the need to create schemas for each file individually in my repository?
Hope I have detailed enough for your understanding? Please let me know, and I can send more screenshots with even more detailed explanations