How to create a dynamic schema mapping using Talend by reading schema.
Hi All,
i have to develop one such job which will be use to load all kind of file based on my distention table schema . i will have a XML file which has all the details of Input Type , File Type, Delimiter Type, Number of Columns, Columns Validation ( Trim, data Type, remove unwanted char), out put, table schema, columns data type, constraints. etc.
So the thing is whenever i am load file it should pic all the details from config. file, and then apply validation to convert or correct the data types with other validation to remove or format the data. then again read the destination table schema and map with source schema and then load to destination. this is sort of information. so please any one can tell how to and what to use to accomplish this task.
Requirement:
We have to process the CSV file based on the agreed format(schema) with Client.
However client wants that even if he sends file in different format (like no of column can be less/more, sequence of columns is diff, data type is diff) changes the job should not fail, it should be captured as exception. Is this possible using any component? how?
