how to handle dynamic schema files which come on daily basis to load into fixed schema databse

[bhagyarekha]

Hi All

I have one requirement I have different source like csv or xml or excel it may not be know to us always the source will keep on changing and schema also varies. in this case how can i handle the file to insert the records in database which is having fixed schema . by using Talend open studio for data integration.

waiting for your reply

Regards 

rekha  

[premchandkar]

Hi ,

Can you confirm whether the schema is fixed for specific file type(e.g.-xml file contains always same schema) ?

Thanks,

Premchand

[bhagyarekha]

yes schema also varies for each file each time

[bhagyarekha]

can any one give reply for this requirement please.is it possible

[premchandkar]

Hi ,

As of now this feature is not working in talend,we also tried a lot to achieve this but no luck 

Thanks,

Premchand

[Anonymous]

I hope this post gives you an idea on dealing with dynamic schemas.

http://bekwam.blogspot.fr/2011/06/dynamic-schemas-in-talend-open-studio.html 

[Anonymous]

Hi,

We have done similar requirement like this but in our case we were getting only one type of data file in csv and dynamic schema file.

[bhagyarekha]

so ,can you share how you have handled in your case if it is only csv file

---

@PK wrote:

Hi,

We have done similar requirement like this but in our case we were getting only one type of data file in csv and dynamic schema file.

---

[bhagyarekha]

it is showing blog does not exist

[Anonymous]

Hi,

Idea is to :

1. first read the files using tfilelist component.

2. Read the header and create temp table in db using header with varchar type for all columns.

3.load the data into temp table.

4. read schema file using tfilelist.

5.Create actual table .

6. insert into acutal table from temp table.

Regards

PK