Temporary store db extraction using dynamic schemas in files

[yoxler]

Hi,

I want to mirror several database tables and only use one job and I use dynamic schemas since I do not know the structure of the tables.

Temorary storing it into a hash output works because hash input picks up the generic schema. Could this be done using files instead in any way?

Because once I put the data into the file the schema dissapears and I need to add a schema in the input file. 

Is there a solution with files instead of using hash? some tables are quite large so I do not want so use hash.

Thanks

Andreas

[fdenis]

why dont you start by loading data into work file.
then use it to load db then if there is error rename/move file?

[yoxler]

The structure of the tables is unknown and will be changing over time, and thats why I want to use dynamic schema.

So the tDBOutput component has a "Drop table if exists and create" so it will always reflect the source table. 

So I guess that if I would go with solution that you suggest it would end up in errors it there is a mismatch between the destination table and the file?

[fdenis]

be carefull, dynamics link (orange) bring type only on direct way. if you store and load data (with file , type is only strings) breaking the link you will loose columns type's.

[yoxler]

Ok, so there is no way to store the schema somehow?

I tried several approaches but non of them worked out.