Loading files with different schema

[Anonymous]

Hi Team,

I have multiple file with different structure.

Is there a way you create one dynamic schema and load all files on the fly.

If not, can it be done using Spark? If yes, how do you do it?

[Anonymous]

Hello,

With talend subscription solution, here is a dynamic schema feature which allows you to design schema with an unknown column structure (unknown name and number of columns).

Where are your input files from?

Here is a community article:https://community.talend.com/t5/Design-and-Development/How-to-process-changing-data-structure/ta-p/2...

Let us know if it is what you are looking for.

Best regards

Sabrina

[Anonymous]

Thanks for the reply! Is it possible to load multiple files to different targets?
Example only shows loading one file at a time to a db, and not the use case i'm looking at.