Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Files load with Generic Schema

Hi All,

 

I've multiple csv files with different schema being sent to shared folder and i need to load the same to target i.e. HDFS. Also, note once loaded files have to be moved and new files will be sent to the folder over time.

Is  there a way where i can define a generic schema and load all files at once.

 

Thanks!

Labels (6)
2 Replies
Anonymous
Not applicable
Author

Hello,

Here is a dynamic schema feature in talend which allows you to design schema with an unknown column structure (unknown name and number of columns).

Let us know if this article helps.

https://community.talend.com/t5/Design-and-Development/How-to-process-changing-data-structure/ta-p/2...

Best regards

Sabrina

Anonymous
Not applicable
Author

Hi, Thanks for the reply.

However the example shows loading one kinda of schema to a table. I was looking for dynamic option such as loading multiple files to multiple different tables.

Cheers!