Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Discover how organizations are unlocking new revenue streams: Watch here
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable
‎2018-01-18 03:40 AM

Dynamic Schema with Hive

Hi Everyone,

We are faced with reading a huge number of hive tables with different schemas. So we were hoping we can develop a single talend job to read these different tables. We recently found out that big data components do not support dynamic schema/type. Does anybody know of a possible solution or work around towards changing schemas with big data components?

Labels (2)
Labels
271 Views
0 Likes
2 Replies
Anonymous
Not applicable
‎2018-01-22 03:30 AM
Author

Hello,

Are you in Standard DI job or Bigdata batch job?

Here is a new feature jira issue about "Support Hive Metastore HA".

https://jira.talendforge.org/browse/TBD-4059

Best regards

Sabrina

271 Views
0 Likes
Anonymous
Not applicable
‎2018-01-23 03:20 AM
Author

Hi Sabrina

 

There's an article "How to operationalize meta-data in Talend with Dynamic Schemas" by Robert Griswold which mentions you can use a String for big data components since Dynamic Schema is not supported by Big Data components.

 

The blog however doesn't mention how this can be done, do you know a way?

 

Thanks

271 Views
0 Likes