Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Run impala "invalidate metadat" command using talend open studio

Hi ,
I am using TOS bigdata 5.6.
I want to write Imapala query from talend studio.
Now the problem is, I have updated the data in Hive metastore. So for Impala to anticipate the changes we need to run "INVALIDATE MATADATA".
Now my question is, "How can i run this command from Talend open studio" ?
Labels (3)
3 Replies
Anonymous
Not applicable
Author

Hi,
So for Impala to anticipate the changes we need to run "INVALIDATE MATADATA".


Do you want DB connection for   Impala in  "metadata" o r you are looking for tImpala component in Talend Open Studio for bigdata?
Please take a look at: https://jira.talendforge.org/browse/TBD-928

Best regards
Sabrina
Anonymous
Not applicable
Author

Hi ,

I am running queries on data from impala. Now, Impala refers to Hive metastore for data. Now if the metastore data changes, Impala daemons should also be updated with that change. For that we need to run "invalidate metadata" command from impala shell.
Is there any way we can run this command from Talend using any component ?

Thanks,
Tapan
Anonymous
Not applicable
Author

Likely already figured out but adding this because I'll likely be searching for this the next time I forget...

tImpalaRow --- (On Component OK) --> tImpalaInput


In the tImpalaRow simply run "INVALIDATE METADATA" and all will be well. Be sure to NOT include the semi-colon at the end of the statement or you will get all sorts of odd errors.