Run impala "invalidate metadat" command using talend open studio
Hi ,
I am using TOS bigdata 5.6.
I want to write Imapala query from talend studio.
Now the problem is, I have updated the data in Hive metastore. So for Impala to anticipate the changes we need to run "INVALIDATE MATADATA".
Now my question is, "How can i run this command from Talend open studio" ?
So for Impala to anticipate the changes we need to run "INVALIDATE MATADATA".
Do you want DB connection for
Impala in
"metadata" o
r you are looking for tImpala component in Talend Open Studio for bigdata?
Please take a look at: https://jira.talendforge.org/browse/TBD-928
I am running queries on data from impala. Now, Impala refers to Hive metastore for data. Now if the metastore data changes, Impala daemons should also be updated with that change. For that we need to run "invalidate metadata" command from impala shell. Is there any way we can run this command from Talend using any component ?
Likely already figured out but adding this because I'll likely be searching for this the next time I forget...
tImpalaRow --- (On Component OK) --> tImpalaInput
In the tImpalaRow simply run "INVALIDATE METADATA" and all will be well. Be sure to NOT include the semi-colon at the end of the statement or you will get all sorts of odd errors.