topic Re: Run impala "invalidate metadat" command using talend open studio in Talend Studio

Run impala "invalidate metadat" command using talend open studio

Anonymous — Sat, 16 Nov 2024 11:17:54 GMT

Hi ,
I am using TOS bigdata 5.6.
I want to write Imapala query from talend studio.
Now the problem is, I have updated the data in Hive metastore. So for Impala to anticipate the changes we need to run "INVALIDATE MATADATA".
Now my question is, "How can i run this command from Talend open studio" ?

Re: Run impala "invalidate metadat" command using talend open studio

Anonymous — Mon, 16 Mar 2015 07:58:37 GMT

Hi,

So for Impala to anticipate the changes we need to run "INVALIDATE MATADATA".

Do you want DB connection for Impala in "metadata" o r you are looking for tImpala component in Talend Open Studio for bigdata?
Please take a look at: https://jira.talendforge.org/browse/TBD-928

Best regards
Sabrina

Re: Run impala "invalidate metadat" command using talend open studio

Anonymous — Tue, 17 Mar 2015 05:47:26 GMT

Hi ,

I am running queries on data from impala. Now, Impala refers to Hive metastore for data. Now if the metastore data changes, Impala daemons should also be updated with that change. For that we need to run "invalidate metadata" command from impala shell.
Is there any way we can run this command from Talend using any component ?

Thanks,
Tapan

Re: Run impala "invalidate metadat" command using talend open studio

Anonymous — Thu, 02 Jul 2015 18:52:09 GMT

Likely already figured out but adding this because I'll likely be searching for this the next time I forget...

tImpalaRow --- (On Component OK) --> tImpalaInput

In the tImpalaRow simply run "INVALIDATE METADATA" and all will be well. Be sure to NOT include the semi-colon at the end of the statement or you will get all sorts of odd errors.