topic Re: tHiveRow not working to update Hive table in Talend Studio

tHiveRow not working to update Hive table

_AnonymousUser — Sat, 16 Nov 2024 10:51:27 GMT

Hi,
We have given below query in tHiveRow -
"set hive.support.concurrency=true;
set hive.enforce.bucketing=true ;
set hive.exec.dynamic.partition.mode=nonstrict;
set ive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
set hive.compactor.initiator.on=true;
set hive.compactor.worker.threads=10;
update hiveupdate set salary = 75000 where employeeid=10";
Job is not throwing any error but record is not actually updated in DB - where as same is working finer from Hive CLI. Please help.
Regards,
Kiran G.

Re: tHiveRow not working to update Hive table

Anonymous — Wed, 20 Jan 2016 06:22:21 GMT

Hi,
What's the hive version you are using? Have you tried to check "Die on error" option in component tHiveRow to see if there is any error message printed on console?
Best regards
Sabrina

Re: tHiveRow not working to update Hive table

_AnonymousUser — Wed, 20 Jan 2016 06:59:29 GMT

Hi,
It is Hive 1.1.0 on Cloudera CDH5.4 YARN.
Yes - Die On Error selected and error message displayed.
Regards,
Kiran G.

Re: tHiveRow not working to update Hive table

Anonymous — Thu, 21 Jan 2016 03:50:34 GMT

Hi,
What does the error message look like?
Could you please post the whole error message into forum which will be helpful for us to locate this issue?
Best regards
Sabrina

Re: tHiveRow not working to update Hive table

_AnonymousUser — Thu, 21 Jan 2016 14:27:34 GMT

Hi,
No error message from tHiveRow and job for Update query is successfully completed - but when we go and the Database the record is not actually updated.
Below code is used in tHiveRow:
"set hive.support.concurrency=true;
set hive.enforce.bucketing=true ;
set hive.exec.dynamic.partition.mode=nonstrict;
set ive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
set hive.compactor.initiator.on=true;
set hive.compactor.worker.threads=10;
update hiveupdate set salary = 75000 where employeeid=10";
Even we removed ; for set statements and ran - but still no Luck.
Above same code - when copy pasted (with out set parameters too) at Hive CLI - it is working fine.
We have set up all above Set parameters in hive-site.xml and that's how Hive CLI working fine.
Not sure - why talend is unable to do this update transaction. Please help.
Regards,
Kiran G.

Re: tHiveRow not working to update Hive table

Anonymous — Fri, 22 Jan 2016 03:55:41 GMT

Hi,
On which build version you got this issue? open source or subscription version?
Best regards
Sabrina

Re: tHiveRow not working to update Hive table

_AnonymousUser — Fri, 22 Jan 2016 05:48:04 GMT

Hi,
It is Open Source (TOS BD 6.1.1).
Regards,
Kiran G.

Re: tHiveRow not working to update Hive table

Anonymous — Fri, 11 Mar 2016 19:12:44 GMT

You resolve this problem ?
I have also in talend this problem
Bruno

Re: tHiveRow not working to update Hive table

Anonymous — Fri, 11 Mar 2016 19:56:21 GMT

I haven't seen this problem, but try to split the query in 2 tHiverow.