topic Re: Error in TOS BD HIVE ELT Step 2 Tutorial in Talend Studio

Error in TOS BD HIVE ELT Step 2 Tutorial

Anonymous — Sat, 16 Nov 2024 11:44:32 GMT

Hi,
I am trying to run the tutorial provided in TOS BD v5.4.1 titled Step_2_Hive_ELT. (I have completed the prior step to this as well). Each time I try and run the job provided in the tutorial I receive the following error:
java.io.IOException: Cannot run program "\usr\bin\hadoop.cmd" (in directory "C:\Users\dgoverman\Documents\TMO\HDL\Talend\TOS_BD-r111943-V5.4.1"): CreateProcess error=2, The system cannot find the file specified
I have simply downloaded and unzipped TOS, so I am unclear as to what file it is looking for and why it is missing. I am running this against HDP 1.3 (to avoid issues between Windows & Linux present with HDP 2.0). The use case I am trying to demonstrate is just a simple ELT job where two tables are joined to produce an output. Other jobs I have created to prove this simple case have encountered the exact same error. I have provided the full job log below for reference:
Starting job Step_2_Hive_ELT at 11:40 20/02/2014.

To see the whole post, download it here

Re: Error in TOS BD HIVE ELT Step 2 Tutorial

Anonymous — Fri, 21 Feb 2014 09:20:11 GMT

Hi,
This error appears when you have not set the Job Tracker in the Hive component.
Can you please check the "Set job tracker URI" option and define it?

Re: Error in TOS BD HIVE ELT Step 2 Tutorial

Anonymous — Fri, 21 Feb 2014 18:08:41 GMT

Hi Remy,
Thanks for the suggestion. However, I had already checked the "Set Jobtracker URI" checkbox and defined it as "sandbox:50300". This worked with a simpler example I built that just took two columns from one table and mapped them to insert into another table. However, in the tutorial (and other examples I have built that would join two tables and map them to insert into another table) I am still getting this error, even with the same jobtracker URI definition.
Any other ideas on how to resolve this error?
Thanks!

Re: Error in TOS BD HIVE ELT Step 2 Tutorial

Anonymous — Wed, 30 Apr 2014 09:08:13 GMT

Hello
I have the same problem, my jobTracker is correct but I have this error :
java.io.IOException: Cannot run program "\usr\bin\hadoop.cmd" (in directory "C:\TOS_BD-r111943-V5.4.1"): CreateProcess error=2, Le fichier spécifié est introuvable
It is very frustrating because depending on the query inside my tHiveRow, sometimes it works fine, sometime it stop with this error...
I tried to run the Talend exemple jobs like : GOV_SPENDING_ANALYSIS and it works fine...;
I also tried to put my query into the GOV_SPENDING_ANALYSIS jobs and ... the error appears !
Do you have an idea why i have this error ? Thanks !

Re: Error in TOS BD HIVE ELT Step 2 Tutorial

Anonymous — Wed, 17 Sep 2014 17:30:06 GMT

I have just encountered this same issue with a demo job that I built. My job tracker is set to 'sandbox:50300'. Why is it trying to run /usr/bin/hadoop.cmd from my studio. Shouldn't this be running on the hadoop server?