topic Re: Connect to Hive database in Talend Studio

Connect to Hive database

Anonymous — Sat, 16 Nov 2024 12:59:05 GMT

I am not able to connect to Hive database can anyone help me out

Re: Connect to Hive database

Anonymous — Wed, 13 Apr 2011 16:27:04 GMT

When i am using general JDBC during connection with the Hive database i am passing everything correctly even then its not able to connect to the database

Re: Connect to Hive database

Anonymous — Thu, 14 Apr 2011 06:19:20 GMT

DB Type: General JDBC
JDBC Url: jdbc:hive://<iP Address>172.17.197.95:<port No.>8099/<databasename>default
Driver Jar: /usr/local/Talend/lib/java/hive-jdbc-0.5.0.jar
Class Name : org.apache.hadoop.hive.jdbc.HiveDriver

After giving all these details also i am not able to connect to the database
please help me out in establishing the database connection

Re: Connect to Hive database

Anonymous — Thu, 14 Apr 2011 07:24:30 GMT

Hi honeybakliwal
I don't have a Hive database installation here, so I can't test it now and I will do it later. Can you create a routine to test this code (JDBC Client Sample Code)and see if it connect successfully to your Hive.
http://wiki.apache.org/hadoop/Hive/HiveClient
Let me know your test result!
Best regards
Shong

Re: Connect to Hive database

Anonymous — Thu, 14 Apr 2011 07:26:48 GMT

import java.sql.SQLException;
import java.sql.Connection;
import java.sql.ResultSet;
import java.sql.Statement;
import java.sql.DriverManager;
public class HiveJdbcClient {
private static String driverName = "org.apache.hadoop.hive.jdbc.HiveDriver";
/**
* @param args
* @throws SQLException
*/
public static void main(String[] args) throws SQLException {
try {
Class.forName(driverName);
} catch (ClassNotFoundException e) {
// TODO Auto-generated catch block
e.printStackTrace();
System.exit(1);
}
Connection con = DriverManager.getConnection("jdbc:hive://localhost:10000/default", "", "");
Statement stmt = con.createStatement();
String tableName = "testHiveDriverTable";
stmt.executeQuery("drop table " + tableName);
ResultSet res = stmt.executeQuery("create table " + tableName + " (key int, value string)");
// show tables
String sql = "show tables '" + tableName + "'";
System.out.println("Running: " + sql);
res = stmt.executeQuery(sql);
if (res.next()) {
System.out.println(res.getString(1));
}
// describe table
sql = "describe " + tableName;
System.out.println("Running: " + sql);
res = stmt.executeQuery(sql);
while (res.next()) {
System.out.println(res.getString(1) + "\t" + res.getString(2));
}
// load data into table
// NOTE: filepath has to be local to the hive server
// NOTE: /tmp/a.txt is a ctrl-A separated file with two fields per line
String filepath = "/tmp/a.txt";
sql = "load data local inpath '" + filepath + "' into table " + tableName;
System.out.println("Running: " + sql);
res = stmt.executeQuery(sql);
// select * query
sql = "select * from " + tableName;
System.out.println("Running: " + sql);
res = stmt.executeQuery(sql);
while (res.next()) {
System.out.println(String.valueOf(res.getInt(1)) + "\t" + res.getString(2));
}
// regular hive query
sql = "select count(1) from " + tableName;
System.out.println("Running: " + sql);
res = stmt.executeQuery(sql);
while (res.next()) {
System.out.println(res.getString(1));
}
}
}

Re: Connect to Hive database

Anonymous — Thu, 14 Apr 2011 07:28:47 GMT

i have alread used this also but no success

Re: Connect to Hive database

Anonymous — Thu, 14 Apr 2011 07:33:16 GMT

Hi
Create a job contains tHiveConnecton and run the job. Have you changed the port from 10000 to 8099?
Best regards
Shong

Re: Connect to Hive database

Anonymous — Thu, 14 Apr 2011 08:05:11 GMT

ya i have done dat also

Re: Connect to Hive database

Anonymous — Thu, 14 Apr 2011 08:09:10 GMT

but neither i am able to see the tables present in hive neither able to fetch the data
i am surprised when the driver is already present there even then y it is nt able to connect to it

Re: Connect to Hive database

Anonymous — Fri, 15 Apr 2011 05:19:01 GMT

Hi
So you have to check the db installation is completely or not, have you turned off the firewall? Can you connect to Hive database with other client tool?
Best regards
Shong