topic Re: Connecting to Hive table in EMR in Talend Studio

Connecting to Hive table in EMR

Anonymous — Sat, 16 Nov 2024 07:49:47 GMT

Hello,

Can someone point me to some documentation on how to create a connection into Hive on EMR so I can load some data from sql server? I recently completed a POC for snowflake, and for the most part, it was quite straight forward. I am really struggling with what components to use, the flow required, etc.

Thanks for any help anyone can provide.

Pete

Re: Connecting to Hive table in EMR

Anonymous — Fri, 10 Aug 2018 09:19:13 GMT

Hi,

You can connect Hive in EMR as shown in below diagram.

Please also refer the documentation also specifying some scenarios to some quick validation.

https://help.talend.com/reader/g8zdjVE7fWNUh3u4ztO6Dw/nGGKRQsJnBeGy8dJaFGfkg

Warm Regards,

Nikhil Thampi

Re: Connecting to Hive table in EMR

Anonymous — Fri, 10 Aug 2018 18:51:29 GMT

Hi Nikhil,

I saw that already, but I cannot figure out what to put in for the various attributes. Espeically the resource manber, namenode, etc. and all port numbers. Are there any examples/defaults I could use?

Thanks, Pete

Re: Connecting to Hive table in EMR

Anonymous — Mon, 13 Aug 2018 15:03:06 GMT

hello,

I just read there should be some sub-options under teh Hadoop cluster connection type, but when I look at it, there is nothing:

https://help.talend.com/reader/VXLHZvns6nwhPGeQbm1Iig/j9w1lBy0GFLQxgLAE9aXNQ

Here is a screen shot of my connections:

How can I add in these options?

hadoop_connections.PNG