topic Re: tHiveConnection doesn't have a shared DB Connection option in Talend Studio

tHiveConnection doesn't have a shared DB Connection option

Anonymous — Thu, 27 Aug 2015 12:28:59 GMT

Hello,
I've downloaded Talend Open Studio BigData, and the tHiveConnection component doesn't have a "Use or register a shared DB Connection" check box as apposed to the documentation. I can't seem to find anywhere to download a new version of it.
Any ideas?
P.S
Does tHDFSConnection have "Use or register a shared DB Connection" check box?

Thanks

Re: tHiveConnection doesn't have a shared DB Connection option

willm1 — Thu, 27 Aug 2015 15:50:44 GMT

I checked in the licensed version (Platform edition for Big Data) and it didn't have that option either for the tHiveConnection component. I've made a note on the documentation page for tHiveConnection for Talend 5.6. tHiveConnection works fine, but even if it had this functionality (to share connections between parent & child jobs), I'd probably not use this feature a lot because if my job runs for long, it's possible that that hive connection could timeout. Obviously, this depends on how Hive is configured - running map reduce or tez or spark or other execution engines that may be faster. Especially for M/R that could be long running, it's not inconceivable that connections could timeout before all the steps in the job complete. Just a thought...

The documentation for tHDFSConnection component does not report that this component has this functionality.

Re: tHiveConnection doesn't have a shared DB Connection option

Anonymous — Fri, 28 Aug 2015 08:37:12 GMT

Hi guys,

Thanks for letting us know this issue.
"Use or register a shared DB Connection" option is only available when 'Mircrosoft HD Insight' distribution is selected. We have created a JIRA issue to inform our Doc team to update the documentation.

Many thanks!
Best regards
Sabrina

Re: tHiveConnection doesn't have a shared DB Connection option

willm1 — Fri, 28 Aug 2015 21:15:24 GMT

Ah! Thanks, Sabrina!

Re: tHiveConnection doesn't have a shared DB Connection option

Anonymous — Sun, 30 Aug 2015 07:40:07 GMT

Hi, Guys.
Thank you for your responses.
Is there going to be an edition for this connection to be shared?
What about tHDFSConnection?
Thanks

Re: tHiveConnection doesn't have a shared DB Connection option

Anonymous — Mon, 31 Aug 2015 03:47:47 GMT

Hi sysmq,
So far, there is no " Use or register a shared DB Connection" option supported in component tHDFSConnection https://help.talend.com/search/all?query=tHDFSConnection&content-lang=en-US
Feel free to create a new feature jira issue of DI project on Talend Bug Tracker.
https://jira.talendforge.org/secure/Dashboard.jspa

Best regards
Sabrina