topic Re: Cloudera CDH5.10 (YARN mode) in Talend Studio

Cloudera CDH5.10 (YARN mode)

Lorenzo5 — Sat, 16 Nov 2024 09:18:02 GMT

Hi,

tHiveConnection Component permits to connect up to version 5.7 of Cloudera.

How to upgrade it let it able to connect to Cloudera 5.10 (YARN mode)?

Regards,

Lorenzo

Re: Cloudera CDH5.10 (YARN mode)

Irshad1 — Wed, 13 Sep 2017 15:25:31 GMT

Hello

You need to upgrade the talend version or apply new patches in order to connect to your new hadoop yarn version.

Thanks!

Re: Cloudera CDH5.10 (YARN mode)

Anonymous — Wed, 13 Sep 2017 17:31:54 GMT

@lorenzolucioni

as @fuzzyedy saild - Talend version 6.4 supports Cloudera 5.10.

However, if you do not want to upgrade Talend you can create a custom hadoop distribution in Talend. That will be a bit more complicated, you will need to download and provide all relevant jars and configure the distribution manually. If it is only Hive, it should be enough to create a new DB connection with the right JDBC jar. i'm adding a picture.

So, this is possible.

Re: Cloudera CDH5.10 (YARN mode)

Lorenzo5 — Thu, 21 Sep 2017 11:19:52 GMT

Hi @ohabushi,

thanks for your response.

In case we decided to upgrade to 6.4, should it only a Talend Studio upgrade or would it impact the TAC/JOB Servers too?

In case of we'd like to only configure a new DB Connection, which JAR should I download for this purpose?

Thanks in advance, regards,

Lorenzo

Re: Cloudera CDH5.10 (YARN mode)

Lorenzo5 — Fri, 29 Sep 2017 12:59:31 GMT

Hello @fuzzyedy and @ohabushi,

any answer for my question above, about the upgrade? Could I upgrade just the Studio or should I also upgrade the Job Servers?

Regards,

Lorenzi

Re: Cloudera CDH5.10 (YARN mode)

Anonymous — Fri, 29 Sep 2017 13:03:20 GMT

You should upgrade the Studio, CommandLine and the TAC together since there is a strong dependency between the 3.

For jobserver, this compatibility table applies https://help.talend.com/reader/eZxUKQZltvhAzhiffXeayw/rAs_XSjog8iMiddhV8Duew

Re: Cloudera CDH5.10 (YARN mode)

Anonymous — Fri, 29 Sep 2017 13:08:52 GMT

A migration will have to be full migration TAC, Studio job serer and so on. For that we have good documentation in our help page.

If you want to just connect to a new version of hive you should follow the custom distribution flow, it has a list of jars that are included in the lasted Cloudera distro that is in your studio version.

After that go into Cloudera home page and look for a list of jars of the the distro you want. see what the difference is between what you have in Talend and what Cloudera listed and replace what needs to be replaced