topic Re: Talend connection to Google Data proc in Installing and Upgrading

Talend connection to Google Data proc

ND2 — Fri, 15 Nov 2024 23:38:01 GMT

Hello,

I am doing a POC and wanted to install Talend. Do you recommend a Talend product that can connect to Google Data Proc cluster ? I see Talend has two products for Big data - Talend open studio for Big Data and Talend with Big Data. I am not sure which one of them has plugin which can connect to Data proc ? If so, where can i download the software. I am being redirected to sales page.

Re: Talend connection to Google Data proc

Anonymous — Wed, 13 Oct 2021 03:46:21 GMT

Hello,

Here is a TalendHelpCenter: tGoogleDataprocManage component which creates or deletes a Dataproc cluster in the Global region on Google Cloud Platform.

This component in this framework is available in all Talend products with Big Data and in Talend Data Fabric

With talend open studio for bigdata product, you can download the software from:

https://sourceforge.net/projects/talend-bigdata/

With talend subscription solution for bigdata, you need to contact our sale team.

https://www.talend.com/contact-sales/

Best regards

Sabrina

Re: Talend connection to Google Data proc

ND2 — Wed, 13 Oct 2021 06:12:39 GMT

Hello, Thanks for your reply. The connector that you mentioned will create a new Data proc cluster on my google account. But i already have a running Data proc cluster on my account and i am looking for a documentation on how to pass relevant cluster information while using hadoop components.

Re: Talend connection to Google Data proc

ND2 — Wed, 13 Oct 2021 06:13:47 GMT

Also if you can point me to any specific documents with using spark jobs will be great as well.

Re: Talend connection to Google Data proc

ND2 — Wed, 13 Oct 2021 06:15:00 GMT

I currently installed Talend Open Studio for Big Data and need to connect to hadoop components running on Data proc cluster.

Re: Talend connection to Google Data proc

Anonymous — Wed, 13 Oct 2021 08:58:19 GMT

Hello,

Please take a look at this documentation about: TalendHelpCenter: Google Dataproc distribution

Feel free to let me know if it is what you are looking for.

Best regards

Sabrina

Re: Talend connection to Google Data proc

ND2 — Wed, 13 Oct 2021 13:08:12 GMT

Hello Sabrina,

The documents says it doesn't apply to Talend Open Studio for Big Data users. Do you have anything for this product ?

"The information in this section is only for users who have subscribed to Talend Data Fabric or to any Talend product with Big Data but it is not applicable to Talend Open Studio for Big Data users."

Re: Talend connection to Google Data proc

Anonymous — Thu, 14 Oct 2021 03:10:04 GMT

Hello,

So far, there is no related documentation for Talend Open Studio for Big Data.

You are able to get a free trial solution from here.

Best regards

Sabrina