Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
ND2
Contributor
Contributor
‎2021-10-12 03:25 PM

Talend connection to Google Data proc

Hello,

I am doing a POC and wanted to install Talend. Do you recommend a Talend product that can connect to Google Data Proc cluster ? I see Talend has two products for Big data - Talend open studio for Big Data and Talend with Big Data. I am not sure which one of them has plugin which can connect to Data proc ? If so, where can i download the software. I am being redirected to sales page.

Labels (3)
Labels
603 Views
0 Likes
7 Replies
Anonymous
Not applicable
‎2021-10-12 11:46 PM

Hello,

Here is a TalendHelpCenter: tGoogleDataprocManage component which creates or deletes a Dataproc cluster in the Global region on Google Cloud Platform.

This component in this framework is available in all Talend products with Big Data and in Talend Data Fabric

With talend open studio for bigdata product, you can download the software from:

https://sourceforge.net/projects/talend-bigdata/

With talend subscription solution for bigdata, you need to contact our sale team.

https://www.talend.com/contact-sales/

Best regards

Sabrina

 

 

603 Views
0 Likes
ND2
Contributor
Contributor
‎2021-10-13 02:12 AM
Author

Hello, Thanks for your reply. The connector that you mentioned will create a new Data proc cluster on my google account. But i already have a running Data proc cluster on my account and i am looking for a documentation on how to pass relevant cluster information while using hadoop components.

603 Views
0 Likes
ND2
Contributor
Contributor
‎2021-10-13 02:13 AM
Author

Also if you can point me to any specific documents with using spark jobs will be great as well.

603 Views
0 Likes
ND2
Contributor
Contributor
‎2021-10-13 02:15 AM
Author

I currently installed Talend Open Studio for Big Data and need to connect to hadoop components running on Data proc cluster.

603 Views
0 Likes
Anonymous
Not applicable
‎2021-10-13 04:58 AM

In response to ND2

Hello,

Please take a look at this documentation about: TalendHelpCenter: Google Dataproc distribution

Feel free to let me know if it is what you are looking for.

Best regards

Sabrina

 

 

603 Views
0 Likes
ND2
Contributor
Contributor
‎2021-10-13 09:08 AM
Author

Hello Sabrina,

 

The documents says it doesn't apply to Talend Open Studio for Big Data users. Do you have anything for this product ?

 

 

"The information in this section is only for users who have subscribed to Talend Data Fabric or to any Talend product with Big Data but it is not applicable to Talend Open Studio for Big Data users."

603 Views
0 Likes
Anonymous
Not applicable
‎2021-10-13 11:10 PM

In response to ND2

Hello,

So far, there is no related documentation for Talend Open Studio for Big Data.

You are able to get a free trial solution from here.

Best regards

Sabrina

603 Views
0 Likes