tspark* Component

shrikavi2008 — Sat, 16 Nov 2024 10:35:10 GMT

Hi,
The tspark* components are not available in Talend 6.0.
Q1 . Can you please let me know, how to connect the spark from Talend ? Is the only way to connect is configure the spark Configuration in "Run View" of Talend spark Jobs ?
Q2. We have spark setup in AWS. Is it possible to connect it from Talend Studio and this talend studio is not in cloud. it is in Physical machine ?

Regards,
ShriKavi

Re: tspark* Component

Anonymous — Tue, 14 Jun 2016 04:13:54 GMT

Hi,

Spark components were delivered as Technical Preview in v5.6 but couldn't leverage the full Studio big data capabilities such as turning a standard Job into an M/R Job then into a Streaming Job.
The effortless migration of a M/R jobs to Spark was one of the key requirements in our 6.0 (subscription) roadmap.
However the development of this capability involved an overal change of the way we handled Spark so that it becomes natively part of the Code generator.
The maintenance issue made it impossible for us to keep two different sets of components generating Spark (given all links to Hadoop distros and versions) and thus we had to drop the initial tSpark** components.
Please get more details on our Talend 6 "What's New" page:http://www.talend.com/products/talend-6

Best regards

Sabrina

topic tspark* Component in Talend Studio

tspark* Component

Re: tspark* Component