talend spark

Anonymous — Sat, 16 Nov 2024 10:05:28 GMT

hi,
i am planning to do POC for spark with Talend. which Talend version has to install .is there any links or material for how to install spark and integration of Talend and spark

Re: talend spark

Anonymous — Sun, 12 Feb 2017 21:07:56 GMT

Talend version - At minimum, you'll need Talend Open Studio for Big Data. I'd suggest getting Talend 6.3 or 6.2. You can see more details about versioning here: https://help.talend.com?content-lang=en?_ga=1.266165839.1394013088.1477338163
Leverage Spark in Talend -
In Talend Studio, create a Big Data Batch job and select 'Spark' as your framework. Ensure you have the libraries needed for the version of Spark you are going to be developing. In Talend Studio click navigate to 'Help' -> 'Installation Details' -> 'Plug-ins' and ensure all Spark plugins are installed. You can run Spark jobs locally, but ensure you set up winutils.exe: https://help.talend.com/search/all?query=The+missing+winutils.exe+program+in+the+Big+Data+Jobs&content-lang=en?_ga=1.137838320.1394013088.1477338163

topic talend spark in Talend Studio

talend spark

Re: talend spark