Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in Toronto Sept 9th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

talend spark

hi,
i am planning to do POC for spark with Talend. which Talend version has to install .is there any links or material for how to install spark and integration of  Talend and spark 
Labels (2)
1 Reply
Anonymous
Not applicable
Author

Talend version - At minimum, you'll need Talend Open Studio for Big Data.  I'd suggest getting Talend 6.3 or 6.2.  You can see more details about versioning here:  https://help.talend.com?content-lang=en?_ga=1.266165839.1394013088.1477338163
Leverage Spark in Talend - 
In Talend Studio, create a Big Data Batch job and select 'Spark' as your framework.  Ensure you have the libraries needed for the version of Spark you are going to be developing.  In Talend Studio click navigate to 'Help' -> 'Installation Details' -> 'Plug-ins' and ensure all Spark plugins are installed.  You can run Spark jobs locally, but ensure you set up winutils.exe:  https://help.talend.com/search/all?query=The+missing+winutils.exe+program+in+the+Big+Data+Jobs&conte...