topic Re: How to use Spark Components in Talend Studio

How to use Spark Components

_AnonymousUser — Sat, 16 Nov 2024 11:17:20 GMT

Hi,
I have design one simple job which will load delimited file using spark.
My Job is-
tSparkConnection-->tSparkLoad-->tSparkLog
In tSparkConnection i have selected Sparkmode as Local.
In tSparkLoad I have selected source delimited file.
But,
After running it gives me error- type org.apache.spark.api.java.JavaRDD can not be resolved. It is indirectly referenced from required .class file.
I am using Talend enterprise Bigda 5.6.1
Regards,
Kiran

Re: How to use Spark Components

Anonymous — Thu, 19 Mar 2015 03:29:57 GMT

Hi,
Is there any x-mark in your job design? Could you please show us your job setting screenshot?

Best regards
Sabrina

Re: How to use Spark Components

_AnonymousUser — Thu, 19 Mar 2015 08:49:09 GMT

Hi Sabrina,
I am not able to login TalendForge.org. After Signin it is re-directing to Talend.com again.
And because of that I can't upload screenshot. Can I send you screenshot mail?.
Regards,
Kiran Bhoknal.

Re: How to use Spark Components

Anonymous — Thu, 26 Mar 2015 07:32:28 GMT

Hi Kiran Bhoknal,

Sorry for delay.
Could you please l og out and log in again and check again the Forum to see if it is working? What's the browsers you are using?

Best regards
Sabrina

Re: How to use Spark Components

Anonymous — Fri, 27 Mar 2015 08:03:17 GMT

Hello,
Can you please build the job you use (right click on the job name --> Build job), open the generated archive and look for a jar named "spark-assembly-xxxxx.jar" in the lib folder ?
Cheers,

Re: How to use Spark Components

_AnonymousUser — Fri, 27 Mar 2015 12:51:29 GMT

Hi,
Thanks for reply guys.
Now I want to load data into Cassandra processed through spark components but I think Talend is not providing this facility.
Can you please give me suggestion that how to load data into Cassandra through spark components Using Talend?

Regards,
Kiran Bhoknal