How to use hive SQL context and spark sql context in tsqlrow of Talend big data job

[Anonymous]

Hi Experts,

I am new to Talend big data job (Spark). I am trying to read data from thiveinput and generating a file but facing below error. The same cluster connections are working fine in data integration job but not working in big data job. In addition, are there any documents available to use Spark components in Talend (like tSQLrow for hive and Spark context,thiveinput, etc)? 

[WARN ]: org.apache.spark.util.Utils - Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
[ERROR]: org.apache.spark.SparkContext - Error initializing SparkContext

Thanks,

Punnam 

[Anonymous]

Hello,

We are supposing that you are aware that each component has pieces of information indicating the families they belong to and the conditions for their eventual availability.

The search on Talend Help Center can help on this. As you arer using Talend BigData solution, here are the different lists for Big data Jobs on different frameworks in your product

Spark Batch: https://help.talend.com/search/all?query=*+properties+in+Spark+Batch+Jobs&filters=EnrichVersion~%252...

Spark Streaming: https://help.talend.com/search/all?query=*+properties+in+Spark+streaming+Jobs&filters=EnrichVersion~...

Let us know if it is OK with you.

Screenshots of your bigdata job setting screenshots will be preferred.

Best regards

Sabrina