Connectivity between Hive on-premise Azure Databricks Spark Cluster and Talend
Hello Community,
Is there a way to fetch data from Hive Tables on-premise Azure Databricks Spark Cluster? I have used Big Data Batch Job for this scenario after setting up the Spark Configuration. However, whenever I run the job it fails after loading the Spark libraries.
Starting job test_poc at 11:50 03/04/2019.
[ERROR]: org.talend.bigdata.launcher.databricks.DatabricksJob - Run terminated with status TERMINATED and result FAILED
Check logs on Spark UI for more information
[ERROR]: intergration_poc_talend.test_poc_0_1.test_poc - TalendJob: 'test_poc' - Failed with exit code: 1.
Job test_poc ended at 11:53 03/04/2019. [exit code=1]
Attached is the logs from Spark UI.
Currently , I'm using Enterprise v7.1.1 Talend Cloud Real Time Big Data Platform.
