connect HDFS and hive using spark framework

[mshafeeq]

Hello,

i'm asking if there is anyway to connect/run spark job (big data batch) containing Thdfsput ,thivecreatetable and thiveload components ?

also same for impala components

thanks.

[Anonymous · Accepted solution]

Hello,

You are able to configure tHDFSConfiguration ,tHiveInput, tHiveOutput and tHiveConfiguration components running in the Spark Batch Job framework.

thdfsput, thivecreatetable and thiveload are running in the Standard Job framework.

Regarding of this online component reference about: TalendHelpCenter:ImpalaComponent

Impala components are running in the Standard Job framework as well not the Spark Batch job.

Best regards

Sabrina