How to use All standard job components in Big data Spark job
Hi All,
My requirement is to read data from Hive and doing lookup with Oracle Stored procedure result and loading to target database Oracle. I could do this using Standard job in Talend Big data but I want to implement this using Spark batch job to improve the performance. For that all required components are not there in Big data batch job. The other way to do this is calling this standard job in Big data batch job. But how it will work in Spark configuration, will it execution in Spark mode or in execute JVM. If so is there any other possibilities to do implement these kind of scenarios.
