Talend Spark jobs uses Data Frames or RDD's for 7.3.1 version Spark jobs with Databricks 5.5 LTS 2.4 spark and 2.11 Scala
Hi Team,
I am using Talend real time bigdata with 7.3.1 version with Databricks cluster 5.5 LTS Spark 2.4 version and scala 2.11.
When I design a job will it create on Dataframes or RDD's. As I know RDD's are some what old Concept and slower than Dataframes and Datasets.
I read in a post that tsqlrow component will create dataframes, if so how to create a temp tabled from parquet files which are stored in azzure HDFS to use as a table in the talend job.
