Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi Team
why cant we use some standard job components in spark job talend
For Example
tflowtoIterate cannot be used in talend batch job
Why what is the reason,Can you help me to Understand better
Thanks
Saranya
Hello,
So far, tflowtoIterate is available in Standard ETL only.
Due to the unavailability of tFlowToIterate component in Spark jobs, could you please use Standard jobs to achieve your goal?
Best regards
Sabrina
My question is why cant we use it
Thanks
Saranya
Hello,
Due to the nature of distributed Jobs, AMC, Context load and tflowtoiterate components are not supported in talend bigdata spark job, so far.
Hope this KB article :https://community.talend.com/t5/Architecture-Best-Practices-and/Spark-Dynamic-Context/ta-p/33038will help.
Best regards
Sabrina