Passing data from bigdata child job to standard parent job in talend 6.4

[TomG1]

Hi there,

Please note my special requirement of passing value from Child Spark job to Parent standard job.

I am aware that this is possible between two standard jobs using tBufferOutput.

Please help.

[rnathan2020]

Spark framework is way different and runs on many nodes. If it is Spark Streaming (Talend Real Time Big Data), you can publish the data to kafka / JMS and pick it up in normal talend job.. If it is Spark batch, you can not do this. You may have to pass via a HDFS file.