Hi, I'm new to Talend and I have a couple of questions regarding tRunjob. I'd like to know if it's possible to pass a data flow to a tRunjob to compute, and if it is, what's the component used as an input in the child job. Regards, ml
Your job looks quite complex.
What I did in the past was a data modification tracking job which is comparing data, line by line, for several databases and schemas. But I?m not sure it relates to your situation.
I stored the differences (mainly the sql queries) in a configuration file. I dumped the output of the queries into temporary files. After this generalisation I was able to code the job with only few components because the differences where encapsulated in the files. The processing sub-job was run as a loop for every line in the configuration file.
My personal feeling is that TOS jobs should use temporary files a lot. In some cases it really simplifies the job design and I think file processing is so fast that it may not worth to try to keep the data in memory.
You can use tSocketInput/ tSocketOutput for parent ? child communication? My understanding was that when the child process is running the parent process can not process data at the same time.
tSocketInput/Output can be used for parent chid communication if used in addition of Multithreading. These components are probably one of the major new functionality of TOS 2.3 Regards,
Actually I took the context variables solution, I use a tFlowToIterate to transform the flow into and iteration and I store it into a context variable that I process into a child job that I call 2 times: one for each branch from the filter. Thank you for your answers. Regards.