How to create single workflow with stage, CORE and Datamart jobs
Hello Friends,
I have to create one single workflow in talend to run Stage, CORE & Datamart jobs run one after another.
Each workflow has roughly 15 to 20 sub jobs in it. How can i design this kind of jobs in studio? Independently i have all the 3 workflows created & running.
With talend open studio, you could make use of TalendHelpCenter: tRunJob component which manages complex Job systems that need to execute one Job after another. It promotes reuse by passing different contexts to the same job.
With talend subscription solution, we provides customer with TalendHelpCenter: joblet feature which factorizes recurrent processing or complex transformation steps to ease the reading of a complex Job. It promotes reuse by passing different data to the same Joblet and can be reused in different Jobs or several times in the same Job.
@Xiaodi Shi : Yes, i implemented my logic using tRunJob component and it seems to be working fine. Although i noticed when i club all my stage jobs(around 20 sub jobs) into 1 job and then run, performance is way slower than when i run them individually under stage workflow. Is that normal behavior or we can improve this performance somehow?
How does your performance look like? What's the row rate rows/s? The screenshots of your job design will helpful for us to address your issue in a quick way.
