Running multiple interdependent jobs one after othe

[Anonymous]

Hi,

I have a case where a Job has to be broken down to two sub jobs as I have to take the output of one job, do some modification (in the output table) and use it as an input to the next job. So, how to do it ? If i try to do something like in the screenshot below then it runs both the jobs simultaneously which I don't want.

[Anonymous]

Is Talend Data Stewardship also an Open Source or we need to buy it.

[Anonymous]

Talend Data Stewardship is only available as a paid product.  However, we include 2 free licenses of it with a Talend Platform product.

[Anonymous]

 Ok.

here i want to ask a couple of questions:

1) If Talend provides the option to customize jobs/ components, where are the options to do it.?

2) If for this job, which we have been discussing long time now(two interdependent jobs), I want to write a customized routine, which will lets's say allow me open up a GUI with the ability to load database table in it(in a tabular structure may be) and I look at the columns and have the ability to change values and click on 'Save' button to make changes in database.

This will do my job. So how difficult it's going to be, if feasible?

Kindly let me know all the options.

[Anonymous]

1) You build the jobs yourself, so you therefore customise them while building them. If you are talking about runtime dynamic functionality, you have to build this as well. You can use Context variables for this for example. Components come with configuration options and you can create your own components. Creating components is too difficult to explain how to do in a scenario like this. You will need to Google how to do this and then experiment. There are no easy answers to that.

2) I am not sure why you would do this. Talend jobs should not be considered GUI enabled. The jobs are not meant to work with GUIs. You *can* do this of course, but it is not something that can be done out of the box. You will need to build it in. You can emulate a very basic version of the stewardship console by yourself by loading data to a db table, setting up a JSP page (maybe using Tomcat) to display and allow editing of the data, and then load the edited data from the table onwards.

[Anonymous]

Ok. Thanks for the detailed reply.

Talking about point no. 2 below, the reason we wanna do it is that our client wants it that way

Anyways if I were to choose that option, then on completion of my first job, can I have a 'button' on UI on click of which I can invoke my webpage which loads the data in UI? Or how do I go about it if I want to link that web page?

[Anonymous]

Any replies on this?

[Anonymous]

Your UI can have a submit button that call a rest service. The rest service could trigger your DI job, or even actually do the actual processing, depending on whether your job is processing 1 record on each button submit, or hundreds/thousands of records on button submit.   

You can use any web i.e. HTML, JavaScript etc, to call you rest service.

[Anonymous]

No but this not clear. My question is how to connect the JSP page which I make, through Talend. The jsp page should be invoked when my first job is finished and I click let's say a 'Review' button on my Talend screen.

How to do this?

[Anonymous]

What @iburtally was suggesting was that you could use a Talend web service to either trigger your job or carry out the processing. Calling a web service would require simply firing a call to a URL (www.myserver.co.uk:8040/myService or localhost:8040/myService). 

I think you are making this a little more complicated than it needs to be though. 

[Anonymous]

Talend has products like Talend Data Stewardship for this kind of problem.  Or you can use a BPM workflow engine with custom UI.  

However, You can have your Talend Job call a tSystem with

chrome.exe google.com  command.  Change the URL to the one you built and it will open the webpage.  

Calling a Talend Job from a UI is straight forward since it is just a java process to call with Java.exe.