topic Talend and event driven architecture in Talend Studio

Talend and event driven architecture

Anonymous — Sat, 16 Nov 2024 12:35:59 GMT

Hi All,
Is it it possible to define a data model and change with several talend business models (related jobs) using "events" to trigger the data processing of specific jobs (transformation) ?
Thanks

Re: Talend and event driven architecture

Anonymous — Thu, 27 Oct 2011 12:39:56 GMT

There are many components that trigger events, mainly they will fire On Subjob Ok.
Socket components, filesystem components... it depends on which kind of event you need to monitor

Re: Talend and event driven architecture

Anonymous — Thu, 27 Oct 2011 16:43:07 GMT

Hi
Thanks for your answer, the idea here is to trigger a set of job with a business model.
I'm using an application server with a specific execution and programming model (JAIN SLEE).
In this model, SBB component ( in J2EE it can be seen as EJB) embed a specific service logic that can trigger and be triggered by events coming from resource adaptors or others SBBs.
The idea for me is to use the ETL to process business logic with a richer data model, based on events coming from SBB components.
Then, do you think the ETL approach is good?
Thanks

Re: Talend and event driven architecture

Anonymous — Fri, 28 Oct 2011 08:40:42 GMT

If you have to respond to specific events (and eventually do so in different kind of jobs), then you may want to build a component for that, something that would interface (directly or via a pre-existing layer) with your app server, the ETL might be the correct approach if the jobs you have to trigger are ETL tasks or anyway at least involve ETL needs.
Suppose you have x possible actions as a response to business rules that trigger events in your app server.
Then theoretically you could have a job getting the events and running child jobs, however you might even get a simpler implementation by simply deploying the various jobs as webservices and create a layer (not necessarily with Open Studio, might be some simple java module) that captures the events and calls the needed webservices.
Without using webservices, each job is anyway a java program, as such it can be executed by your intermediate layer.
Just ideas...

Re: Talend and event driven architecture

Anonymous — Fri, 28 Oct 2011 12:49:44 GMT

Thanks Saburo