Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in NYC Sept 4th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
Alpha549
Creator II
Creator II

ESB : prejob, postjob and log management in comparison with DI

Hello everyone,

 

I recently switched from Open Studio for DI to Open Studio for ESB.

 

In DI, I used tPrejob and tPostjob. Concerning logs, tLogCatcher, send rows in a CSV file, and an e-mail sending in case of error code 1.

 

I would like to know for ESB, how do one know if there is an error in the job, especially if it's deployed ?

Also, does it make sense to use tPrejob and tPostjob, especially tPostjob because actually en ESB job for a REST api never ends, isn't it ?

 

Can you tell me if my vision is correct concerning ESB ?

Labels (2)
1 Solution

Accepted Solutions
Anonymous
Not applicable

Hello,

DI is used to automate integrating data whereas ESB is used to automate integrating applications.

An important feature in ESB is ESB Route which mainly acts on message queues as a restful service.

We have log and error management in both DI and Mediation which depends on your requirement.

Please have a look at our online documentations about: TalendHelpCenter: Logs and errors (Mediation) and TalendHelpCenter: Logs and errors (Integration)

In processing mode, for routing, duplicating messages, scalability with ActiveMQ to transmit data between several routes (thus you can stop any one, the others will continue working, and MQ stores the messages, then the stopped route restarts.)

 A standard Job is more convenient for graphical design and integration of mapping between sources and output. It does make sense to use tPrejob and tPostjob. They're usually used as ETL for batch and bulk data processing.

 

There is some cross over between DI & ESB. A DI Job can be used to process messages; e.g., MS (MicroSoft) and MOM (Message Oriented Middleware) queues; and can be exposed as a Data Service; e.g., tRESTClient, tRESTRequest, tRESTResponse. Similarly, an ESB Route can be used to transform data; e.g., cAggregate and cContentEnricher, cTalendJob, cMap. However, DI functionality is best leveraged for complex data transformations and ESB functionality is best leveraged for complex message distributions.

Feel free to let us know if it helps for you.

Best regards

Sabrina

 

 

 

View solution in original post

3 Replies
Anonymous
Not applicable

Hello,

DI is used to automate integrating data whereas ESB is used to automate integrating applications.

An important feature in ESB is ESB Route which mainly acts on message queues as a restful service.

We have log and error management in both DI and Mediation which depends on your requirement.

Please have a look at our online documentations about: TalendHelpCenter: Logs and errors (Mediation) and TalendHelpCenter: Logs and errors (Integration)

In processing mode, for routing, duplicating messages, scalability with ActiveMQ to transmit data between several routes (thus you can stop any one, the others will continue working, and MQ stores the messages, then the stopped route restarts.)

 A standard Job is more convenient for graphical design and integration of mapping between sources and output. It does make sense to use tPrejob and tPostjob. They're usually used as ETL for batch and bulk data processing.

 

There is some cross over between DI & ESB. A DI Job can be used to process messages; e.g., MS (MicroSoft) and MOM (Message Oriented Middleware) queues; and can be exposed as a Data Service; e.g., tRESTClient, tRESTRequest, tRESTResponse. Similarly, an ESB Route can be used to transform data; e.g., cAggregate and cContentEnricher, cTalendJob, cMap. However, DI functionality is best leveraged for complex data transformations and ESB functionality is best leveraged for complex message distributions.

Feel free to let us know if it helps for you.

Best regards

Sabrina

 

 

 

Alpha549
Creator II
Creator II
Author

Hello @Xiaodi Shi​ ,

 

Thank you for your reply.

You said everything.

I will use ActiveMQ to manage my errors 🙂

 

Topic solved !

Anonymous
Not applicable

Hello,

Great it helps. Feel free to let us know if there is any further help we can give.

Best regards

Sabrina