topic Re: Logging Exceptions along with Error Record Details during Data fetch. in Talend Studio

Logging Exceptions along with Error Record Details during Data fetch.

Anonymous — Sat, 19 Dec 2015 10:45:30 GMT

Hi Team,
We are using Talend Open Studio for Big data V6.1.0 to move data from MongoDB to oracle. We need to catch the exceptions/ errors while data fetch (tMongoDBInput) along with the error record. We tried using tLogCatcher/tFlowMeterCatcher, it is providing only the error details and not the error record details. The rejected records along with the error message is available only during tOracleOutput (Row-->Rejects). Please help us if there is any way to log both the error details (mostly java exception) and error record details during data fetch itself.
Regards,
Jebas

Re: Logging Exceptions along with Error Record Details during Data fetch.

Anonymous — Mon, 21 Dec 2015 04:14:03 GMT

Hi,
Is the error record details of "rejects" row from tOracleOutput not satisfying your needs? Have you already checked the option "Die on error" on tOracleOutput to catch the exception?
Best regards
Sabrina

Re: Logging Exceptions along with Error Record Details during Data fetch.

Anonymous — Mon, 21 Dec 2015 06:35:57 GMT

Hi Sabrina,
Thanks for your reply...
Rejects rows doesn't suffice our need, why because if a java exception is thrown during data fetch itself, that record is not getting processed and not getting flown to other components, hence there won't be any rejects during oracle insert. Only in logCatcher it is getting catch as java exception.
we haven't enabled dieOnError, as because we need to run the job even in case of any error and also if dieOnError is enabled, we won't get Rejects in OracleOutput rt?
Regards,
Jebas

Re: Logging Exceptions along with Error Record Details during Data fetch.

Anonymous — Mon, 28 Dec 2015 11:07:18 GMT

Hi Team,
please let us know, if there is any work around to capture error details along with error record during data fetch itself?
Regards,
Kingsly J

Re: Logging Exceptions along with Error Record Details during Data fetch.

Anonymous — Tue, 29 Dec 2015 02:40:31 GMT

Hi Kingsly J,
So far, there is no "Rejects" row from tOracleInput.
Here is a global variable((String)globalMap.get("tOracleInput_1_ERROR_MESSAGE")) which is generated by the component when an error occurs.
Best regards
Sabrina

Re: Logging Exceptions along with Error Record Details during Data fetch.

Anonymous — Tue, 29 Dec 2015 07:49:10 GMT

Hi Sabrina,
Thanks for your update. Can you people please consider this option(logging error record details during fetch also) in your future builds?
Regards,
Jebas

Re: Logging Exceptions along with Error Record Details during Data fetch.

Anonymous — Tue, 29 Dec 2015 08:36:37 GMT

Hi,
Feel free to create a new feature/work item jira issue on Talend Bug Tracker.
https://jira.talendforge.org/secure/Dashboard.jspa
Best regards
Sabrina

Re: Logging Exceptions along with Error Record Details during Data fetch.

Anonymous — Tue, 29 Dec 2015 09:51:51 GMT

Thank you Sabrina. Raised a jira ticket for the same.