Logging Exceptions along with Error Record Details during Data fetch.
Hi Team,
We are using Talend Open Studio for Big data V6.1.0 to move data from MongoDB to oracle. We need to catch the exceptions/ errors while data fetch (tMongoDBInput) along with the error record. We tried using tLogCatcher/tFlowMeterCatcher, it is providing only the error details and not the error record details. The rejected records along with the error message is available only during tOracleOutput (Row-->Rejects). Please help us if there is any way to log both the error details (mostly java exception) and error record details during data fetch itself.
Regards,
Jebas
Hi, Is the error record details of "rejects" row from tOracleOutput not satisfying your needs? Have you already checked the option "Die on error" on tOracleOutput to catch the exception? Best regards Sabrina
Hi Sabrina, Thanks for your reply... Rejects rows doesn't suffice our need, why because if a java exception is thrown during data fetch itself, that record is not getting processed and not getting flown to other components, hence there won't be any rejects during oracle insert. Only in logCatcher it is getting catch as java exception. we haven't enabled dieOnError, as because we need to run the job even in case of any error and also if dieOnError is enabled, we won't get Rejects in OracleOutput rt? Regards, Jebas
Hi Kingsly J, So far, there is no "Rejects" row from tOracleInput. Here is a global variable((String)globalMap.get("tOracleInput_1_ERROR_MESSAGE")) which is generated by the component when an error occurs. Best regards Sabrina
Hi Sabrina,
Thanks for your update. Can you people please consider this option(logging error record details during fetch also) in your future builds?
Regards,
Jebas
