topic Re: Catch all type of errors in Talend Studio

Catch all type of errors

McJingles — Sat, 16 Nov 2024 03:49:31 GMT

How to catch all types of errors in Talend.?

Is there any examples of generating an error and catch those errors.

Please let me know how to do that.

Thanks in Advance..!!

Re: Catch all type of errors

Anonymous — Mon, 16 Dec 2019 05:58:39 GMT

Hi
You can use tLogCatcher to catch the Java error, customize error thrown by tDie component. To generate an example error for testing, use tFileInputDelimited to read the a file that does not exist, it will thrown FileNotFound Java exception.

Regards
Shong

Re: Catch all type of errors

McJingles — Mon, 16 Dec 2019 06:24:21 GMT

Thanks @shong

But, I can catch Java exception error and SQL query error by using tLogCatcher alone.

How can I catch the errors like Data truncation and Type mismatch: int to string errors.?

Capture.JPG

Re: Catch all type of errors

Anonymous — Mon, 16 Dec 2019 06:42:10 GMT

If these error occurs on DB components, and you want to catch them, check the 'Die on error' box, these SQL error will be thrown out and can be captured by tLogCatcher.

Re: Catch all type of errors

McJingles — Mon, 16 Dec 2019 06:58:55 GMT

Thanks @shong

And one more is how can I catch the mismatch type error like int to string which occurs in the tMap component.?

Re: Catch all type of errors

Anonymous — Mon, 16 Dec 2019 07:13:58 GMT

The mismatch type error is Java exception error, make sure the 'die on error' box is checked on tMap.

Re: Catch all type of errors

McJingles — Mon, 16 Dec 2019 07:28:54 GMT

There is no such option in the tMap component, @shong

Re: Catch all type of errors

Anonymous — Mon, 16 Dec 2019 07:52:42 GMT

Hello,

Please see the setting screenshot.

Best regards

Shong

Re: Catch all type of errors

tnewbie — Mon, 16 Dec 2019 16:30:35 GMT

Hello Shong,

Enabling 'Die on Error' would fail the job, is there where the job would still move on and enable us to capture the errors.

Example:

I have Million records in my source table, 999999th record has a data value that will be truncated, if I enable 'Die on Error' this error will be captured but my job would fail, is there a way where i would still continue and be able to capture the error?

Thanks

Re: Catch all type of errors

Anonymous — Tue, 17 Dec 2019 08:05:15 GMT

@tnewbie, it is possible capture the error and continue to process next record, you need to iterate the records one by one, but the performance is bad if the data volume is big.

Re: Catch all type of errors

tnewbie — Tue, 17 Dec 2019 14:46:54 GMT

Thanks Shong...can you kindly share a reference/snippet of the job design you may have, so that i can learn how it is done.

Also, from the tools perspective, can you please look into the commonality of the issue and do something ? because every job doesn't need to fail just because one among the many have error ed out. The ability of capturing the DB level or data level errors only on 'Die on errors' looks subsidized and many need an uplift.

Please share your thoughts and also a job prototype if you have...Many thanks

Re: Catch all type of errors

AbassYawar — Tue, 16 Mar 2021 11:43:39 GMT

i am also searching the answer for same query.

How to catch errors on each and every tdbrow components without job failure. @Shicong Hong