topic Re: tS3get - log errors in Talend Studio

tS3get - log errors

danblo — Sat, 16 Nov 2024 09:03:49 GMT

I have a job that reads a database to retrieve a list of file_names, what I later download from s3 using tS3get (iterate over the output from the database). Some files are missing and I need to log them. I tried using on error trigger and dump them to a text file, but it won't let me create that trigger. What's the aproach I should take?

Re: tS3get - log errors

Anonymous — Tue, 14 Nov 2017 07:15:33 GMT

Hello,

Could you please post your current job design screenshots into forum? Are you using "Onsubjoberror" or "Oncomponenterror" trigger?

Best regards

Sabrina

Re: tS3get - log errors

danblo — Tue, 14 Nov 2017 15:32:59 GMT

Re: tS3get - log errors

danblo — Tue, 14 Nov 2017 15:38:51 GMT

I was trying to use "on component error".

Re: tS3get - log errors

Anonymous — Wed, 15 Nov 2017 11:29:56 GMT

Hi,

I have an idea to get the unprocessed file names, if any other solutions available, please share in the forum.

use "on component error" trigger from ts3Get and connect to tjava component.

In tJava, use a context variable and append with the file name variable (from tFlowToIterate)

eg: context.filaname=context.filaname+","+((String)globalMap.get("Filename"))

So at last your context.filename will contain all the file names with comma separated.

Use a fixedflowinput, use this context variable and divide using tNormalize and save into another file.

Job Design:

Re: tS3get - log errors

danblo — Wed, 15 Nov 2017 21:37:30 GMT

Good idea. I'll give it a try.

Re: tS3get - log errors

Anonymous — Thu, 16 Nov 2017 04:38:03 GMT

Hi,

If this is working, please accept my solution as resolved and press Kudos button