tS3get - log errors

[danblo]

I have a job that reads a database to retrieve a list of file_names, what I later download from s3 using tS3get (iterate over the output from the database).  Some files are missing and I need to log them.  I tried using on error trigger and dump them to a text file, but it won't let me create that trigger.  What's the aproach I should take? 

[Anonymous · Accepted solution]

Hello,

Could you please post your current job design screenshots into forum? Are you using "Onsubjoberror" or "Oncomponenterror" trigger?

Best regards

Sabrina

[danblo]

[danblo]

I was trying to use "on component error".

[Anonymous]

Hi,

I have an idea to get the unprocessed file names, if any other solutions available, please share in the forum.

use "on component error" trigger from ts3Get and connect to tjava component.

In tJava, use a context variable and append with the file name variable (from tFlowToIterate)

eg: context.filaname=context.filaname+","+((String)globalMap.get("Filename"))

So at last your context.filename will contain all the file names with comma separated.

Use a fixedflowinput, use this context variable and divide using tNormalize and save into another file.

Job Design:

[danblo]

Good idea. I'll give it a try.

[Anonymous]

Hi,

If this is working, please accept my solution as resolved and press Kudos button