How do I get a column count that is visible in the talend run console and move that to an email with some formatting? I am using GPLoad, and I see the row counts for insert/delete/update/error within the log file. My problem is that even with the errors, the job completes successfully (though no records are inserted), and there is no notification for me to know this was a failed job. When I go back and take a look at the logs, I see the Error/insert/update counts, but it is a manual process for me. What I would like is to get the console message into email as an alert to particular list of users in case of job has not successfully added rows in the run.
So far, I have tried a tFileRowCount for the input csv file for gpload, and a select count(*) from target table, exporting that to a csv and running a binary tally between the two of them using tFileCompare, tAssert to throw up the match/mismatch, then tSendEmail.
tfileinput(raw file used in gpload) -- tgpload--tgpinput (select count(*)) -- tfileoutputdelimited (2)
|
tFileRowCount--(raw file+ (2))
|
tfilecompare --tassert - tsendmail
I feel like I am adding extra steps. Please help me.. Thanks