topic Re: Metadata from a tRunJob in Talend Studio

Metadata from a tRunJob

vincecassel — Sat, 16 Nov 2024 01:59:07 GMT

Hi everybody,

I'm using Talend 7.1 Big Data and I am making some jobs with tRunJob to better schedule the refresh of the tables but I have a question:

if I want to know some metadata about the tables I'm refreshing, how can I do? (Like number of row, execution date, start execution time, end execution time and error log)

It's possible to insert all these information in a MySQL table?

Thank you

Re: Metadata from a tRunJob

vincecassel — Fri, 03 Jul 2020 16:09:01 GMT

I found the tStatCatcher that could help me, does anybody know how can I use it? (Taking the start execution time and the end execution time) Must I use a temporary table to make some join?

Re: Metadata from a tRunJob

vincecassel — Fri, 03 Jul 2020 16:09:01 GMT

I found the tStatCatcher that could help me, does anybody know how can I use it? (Taking the start execution time and the end execution time) Must I use a temporary table to make some join?

Re: Metadata from a tRunJob

Anonymous — Fri, 03 Jul 2020 17:47:33 GMT

@vincecassel - you have to design a post process framework. You can use tPostJob and then link a subjob all stats you et from tstatcatcher you can usee > tmap> then redirect to DB, simple. does that make sense.

Re: Metadata from a tRunJob

Anonymous — Fri, 03 Jul 2020 17:47:33 GMT

Re: Metadata from a tRunJob

vincecassel — Mon, 06 Jul 2020 11:45:25 GMT

Thank you for your reply.

I tried using a tPostJob but it looks like it doesn't work well.

Now I'm trying using Hash Table and joining them using Origin (to take the 2 different moments, for the start and end time), but they don't join themselves, although I use the same table with the same records.

Re: Metadata from a tRunJob

vincecassel — Mon, 06 Jul 2020 11:45:25 GMT

Thank you for your reply.

I tried using a tPostJob but it looks like it doesn't work well.

Re: Metadata from a tRunJob

Anonymous — Mon, 06 Jul 2020 18:41:37 GMT

send your problem statement and screenshot in details

Re: Metadata from a tRunJob

Anonymous — Mon, 06 Jul 2020 18:41:37 GMT

send your problem statement and screenshot in details

Re: Metadata from a tRunJob

vincecassel — Tue, 07 Jul 2020 11:13:30 GMT

I solved!

I put my tStatCatcher on a HashTable, checking "Keep All" and "Append" and it is ok!

(without those checks it didn't work)

Re: Metadata from a tRunJob

vincecassel — Tue, 07 Jul 2020 11:13:30 GMT

I solved!

I put my tStatCatcher on a HashTable, checking "Keep All" and "Append" and it is ok!

(without those checks it didn't work)