Good approach to check for refresh date to start my ETL jobs

[Ameyy]

I am creating a staging area to land tables from ODS. What would be a good approach to check if ODS data load is complete.

ODS ETL RUN TABLE:

NAME START TIME END TIME.

Essentially I want to poll the end time and once it has the current date I can start executing my jobs.

Thanks

[Anonymous · Accepted solution]

Hi

In the beginning of job, read the end time from ODS and check it with current date, if it matches the condition, trigger another child job using runIf connector, eg:

tDBInput-main--tJavaRow--runIf---ETL jobs (call by tRunJob component)

I think you need to schedule the job to run time to time to check for the refresh date.

Regards

Shong

[Ameyy]

Shong,

Can we do this as part of PreJob?

[Anonymous]

Yes, you can do this as part of PreJob.