topic Re: How to use a 'Last Update Date' in Talend Studio

How to use a 'Last Update Date'

Anonymous — Mon, 30 Oct 2017 11:14:55 GMT

I'm using Talend Open Studio for Data Integration (6.4.0).

Moving data from Oracle to PostgreSQL; only want to update the PostgreSQL tables with new records from Oracle.

Previous successful run, I store the 'Last_Update_Date' in a separate table in PostgreSQL.

The Oracle input tables have a 'Create_Date' field, which I can compare to the PostgreSQL 'Last_Update_Date', and only keep the Oracle records which have date greater than 'Last_Update_Date'.

In summary, I want to:

Read Oracle tables, compare 'Create_Date' to the 'Last_Update_Date' I previously stored in a PostgreSQL table, insert only new records into the PostgreSQL tables.

Thanks for the help!

Re: How to use a 'Last Update Date'

TRF — Mon, 30 Oct 2017 11:26:01 GMT

Hi,
Read the 'Last_Update_Date' max value from Postgresql and store the result into a global variable.
Then reuse this global to the Oracle where clause, giving something like:
"Create_Date > to_date('" + (String)globalMap.get("yourGlobal") + "')"

Re: How to use a 'Last Update Date'

Anonymous — Wed, 01 Nov 2017 19:18:29 GMT

Thanks! Works perfectly.

Re: How to use a 'Last Update Date'

Anonymous — Wed, 15 Apr 2020 20:29:56 GMT

Hi,
Please how can I read the 'Last_Update_Date' max value from mysql and store the result into a global variable.