tDynamoDBInput_1 filter expression with Global Variable date type or Long

CostinMarzea — Sat, 16 Nov 2024 00:38:32 GMT

Hi,

It is a simple filter expression with updated_at column > max(last run)

I've created GlobalVar to get max(last date updated) in dwh layer, so data type is Datetime2 19 positions "yyyy-MM-dd HH:mm:ss" with the value :

2021-02-09 11:27:59

also I've created A string GlobalVar to get max(last date updated) as original string in dwh layer, so data type is String with the value "

1612862879.914776

the updated_at column in the source is String 100 which consist of epoch date time conversion with the value i.e.

"1611885640.620273"

I convert the string to long and then to Date using those commands :

row3.UPDATED_AT==null?-1:Long.parseLong(StringHandling.TRIM(row3.UPDATED_AT.substring(0,10)))
out5.UPDATED_AT_long==-1

?TalendDate.parseDate("yyyy-MM-dd HH:mm:ss","1900-01-01 HH:mm:ss",true)

:new java.util.Date(out5.UPDATED_AT_long*1000)

I created 2 Global mac just in case:

((Date) globalMap.get("max_date")) 2021-02-09 11:27:59

((String) globalMap.get("max_updated_at")) 1612862879.914776

I need assistance please how to use it in tDynamoDBinput_1

in filter expression or in advanced filter expression , and please dont forget that the column in the source comes in String Type

Thank you

topic tDynamoDBInput_1 filter expression with Global Variable date type or Long in Talend Studio