topic Re: store the dynamic values in context variable in Talend Studio

store the dynamic values in context variable

Karuetl — Fri, 13 Jul 2018 18:20:17 GMT

I am beginner in Talend , So need help

From the source I have ID column and I need to store the max value of ID into the context variable and use it in the query in the source in next run like as below

where clause as where ID > "+context.Max_ID+"

Please guide me how I can implement this

Re: store the dynamic values in context variable

TRF — Sat, 14 Jul 2018 07:28:40 GMT

Have a look to tContexDump and tContextLoad components

Re: store the dynamic values in context variable

Karuetl — Wed, 18 Jul 2018 15:07:12 GMT

Could you pls help me in steps

Re: store the dynamic values in context variable

TRF — Wed, 18 Jul 2018 16:33:33 GMT

Suppose you have a property file which contains the last Max_ID you've queried:

Key;Value
Max_ID;100

When the job starts, you can get the content from this file to populate your Max_ID context variable using tFileInputDelimited + tContextLoad components:

Now you can use the current Max_ID value in your query where clause.

From the result, you have to retrieve the new max value to update the Max_ID variable (using a tJavaRow or something else).

Finally, use a tContextDump to dump all the context variables, tFilterRow to keep only the key "Max_ID" and tFileOutputDelimited to overwrite the initial property file with the new Max_ID value:

Re: store the dynamic values in context variable

TRF — Sat, 21 Jul 2018 11:59:58 GMT

@Karuetl did this help you? If so, thank's to mark you case as Solved (Kudos also accepted)