Insert in Salesforce if last update date is greater than last modified date

[Anonymous]

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Source view

Tot_ID	Reason	Status	……..other details	LastUpdateDate
TID_1	R1	Submitted	XYZ	2019-10-25 01:35:55
TID_2	R1	Submitted	XYZ	2019-10-23 02:20:30

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------

After execution of flow…..

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Target Lynx:

SFDC_ID	External_Id	Reason	Status	……..other details	Operation
Asdasdasda1212	TID_1	R1	Submitted	XYZ	INSERT
Asdasdasda1213	TID_2	R1	Submitted	XYZ	INSERT

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Now data in source

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Source view

Tot_ID	Reason	Status	……..other details	LastUpdateDate
TID_1	R1	Submitted	XYZ	2019-10-25 01:35:55
TID_2	R1	Submitted	XYZ	2019-10-23 02:20:30
TID_3	R1	Submitted	XYZ	2019-10-26 10:40:16

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------

After execution of flow……..

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Target Lynx:

SFDC_ID	External_Id	Reason	Status	……..other details	Operation	Comments
Asdasdasda1212	TID_1	R1	Submitted	XYZ	No operation	No change in LastUpdateDate 2019-10-25 01:35:55
Asdasdasda1213	TID_2	R1	Submitted	XYZ	No operation	No change in LastUpdateDate 2019-10-25 01:35:55
Asdasdasda1214	TID_3	R1	Submitted	XYZ	INSERT	New record - LastUpdateDate > 2019-10-25 01:35:55

Source.LastUpdateDate > Max(previous all LastUpdateDate) in salesforce

If records not found, insert rows in Salesforce

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Now data in source

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Source view

Tot_ID	Reason	Status	……..other details	LastUpdateDate
TID_1	R1	Submitted	XYZ	2019-10-25 01:35:55
TID_2	R2	Submitted	abc	2019-10-26 12:20:30
TID_3	R1	Submitted	XYZ	2019-10-26 10:40:16

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------

After execution of flow……..

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Target Lynx:

SFDC_ID	External_Id	Reason	Status	……..other details	Operation	Comments
Asdasdasda1212	TID_1	R1	Submitted	XYZ	No operation	No change in LastUpdateDate 2019-10-25 01:35:55
Asdasdasda1213	TID_2	R2	Submitted	abc	Update	Update, change in LastUpdateDate 2019-10-26 12:20:30> 2019-10-26 10:40:16
Asdasdasda1213	TID_3	R1	Submitted	XYZ	No operation	No change in LastUpdateDate 2019-10-26 10:40:16

Step:2 If existing records found, update the records in Salesforce

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------

[Anonymous · Accepted solution]

Hello,

My actual question is :

1. I have to extract the data on daily basic from SQL.

2: Store in buffer or anywhere in talend.

3: Take the latest modified date form the data.

4: process latest data into target.

5: and again next day only i have to take latest records from SQL and process.

For E.G.

its a daily run

in 1st ran all records inserted into target,

in 2nd ran only latest records is inserted and lastupdated date column is available in SQL.

Suppose, in 1st ran full records(400) is inserted, but in 2nd run only 10 records is new records so i need to insert only 10 records and store the latest date in talend to compare again with new upcoming records.

Thanks for your help