Incremental Loading using Oracle DB as Source and SQL server as Target

Anonymous — Wed, 09 Jan 2019 05:07:26 GMT

Hi all,

I wanted to perform an incremental load having Oracle DB as source and SQL server as Target DB.

Have Attached the screenshot regarding the job designing Phase. Initially, I created a table in Oracle as Incrementalload having columns TableName, IncrementDate1 where the tables names and the date is inserted. In the first Input component, I have written the query as "select Incrementaldate1 from Incrementalload where TableName like 'po_vendors'" and in the Tjavarow component I have the code context.Incrementaldate1 = input_row.INCREMENTALDATE1; . In the next input component, I have "select * from po_vendors where last_update_date>'" + TalendDate.formatDate("dd-MM-yyyy", context.Incrementaldate1) + "'"

This is the brief of the job designed phase. When I run the job I get the following error,

Exception in component tDBInput_5 (Incremental_Load_ACC_MAP)
java.lang.NullPointerException
at java.util.Calendar.setTime(Unknown Source)
at java.text.SimpleDateFormat.format(Unknown Source)
at java.text.SimpleDateFormat.format(Unknown Source)
at java.text.DateFormat.format(Unknown Source)
at routines.TalendDate.formatDate(TalendDate.java:135)
at craftsman_test.incremental_load_acc_map_0_1.Incremental_Load_ACC_MAP.tDBInput_5Process(Incremental_Load_ACC_MAP.java:3452)
at craftsman_test.incremental_load_acc_map_0_1.Incremental_Load_ACC_MAP.tDBInput_1Process(Incremental_Load_ACC_MAP.java:1201)
at craftsman_test.incremental_load_acc_map_0_1.Incremental_Load_ACC_MAP.runJobInTOS(Incremental_Load_ACC_MAP.java:6373)
at craftsman_test.incremental_load_acc_map_0_1.Incremental_Load_ACC_MAP.main(Incremental_Load_ACC_MAP.java:6169)

Kindly help to proceed further. This one is an urgent requirement.

Thanks,

Sowmiya Ranganathan

Re: Incremental Loading using Oracle DB as Source and SQL server as Target

Anonymous — Wed, 09 Jan 2019 09:24:10 GMT

Hello,

From your screenshot, we see that you are using tMSSQLConnection component without any trigger(OnSubjobOK or OnComponentOK). The sqlserver data will be not transferred into the next component.

In addition to that, here is Change Data Capture feature in talend subscription solution which simplifies the process of identifying the change data since the last extraction.

Best regards

Sabrina

Re: Incremental Loading using Oracle DB as Source and SQL server as Target

Anonymous — Wed, 09 Jan 2019 13:24:45 GMT

Hi xdhsi,

Kindly can you help me out with the CDC feature of Talend with the steps to implement it having Oracle as source and SQL server as Target.

Thanks,

Sowmiya

topic Incremental Loading using Oracle DB as Source and SQL server as Target in Talend Studio

Incremental Loading using Oracle DB as Source and SQL server as Target

Re: Incremental Loading using Oracle DB as Source and SQL server as Target

Re: Incremental Loading using Oracle DB as Source and SQL server as Target