topic Re: Partial data Load from one schema to other schema through Talend Job in Talend Studio

Partial data Load from one schema to other schema through Talend Job

Ritz05 — Fri, 15 Nov 2024 22:52:33 GMT

Currently we have created a merge statement script in snowflake and calling it in Talend job to load data from TRNS schema to RAW schema table.

Its good at performance standpoint, but now we need to achieve Partial data load in this case if at all in errors comes during merging the data and as well as need to get rejected rows too in Talend job.

Please suggest.

Re: Partial data Load from one schema to other schema through Talend Job

Anonymous — Tue, 31 May 2022 03:24:20 GMT

Can you provide more details about your job? Which component do you use to call the merge statement script?

Regards

Shong

Re: Partial data Load from one schema to other schema through Talend Job

KStevenson1653542555 — Tue, 31 May 2022 07:22:24 GMT

Looking for a close to issue. Expecting more reply.

www.mybalancenow.com

Re: Partial data Load from one schema to other schema through Talend Job

Ritz05 — Tue, 31 May 2022 11:18:37 GMT

We have table A created in DB schema X. need to load table B in DB schema Y. A and B having same number of columns and data type. currently datatype is matching in both the schemas for table A and B for column to column. but it may change get in future.

Created a Talend job to load data in Table B from table A by using merge statement. It is Update Insert operation while loading data in table B on the basis of primary key.

A procedure has been developed in snowflake database which includes Merge statement of tables. This procedure is being called in tDBRow_1 component in Talend Job.