topic Re: How to do Source Database schema changes into all job. in Talend Studio

How to do Source Database schema changes into all job.

gt0731 — Sat, 16 Nov 2024 10:00:28 GMT

Scenario
When ERP application Upgrade finished from front end . it also changes backend SQL schema. Our Talend jobs are using this schema as a input /source file.
Q1: How to propagate schema changes related to data length at target file ?
for Ex:
Customer is 7 digit . it becomes 15 digit now.
Q2: Need to write ETL Test case after ERP application upgrade ?steps for test case ?
Any help on it would be much appreciated ?

Re: How to do Source Database schema changes into all job.

Anonymous — Sun, 12 Mar 2017 21:55:19 GMT

Usually the length and precision are only be used if Talend has to create tables. Internally these settings has no effect at all. Your job should work without any problems. The only possible problem could be if you are using a schema check component, but if you use here also the metadata schema, everything should be ok.
Nevertheless I recommend always to run test jobs if such figures has been changed.

Re: How to do Source Database schema changes into all job.

gt0731 — Tue, 14 Mar 2017 17:38:47 GMT

Usually the length and precision are only be used if Talend has to create tables.

First of all thanks for answer ,Here talend is not creating table. For each job we have to create External and internal table in Greenplum database.

Data flow is :

Read from ERP Application -->Write into HDFS -->Create DDL External and internal table(Manually) --->on component ok ---->tgreenplumrow --->t..Commit.

Do we need to recreate new External and internal table for each test of job ?