Automatically update newly added columns

Anonymous — Tue, 26 Feb 2019 15:53:19 GMT

Hi all,

I am looking for guidance, if the following routine can be automatized in Talend?

I have multiple Redshift tables, which are already containing billions of records, but sometimes I need to add new columns. All of the added columns should be NOT NULL and it must not have a default value. The workaround that we currently have, is that we implement the new columns with NOT NULL and a default value, then we are populating the column with data, after that we are creating a new table with the same columns, but without the default value, then we are loading everything from the source table to the newly created one, then we are dropping the original table, and renaming the newly created table.

So the steps are the following:

Adding new column with NOT NULL DEFAULT = something
Update new column with data
Create new database with same columns as the original one, but the new column are NOT NULL without default
Inserting everyhing from original table to the new table
Dropping the old table
Renaming the new table

Is it possible to automatize this procedure?

Re: Automatically update newly added columns

Anonymous — Thu, 07 Mar 2019 08:54:15 GMT

Hello,

Could you please elaborate your case with an example with input and expected output values?

Best regards

Sabrina

topic Automatically update newly added columns in Talend Studio

Automatically update newly added columns

Re: Automatically update newly added columns