how to update bulk records in redshift?

[k526]

HI ,

I need to load daily lakhs of records in redshift.so i need to insert or update the data.by using tredshiftbulkoutputexec we can do insert operation only.by if i used tredshiftoutput for 1 lakh records it takes more than 6 hours.

is there any way to update ?

can any one help me ?

Thank you

[vapukov · Accepted solution]

---

---

lakhs of records

When You use a local terms, ожидайте неожиданного ответа

but in any case:
- bulk insert into stage table

- INSERT FROM SELECT WHERE NOT EXISTS

- UPDATE WHERE EXISTS

it also will be hard operation, but much faster than remote INSERT/UPDATE

[majum2p]

I too have similar requirement except i have quite a few transformation logic. i am using tRedshiftInput , tMap and tRedshiftOutput for insert and tRedshiftRow for update. looking for any other patterns for performance optimization.
P.S. creating stage table is not a good solution for me as i have hundreds of tables to update/insert.

[Anonymous]

How we can use tredshiftrow if the insert/update has to be made from postgres source data.

for example tpostgresinput --> tmap -->tredhsifptoutput?

[Anonymous]

How we can use tredshiftrow if the insert/update has to be made from postgres source data.

for example tpostgresinput --> tmap -->tredhsifptoutput?

[Anonymous]

Did we have solution for the below.

[Anonymous]

Did we have solution for the below.