topic Re: Multiple temp tables merge into main DB table in Talend Studio

Multiple temp tables merge into main DB table

Parikhharshal — Wed, 19 Dec 2018 05:46:23 GMT

Hi experts

Is there anyway to merge multiple temp tables into main redshift table?

Pls note that all temp tables have same data type and format.

Thanks
Harshal.

Re: Multiple temp tables merge into main DB table

Anonymous — Wed, 19 Dec 2018 05:55:17 GMT

Hi Harshal,

Please refer the below stack overflow link for the same.

https://stackoverflow.com/questions/28413132/can-i-copy-from-one-table-to-another-in-redshift

You can run the command in Talend using the component tRedhsiftRow.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: Multiple temp tables merge into main DB table

Parikhharshal — Wed, 19 Dec 2018 06:01:23 GMT

@nikhiltampi: Thanks for your reply. I have got solution where earlier I was copying all the files into redshift table. That was taking lot of time as my files were in number 20k but very small ones like contained only 10 to 15 records.

To this alternative, I thought I could instead create temp tables instead of creating files and then put all multiple temp tables data into main redshift table. Hope this makes sense now.

The link you gave I’m aware of it. But looking for better option to improve performance of job. Although what you mentioned is correct that I can use insert into command but I have many temp tables which I want to insert into one table.

Re: Multiple temp tables merge into main DB table

Parikhharshal — Wed, 19 Dec 2018 06:24:55 GMT

@nthampi: I’m looking something for this sort of stuff:

https://community.talend.com/t5/Design-and-Development/Loading-multiple-table-from-source-into-multiple-table-into/td-p/47535

The only difference is I have got multiple table to one table.