topic Re: Talend 5.3.1 Redshift Bulk Load Component in Talend Studio

Talend 5.3.1 Redshift Bulk Load Component

Anonymous — Thu, 25 Jul 2013 21:42:36 GMT

A Redshift bulk data load component would be very useful.
This component would package file uploads to S3 and copy command to bulk load data into Redshift.
The existing tRedshiftOutput component does singleton row inserts which Redshift is not optimized for and heavily discourages.

Re: Talend 5.3.1 Redshift Bulk Load Component

Anonymous — Fri, 26 Jul 2013 02:17:26 GMT

Hi
I would suggest you to report a new feature in our bugtracker, right now, I invite you to test the 'Extend insert' feature on tRedshiftOutput which is available since v5.3.2. see
https://jira.talendforge.org/browse/DOCT-2117
Shong

Re: Talend 5.3.1 Redshift Bulk Load Component

Anonymous — Mon, 07 Oct 2013 21:35:08 GMT

Hi Wilson,
I am using Talend Open Studio 5.3.1 and I use (abuse) the component tRedshiftRow to put in the Copy-command instead of a query and it works fine. I also use Contexts with it so you can use it with Development, Acceptance and Production.

Re: Talend 5.3.1 Redshift Bulk Load Component

Anonymous — Thu, 26 Dec 2013 09:01:45 GMT

How do you load the S3 Bucket before performing the COPY?
I thought there was an output component for S3, but the set seems only to hold components for local file up-/download.
I would like to fetch data from other databases (MySQLs) and upload it to S3 and then COPY it to Redshift.
Any suggestions around this?
/Geuder