A Redshift bulk data load component would be very useful. This component would package file uploads to S3 and copy command to bulk load data into Redshift. The existing tRedshiftOutput component does singleton row inserts which Redshift is not optimized for and heavily discourages.
Hi
I would suggest you to report a new feature in our bugtracker, right now, I invite you to test the 'Extend insert' feature on tRedshiftOutput which is available since v5.3.2. see
https://jira.talendforge.org/browse/DOCT-2117 Shong
Hi Wilson,
I am using Talend Open Studio 5.3.1 and I use (abuse) the component tRedshiftRow to put in the Copy-command instead of a query and it works fine. I also use Contexts with it so you can use it with Development, Acceptance and Production.
How do you load the S3 Bucket before performing the COPY? I thought there was an output component for S3, but the set seems only to hold components for local file up-/download. I would like to fetch data from other databases (MySQLs) and upload it to S3 and then COPY it to Redshift. Any suggestions around this? /Geuder
