I'm currently syncing up various salesforce objects with my redshift cluster. I am currently just doing accounts and only getting ~2.5 rows/s.
I am not linking all columns only about 20 but still if I need to do this for all of my objects in salesforce it would take forever. Additionally doing a daily update of records would be troublesome as well.
The current linkage is: tSalesforceInput > tMap > tRedshiftOutput
My output is set to "action on table: drop and create table" (this is the only way I got it to work... not sure why create table did not) and "action on data: insert or update".
I am trying to get all of my objects into my redshift db before I start setting up regular update queries but I was quite surprised at this speed. Any tips or help would be greatly appreciated.
Thanks,
Brian
