Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi All,
We are extracting data from Salesforce through tMap then into Snowflake.
We are using tSalesforceInput - tMap - tDBOutput
When we run the job it completes fine but is taken hours to get the data. We have two objects one with 2.1 million rows which is taken 2 1/2 and one with 5 million rows which is taken over 5 hours. It is batching in rows of 250.
The batch size in the tSalesforceInput component is set to 250. If i increase this to 1000 it still only does batches of 250. If i go above 1000 the job errors.
Is there anything i can do to improve the speed?
@John Slator , you can try to use BULK connection option and see how it is performing?
Thanks,
Manohar