Skip to main content
Announcements
Introducing Qlik Answers: A plug-and-play, Generative AI powered RAG solution. READ ALL ABOUT IT!
cancel
Showing results for 
Search instead for 
Did you mean: 
JSlatorMHC
Contributor
Contributor

tSalesforceInput slow

Hi All,

We are extracting data from Salesforce through tMap then into Snowflake.

We are using tSalesforceInput - tMap - tDBOutput

When we run the job it completes fine but is taken hours to get the data. We have two objects one with 2.1 million rows which is taken 2 1/2 and one with 5 million rows which is taken over 5 hours. It is batching in rows of 250.

The batch size in the tSalesforceInput component is set to 250. If i increase this to 1000 it still only does batches of 250. If i go above 1000 the job errors.

Is there anything i can do to improve the speed?

Labels (4)
1 Reply
manodwhb
Champion II
Champion II

@John Slator​ , you can try to use BULK connection option and see how it is performing?

 

Thanks,

Manohar