Skip to main content
Announcements
A fresh, new look for the Data Integration & Quality forums and navigation! Read more about what's changed.
cancel
Showing results for 
Search instead for 
Did you mean: 
mani1304
Creator

Slow upsert in salesforce

Hi,

 

I am upserting to salesforce, but the data is upserting at a very less pace around 5000 records get upserted in 45 min, Is there any way to do it faster.

Labels (2)
8 Replies
TRF
Champion II

Are you using bulk component or not?
Did you compare response time with DataLoader?
Standard or custom object?
Do you have many process builder/workflow/validation rules/triggers on salesforce side?
mani1304
Creator
Author

I am using tSalesforceOutput component of talend not custom one, can we make upsert fast in this component or these are for very small number of data and have to use bulk component.

TRF
Champion II

5000 records is a "very small" number of records.

You should not have performance issue due to this volume and Bulk is not required here.

I suggest you to compare performance with DataLoader for the same volume.

Also you should share your job design with details for tSalesforce component.

mani1304
Creator
Author

I have checked Retrieve Id in the advance setting, that might be the reason, but I need salesforce id for further operation and Die on Error and Ignore Null is unchecked

TRF
Champion II

Retrieving salesforce Ids is an usual use case and this is not the root cause of poor performances.
Once again, compare with DL and if your job is really slower than DL then you probably have something wrong somewhere in your job but I can't guess where/what as soon as you don't share your design.
mani1304
Creator
Author

I am not getting what design are you looking, there is an input file which is upserting the data in a salesforce object on the basis of key. Data loader, I need to check because I am new to this and not a salesforce developer.

mani1304
Creator
Author

Hi,

 

Now, I need to upsert around 20k in my next iteration and its taking so much time, can you suggest how to fast proceed with this.

Pooja_kataria
Contributor III

Hi,

 

You got how to solve this performance issue ?How did you solved it