topic Re: Slow upsert in salesforce in Talend Studio

Slow upsert in salesforce

mani1304 — Wed, 11 Dec 2019 12:16:22 GMT

Hi,

I am upserting to salesforce, but the data is upserting at a very less pace around 5000 records get upserted in 45 min, Is there any way to do it faster.

Re: Slow upsert in salesforce

TRF — Wed, 11 Dec 2019 12:25:46 GMT

Are you using bulk component or not?
Did you compare response time with DataLoader?
Standard or custom object?
Do you have many process builder/workflow/validation rules/triggers on salesforce side?

Re: Slow upsert in salesforce

mani1304 — Wed, 11 Dec 2019 13:27:51 GMT

I am using tSalesforceOutput component of talend not custom one, can we make upsert fast in this component or these are for very small number of data and have to use bulk component.

Re: Slow upsert in salesforce

TRF — Wed, 11 Dec 2019 14:05:44 GMT

5000 records is a "very small" number of records.

You should not have performance issue due to this volume and Bulk is not required here.

I suggest you to compare performance with DataLoader for the same volume.

Also you should share your job design with details for tSalesforce component.

Re: Slow upsert in salesforce

mani1304 — Wed, 11 Dec 2019 15:36:10 GMT

I have checked Retrieve Id in the advance setting, that might be the reason, but I need salesforce id for further operation and Die on Error and Ignore Null is unchecked

Re: Slow upsert in salesforce

TRF — Wed, 11 Dec 2019 15:46:15 GMT

Retrieving salesforce Ids is an usual use case and this is not the root cause of poor performances.
Once again, compare with DL and if your job is really slower than DL then you probably have something wrong somewhere in your job but I can't guess where/what as soon as you don't share your design.

Re: Slow upsert in salesforce

mani1304 — Wed, 11 Dec 2019 15:57:11 GMT

I am not getting what design are you looking, there is an input file which is upserting the data in a salesforce object on the basis of key. Data loader, I need to check because I am new to this and not a salesforce developer.

Re: Slow upsert in salesforce

mani1304 — Thu, 12 Dec 2019 13:33:43 GMT

Hi,

Now, I need to upsert around 20k in my next iteration and its taking so much time, can you suggest how to fast proceed with this.

Re: Slow upsert in salesforce

Pooja_kataria — Thu, 29 Oct 2020 14:47:40 GMT

Hi,

You got how to solve this performance issue ?How did you solved it