topic Bulk connection not working in Talend Studio

Bulk connection not working

Anonymous — Sat, 16 Nov 2024 06:27:24 GMT

I have a Microsoft SQL Server database table and I need to upload that data to Salesforce on a regular basis. The job is set up, but the load is not utilizing the bulk connection.

The Salesforce connection I have set up (in the left pane) uses the bulk connection option. I have a tSalesforceConnection component in the job that points to that connection. My first component is a tMSSqlInput component that calls a stored procedure which returns the data from the database table. It goes through a tMap and then to a tSalesforceOutput component as an upsert. Fairly straightforward and the tSalesforceOutput component uses the tSalesforceConnection component to connect.

When I run the job, I can see the count ticking up row by row, not in chunks as I would expect. It takes 10-15 minutes to upload about 2,000 rows. I checked on the Salesforce web page for that instance and there is no history of a bulk job running.

Not sure what to check? Is there an issue with using a stored procedure to select the data and bulk connections in SF?

Thanks!

Re: Bulk connection not working

Anonymous — Fri, 01 Mar 2019 02:54:58 GMT

Hello,

Would you mind posting your job design screenshots on forum which will be helpful for us to address your issue.

Best regards

Sabrina

Re: Bulk connection not working

TRF — Fri, 01 Mar 2019 08:51:26 GMT

Hi,

If you want to bulkify your jobs you need to change tSalesforceOutput component by tSalesforceOutputBulkExec.

Re: Bulk connection not working

Anonymous — Thu, 07 Mar 2019 22:45:58 GMT

But the tSalesforceOutputBulkExec connector wants a bulk file path. I'm not uploading from a file, I'm uploading using a stored procedure call against a MS SQL Server database table.

Re: Bulk connection not working

Anonymous — Thu, 07 Mar 2019 23:03:47 GMT

Pics attached - thanks in advance for the help...!

SF Bulk Destination 1.png
SF Bulk Destination 2.png
SF Bulk Source.png

Re: Bulk connection not working

Anonymous — Mon, 11 Mar 2019 23:56:25 GMT

Anyone?

Re: Bulk connection not working

vatsal_ras — Fri, 22 Mar 2019 10:58:15 GMT

Hey you can write on some file first. Use that file and "tSalesforceBulkExec" to load data. After that you can delete the file.