We're using talend data integration 6.5.1. We try to export our clients from Salesforce (Account object) and use this query: "SELECT Id, PersonEmail FROM Account"
There's about 4M records.
To make this request, we use tSalesforceInput, with the following options: - connexion type: basic - query mode: bulk - timeout: 1800000
Our Talend job fails 2 minutes after beginning with the following error: "Exception in component tSalesforceInput_2 (Alim_RCU_Oneshot) org.talend.components.api.exception.ComponentException: org.talend.daikon.exception.error.DefaultErrorCode@7ef82753:{failedBatch=[BatchInfo id='7510Q000001gX65QAE' jobId='7500Q000001zNZUQA2' state='InProgress' stateMessage='null' createdDate='java.util.GregorianCalendar[time=1553695116000,areFieldsSet=true,areAllFieldsSet=true,lenient=true,zone=sun.util.calendar.ZoneInfo[id="GMT",offset=0,dstSavings=0,useDaylight=false,transitions=0,lastRule=null],firstDayOfWeek=2,minimalDaysInFirstWeek=4,ERA=1,YEAR=2019,MONTH=2,WEEK_OF_YEAR=13,WEEK_OF_MONTH=4,DAY_OF_MONTH=27,DAY_OF_YEAR=86,DAY_OF_WEEK=4,DAY_OF_WEEK_IN_MONTH=4,AM_PM=1,HOUR=1,HOUR_OF_DAY=13,MINUTE=58,SECOND=36,MILLISECOND=0,ZONE_OFFSET=0,DST_OFFSET=0]' systemModstamp='java.util.GregorianCalendar[time=1553695121000,areFieldsSet=true,areAllFieldsSet=true,lenient=true,zone=sun.util.calendar.ZoneInfo[id="GMT",offset=0,dstSavings=0,useDaylight=false,transitions=0,lastRule=null],firstDayOfWeek=2,minimalDaysInFirstWeek=4,ERA=1,YEAR=2019,MONTH=2,WEEK_OF_YEAR=13,WEEK_OF_MONTH=4,DAY_OF_MONTH=27,DAY_OF_YEAR=86,DAY_OF_WEEK=4,DAY_OF_WEEK_IN_MONTH=4,AM_PM=1,HOUR=1,HOUR_OF_DAY=13,MINUTE=58,SECOND=41,MILLISECOND=0,ZONE_OFFSET=0,DST_OFFSET=0]' numberRecordsProcessed='0' numberRecordsFailed='0' totalProcessingTime='0' apiActiveProcessingTime='0' apexProcessingTime='0' ] } at org.talend.components.salesforce.runtime.SalesforceBulkRuntime.doBulkQuery(SalesforceBulkRuntime.java:525) at org.talend.components.salesforce.runtime.SalesforceBulkQueryInputReader.executeSalesforceBulkQuery(SalesforceBulkQueryInputReader.java:114) at org.talend.components.salesforce.runtime.SalesforceBulkQueryInputReader.start(SalesforceBulkQueryInputReader.java:56) at org.talend.codegen.flowvariables.runtime.FlowVariablesReader.start(FlowVariablesReader.java:73) at XXX_flux_talend.alim_rcu_oneshot_0_1.Alim_RCU_Oneshot.tSalesforceInput_2Process(Alim_RCU_Oneshot.java:3751) at XXX_flux_talend.alim_rcu_oneshot_0_1.Alim_RCU_Oneshot.tFileInputDelimited_3Process(Alim_RCU_Oneshot.java:1935) at XXX_flux_talend.alim_rcu_oneshot_0_1.Alim_RCU_Oneshot.runJobInTOS(Alim_RCU_Oneshot.java:7694) at XXX_flux_talend.alim_rcu_oneshot_0_1.Alim_RCU_Oneshot.main(Alim_RCU_Oneshot.java:7301)"
On salesforce side, there's no error, we can see that our bulk job lasted 4 minutes et ended well. We can even see the results.
We already made a case in salesforce but they told us that the problem was in Talend.
Third try: juste a simple salesforce input that goes to a csv file.
Results:
- bulk mode: error
- query mode (2000 batch size): ok (but last nealry 2 hours)
Detailled errors:
- Bulk mode:
Démarrage du job POC_SFSC_Export a 14:05 15/04/2019. [statistics] connecting to socket on port 3621 [statistics] connected log4j:ERROR Could not connect to remote log4j server at [localhost]. We will try again later. Exception in component tSalesforceInput_3 (POC_SFSC_Export) org.talend.components.api.exception.ComponentException: org.talend.daikon.exception.error.DefaultErrorCode@52719fb6:{failedBatch=[BatchInfo id='7511t000004eeMSAAY' jobId='7501t000004csSGAAY' state='InProgress' stateMessage='null' createdDate='java.util.GregorianCalendar[time=1555329956000,areFieldsSet=true,areAllFieldsSet=true,lenient=true,zone=sun.util.calendar.ZoneInfo[id="GMT",offset=0,dstSavings=0,useDaylight=false,transitions=0,lastRule=null],firstDayOfWeek=2,minimalDaysInFirstWeek=4,ERA=1,YEAR=2019,MONTH=3,WEEK_OF_YEAR=16,WEEK_OF_MONTH=3,DAY_OF_MONTH=15,DAY_OF_YEAR=105,DAY_OF_WEEK=2,DAY_OF_WEEK_IN_MONTH=3,AM_PM=1,HOUR=0,HOUR_OF_DAY=12,MINUTE=5,SECOND=56,MILLISECOND=0,ZONE_OFFSET=0,DST_OFFSET=0]' systemModstamp='java.util.GregorianCalendar[time=1555329956000,areFieldsSet=true,areAllFieldsSet=true,lenient=true,zone=sun.util.calendar.ZoneInfo[id="GMT",offset=0,dstSavings=0,useDaylight=false,transitions=0,lastRule=null],firstDayOfWeek=2,minimalDaysInFirstWeek=4,ERA=1,YEAR=2019,MONTH=3,WEEK_OF_YEAR=16,WEEK_OF_MONTH=3,DAY_OF_MONTH=15,DAY_OF_YEAR=105,DAY_OF_WEEK=2,DAY_OF_WEEK_IN_MONTH=3,AM_PM=1,HOUR=0,HOUR_OF_DAY=12,MINUTE=5,SECOND=56,MILLISECOND=0,ZONE_OFFSET=0,DST_OFFSET=0]' numberRecordsProcessed='0' numberRecordsFailed='0' totalProcessingTime='0' apiActiveProcessingTime='0' apexProcessingTime='0' ] } at org.talend.components.salesforce.runtime.SalesforceBulkRuntime.doBulkQuery(SalesforceBulkRuntime.java:525) at org.talend.components.salesforce.runtime.SalesforceBulkQueryInputReader.executeSalesforceBulkQuery(SalesforceBulkQueryInputReader.java:114) at org.talend.components.salesforce.runtime.SalesforceBulkQueryInputReader.start(SalesforceBulkQueryInputReader.java:56) at org.talend.codegen.flowvariables.runtime.FlowVariablesReader.start(FlowVariablesReader.java:73) at XXX_flux_talend.poc_sfsc_export_0_1.POC_SFSC_Export.tSalesforceInput_3Process(POC_SFSC_Export.java:1423) at XXX_flux_talend.poc_sfsc_export_0_1.POC_SFSC_Export.runJobInTOS(POC_SFSC_Export.java:5368) at XXX_flux_talend.poc_sfsc_export_0_1.POC_SFSC_Export.main(POC_SFSC_Export.java:4823) [statistics] disconnected Job POC_SFSC_Export terminé à 14:08 15/04/2019. [Code sortie=1]
