A Qlik Replicate task with a Salesforce source endpoint may encounter the following task log error on some tables:
[SOURCE_UNLOAD ]E: An DATASET_ERROR error occurred unloading dataset: .<tableName> (custom_endpoint_util.c:1155)
The endpoint server log files (if the logging level is set to TRACE or VERBOSE) will read:
"errorMessage" : "Failure during batch processing: InvalidBatch : Query processing exception: OPERATION_TOO_LARGE: exceeded 100000 distinct who/what's"
Environment
- Qlik Replicate, All versions
- Salesforce Endpoint, All Versions
Cause
The issue is related to user permissions. When a user without the View All Data permission runs a task on activities involving a large number of related records, Salesforce may throw a "Query processing exception: OPERATION_TOO_LARGE: exceeded 100000 distinct who/what's" error, indicating that more than 100,000 distinct who/what's records were queried.
Resolution
The Salesforce administrator should grant View All Data permission to the affected user's profile. Once this permission is enabled, the task will run successfully without errors.
