Description:
When using Google Big Query as your Target Endpoint the loads to the target will fail because Replicate queries the INFORMATION_SCHEMA and if the region is not set it tries to create the DATASET in EU. Google docs refer to “When present, a region qualifier restricts results to the specified region.” - it seems however that when NO region qualifier is provided it assumes US.
Link to Google Changes:
https://cloud.google.com/bigquery/docs/information-schema-intro#syntax
Resolution:
Please do the following steps:
- Open the Big Query endpoint definition
- Click on the Advanced tab Internal Parameters
- In the search box for the parameter name type (case sensitive):
$info.query_syntax.check_schema_exist
For its vale enter - select count(*) from region-eu.INFORMATION_SCHEMA.SCHEMATA where SCHEMA_NAME = '${TABLE_OWNER}'
4. Save and restart the task.
Note: This would force Replicate to query with the syntax of 'region-eu'. Customers, use the relevant region value.