Qlik Replicate Tasks Stopped: "Failed to Create Dataset" Error

[Varshini_123]

I am experiencing an issue with Qlik Replicate where all the replication tasks from an Oracle source to a BigQuery target are stopping automatically. The error message encountered is:

[Target_Load   ]E: Failed to create dataset QLIKREPLICATE_asia_south1

we have also verified connection settings for both Oracle and BigQuery for which connections were successful.

Given these concerns, we are seeking your expertise and guidance to provide a solution

[SachinB]

Hello @Varshini_123 ,

Thanks for contacting Qlik community forum.

Kindly follow the below community article for your error.

https://community.qlik.com/t5/Official-Support-Articles/Unqualified-INFORMATION-SCHEMA-queries-views...

https://community.qlik.com/t5/Support-Updates/Qlik-Replicate-and-Google-Big-Query-Issue-Identified/b...

If not resolved please create support case along with enhanced logs enabled for TARGET_LOAD.

Regards,
Sachin B

[john_wang]

Hello @Varshini_123 ,

Thanks for reaching out to Qlik Community!

IN gernal this error cause is in Google side, if it's a random error. After some time the problem will be disappeared.
If the problem persists, please share the Qlik Replicate version, and the dataset location,
for example is it in US, or Singapore or anywhere else?

Thanks,

John.

[Varshini_123]

Hi John,

We resumed the task after some time, but we are still facing the same issue.

Regards,
Varshini

[john_wang]

Hello @Varshini_123 ,

Thanks for the update. If the problem persists, would you please share the Qlik Replicate version, and the dataset location,for example is it in US, or Singapore or anywhere else.

If the above information contains sensitive information, please open a support ticket with above information, and also attach the task Diag Package, and "repsrv.log" file. Our support team will be more than happy to assist you.

Regards,

John.

[Varshini_123]

Hi John,

Our Qlik Replicate version is 2023.11.0.282 
dataset location is asia-south1.

We have also observed that there are limits on the current quota metrics, specifically 'Requests' and 'Requests per day,' for the project in GCP BigQuery.

Regards,
Varshini

[Varshini_123]

Hi John,

Our Qlik Replicate Version is 2023.11.0.282
Dataset location is asia-south1.

We have also observed that there are limits on the current quota metric, 'Requests,' as well as on the 'Requests per day' limits for the project.

Regards,
Varshini

[john_wang]

Hello @Varshini_123 ,
Thanks for the update. I think you got the root cause already, it's in Google BigQuery side. And I got below information from GoogleCloud Community:

I get that you wanted to understand what's driving your quota or limit exhaustion, one quick way is by checking the logs since Google Cloud keeps a record of all the activities in your project, it can assist you in identifying your essential quota or limit usage.

Please also consider exploring the "View and manage quotas" and the "Monitor and alert with quota metrics" documents as they are good alternatives relevant to your scenario, they can help you determine why you are getting the Error 429 message in BigQuery.

Hope this helps.

John.

[sureshkumar]

Hello @Varshini_123 

Kindly try checking in GBQ endpoint --> Advanced Setting --> "Do not create datasets"

Manually create table/dataset at the GBQ side and add the schema at the Target table schema/Create target control tables in schema:

Test the connection and run the task. Let us know the result.

Regards,
Suresh