Qlik Replicate Write method in Google Big query

harsh2 — Tue, 23 Jan 2024 09:22:46 GMT

Hi Qlik Team,

I'm curious about the writing method Qlik Replicate uses in Big Query. Can you provide some insights?

Thanks,

Harsh

Re: Qlik Replicate Write method in Google Big query

john_wang — Tue, 23 Jan 2024 09:37:22 GMT

Hello @harsh2 ,

Thanks for reaching to Qlik Community!

By default Qlik Replicate utilize the interim CSV files to LOAD the data (in Full Load stage, it's history data records, in CDC stage it's change data records) to Google BigQuery rather than INSERT the data rows straightly to gain better performance. Qlik Replicate composes the .CSV files (at Qlik Replicate Server) and then call LOAD command, upload the .CSV files to BigQuery storage then merge the data from interim CSV files to final target table(s).

If you like you may set TARGET_LOAD & TARGET_APPLY to Verbose or Trace to get more information to understand the behavior further.

Hope this helps.

John.

topic Re: Qlik Replicate Write method in Google Big query in Qlik Replicate

Qlik Replicate Write method in Google Big query

Re: Qlik Replicate Write method in Google Big query