Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik GA: Multivariate Time Series in Qlik Predict: Get Details
cancel
Showing results for 
Search instead for 
Did you mean: 
harsh2
Partner - Contributor III
Partner - Contributor III

Qlik Replicate Write method in Google Big query

Hi Qlik Team,

I'm curious about the writing method Qlik Replicate uses in Big Query. Can you provide some insights?

Thanks,

Harsh

Labels (1)
1 Solution

Accepted Solutions
john_wang
Support
Support

Hello @harsh2 ,

Thanks for reaching to Qlik Community!

By default Qlik Replicate utilize the interim CSV files to LOAD the data (in Full Load stage, it's history data records, in CDC stage it's change data records) to Google BigQuery rather than INSERT the data rows straightly to gain better performance. Qlik Replicate composes the .CSV files (at Qlik Replicate Server) and then call LOAD command, upload the .CSV files to BigQuery storage then merge the data from interim CSV files to final target table(s).

If you like you may set TARGET_LOAD & TARGET_APPLY to Verbose or Trace to get more information to understand the behavior further.

Hope this helps.

John.

Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!

View solution in original post

1 Reply
john_wang
Support
Support

Hello @harsh2 ,

Thanks for reaching to Qlik Community!

By default Qlik Replicate utilize the interim CSV files to LOAD the data (in Full Load stage, it's history data records, in CDC stage it's change data records) to Google BigQuery rather than INSERT the data rows straightly to gain better performance. Qlik Replicate composes the .CSV files (at Qlik Replicate Server) and then call LOAD command, upload the .CSV files to BigQuery storage then merge the data from interim CSV files to final target table(s).

If you like you may set TARGET_LOAD & TARGET_APPLY to Verbose or Trace to get more information to understand the behavior further.

Hope this helps.

John.

Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!