Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable
‎2019-01-24 05:24 AM

'Insert Overwrite' into a partition in hive table equilant functionality in Bigquery?

Hi Everyone,

We are in the process of migrating from hdfs/hive to GCS/Bigquery infrastructer and using Talend v6.3 bigdata edition for ETL logic.Most of the hive tables are being partitioned and while loading we are using 'INSERT OVERWRITE' syntax in hiverow component while inserting data into a perticular partion.

Now we need to replace hive with bigquery table with same metadata and partition details.I dont see option INSERTOverwrite in Bigquery!

 

Could someone help me on how do i implement similar 'InsertOverwrite Logiv' in Bigquery which is currently we are doing in Hive?

Thanks in advance and much appreciated any suggestion.

Sam

Labels (3)
Labels
592 Views
0 Likes
1 Reply
vapukov
Master II
Master II
‎2019-01-24 09:11 PM

no features in Talend component for this, but as a variant, you could use command line client for this:

 

https://cloud.google.com/bigquery/docs/bq-command-line-tool

https://cloud.google.com/bigquery/docs/reference/standard-sql/dml-syntax

https://stackoverflow.com/questions/51079803/bq-command-line-for-dml

 

592 Views
0 Likes