Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi
I have a table in GCP with only two columns (id and value). I exported it to qvd (table1) and now I would like to load only values for such id's not already loaded - to get lower GCP costs and save time. If I had two qvd files I would just do this:
But what if the second table (table2) is my GCP table?
table1:
LOAD distinct id
FROM [lib://.../table1.qvd] (qvd);
LIB CONNECT TO 'Google BigQuery';
table2:
LOAD id, `value`;
SQL SELECT id, `value`
FROM ...`...`
[???]
drop table table1;
store table2...;
Thanks
Take resident of table 2 and apply where not exists()
Thanks for the answer, but I don't want to load the entire large table once and then reduce it. It causes a cost and the error "Response too large to return. Consider specifying a destination table in your job configuration" if the table is too large.