Skip to main content
Announcements
Join us at Qlik Connect for 3 magical days of learning, networking,and inspiration! REGISTER TODAY and save!
cancel
Showing results for 
Search instead for 
Did you mean: 
qlik_to_answer
Contributor
Contributor

Exists function with GCP

Hi 

I have a table in GCP with only two columns (id and value). I exported it to qvd (table1) and now I would like to load only values for such id's not already loaded - to get lower GCP costs and save time. If I had two qvd files I would just do this:

qlik_to_answer_0-1667568768423.png

 

But what if the second table (table2) is my GCP table?

qlik_to_answer_2-1667567713610.png

table1:
LOAD distinct id
FROM [lib://.../table1.qvd] (qvd);

LIB CONNECT TO 'Google BigQuery';

table2:
LOAD id, `value`;
SQL SELECT id, `value`
FROM ...`...`

[???]

drop table table1;

store table2...;

Thanks

Labels (2)
2 Replies
Rockstar7
Partner - Creator
Partner - Creator

Take resident of table 2 and apply where not exists()

qlik_to_answer
Contributor
Contributor
Author

Thanks for the answer, but I don't want to load the entire large table once and then reduce it. It causes a cost and the error "Response too large to return. Consider specifying a destination table in your job configuration" if the table is too large.