Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in Bucharest on Sept 18th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
qlik_to_answer
Contributor
Contributor

Exists function with GCP

Hi 

I have a table in GCP with only two columns (id and value). I exported it to qvd (table1) and now I would like to load only values for such id's not already loaded - to get lower GCP costs and save time. If I had two qvd files I would just do this:

qlik_to_answer_0-1667568768423.png

 

But what if the second table (table2) is my GCP table?

qlik_to_answer_2-1667567713610.png

table1:
LOAD distinct id
FROM [lib://.../table1.qvd] (qvd);

LIB CONNECT TO 'Google BigQuery';

table2:
LOAD id, `value`;
SQL SELECT id, `value`
FROM ...`...`

[???]

drop table table1;

store table2...;

Thanks

Labels (2)
2 Replies
Rockstar7
Partner - Creator
Partner - Creator

Take resident of table 2 and apply where not exists()

qlik_to_answer
Contributor
Contributor
Author

Thanks for the answer, but I don't want to load the entire large table once and then reduce it. It causes a cost and the error "Response too large to return. Consider specifying a destination table in your job configuration" if the table is too large.