Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

DELETE or INSERT query with tBigQueryInput component loads complete table content after command

Hello Talend-Community, 

 

I've got a problem with the tBigQueryInput component. I am using talend to extract data from Google Analytics and push this data to Google Big Query every day. Within this workflow, I am deleting the entries from the last two days, in case of data changes and insert the fresh data. 

 

Unfortunately, using the DELETE command via tBigQueryInput loads the whole raw table before the Component finishes. The problem here for me is, that some of my tables have tens of millios of rows - so this takes forever. 

Does anyone know why this is the case and how to prevend this?

 

Thanks so much, looking forward to your feedback!

Labels (2)
1 Reply
Anonymous
Not applicable
Author

Hello,

Have you tried to specify the data that you want to delete or update? Would you mind posting your tBigQueryInput Delete statement here?

Starting from V 7.1.1, talend has already added support for "Standard SQL" in Bigquery.

Best regards

Sabrina