Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hello Talend-Community,
I've got a problem with the tBigQueryInput component. I am using talend to extract data from Google Analytics and push this data to Google Big Query every day. Within this workflow, I am deleting the entries from the last two days, in case of data changes and insert the fresh data.
Unfortunately, using the DELETE command via tBigQueryInput loads the whole raw table before the Component finishes. The problem here for me is, that some of my tables have tens of millios of rows - so this takes forever.
Does anyone know why this is the case and how to prevend this?
Thanks so much, looking forward to your feedback!
Hello,
Have you tried to specify the data that you want to delete or update? Would you mind posting your tBigQueryInput Delete statement here?
Starting from V 7.1.1, talend has already added support for "Standard SQL" in Bigquery.
Best regards
Sabrina