Over the last couple of days when we try to insert data into Google Cloud Platform Bigquery using Talend the jobs are failing with the below error message,
Whenever this failure happens the data does not get loaded into the table and we had to do multiple reruns to load the data into the tables. Usually succeeds in consecutive attempts.
This error is happening at random not specific to any particular table. These insert statements were working very well for more than a year so I do not think there is some issue with the SQL statements.
We are just clueless if any setting got updated at Talend end recently.
Does the task randomly fail when executing in TMC against the Remote engine?
We see that it failed in the Google Bigquery Row component. What's query in tBigQuerySQLRow? On the big query side, did you check the activity o see what's requests being made for your execution of the job?
The inserts fail at both places, from local studio and ran from TMC as well.
We did check the logs from bigquery, but looks like this failure is not captured there. If the same insert query is run from Bigquery console it is running fine without any issues.
It looks like a standalone issue specific to Talend, because we do insert data using Python and it is working fine. We did reach out to Google support team and they mentioned its an issue related to Talend. Can you help to address the same.
With subscription solution Talend Cloud management Platform, could you please create a support case on talend support portal so that we could give you a remote assistance(zoom meeting) through support cycle with priority.
