urgent help needed. tbigqueryoutput error.

[Anonymous]

im getting the error below when trying to run my job. the data is coming in but for some reason its throwing an error. i couldnt find any helpful articles on the web about this error. can someone please help me?

Exception in component tBigQueryOutput_1_tBQBE (LoadInfareFiles)
com.google.cloud.bigquery.BigQueryException: com.google.api.gax.retrying.PollException: total timeout or maximum number of attempts exceeded; current settings: RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT1S, retryDelayMultiplier=1.0, maxRetryDelay=PT3S, maxAttempts=0, jittered=true, initialRpcTimeout=PT0S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT0S}
at com.google.cloud.bigquery.BigQueryException.translateAndThrow(BigQueryException.java:108)
at com.google.cloud.bigquery.Job.waitForJob(Job.java:351)
at com.google.cloud.bigquery.Job.waitFor(Job.java:240)
at etl.loadinfarefiles_0_1.LoadInfareFiles.tFileList_3Process(LoadInfareFiles.java:4067)
at etl.loadinfarefiles_0_1.LoadInfareFiles.tFileList_1Process(LoadInfareFiles.java:881)
at etl.loadinfarefiles_0_1.LoadInfareFiles.runJobInTOS(LoadInfareFiles.java:5118)
at etl.loadinfarefiles_0_1.LoadInfareFiles.main(LoadInfareFiles.java:4901)
Caused by: com.google.api.gax.retrying.PollException: total timeout or maximum number of attempts exceeded; current settings: RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT1S, retryDelayMultiplier=1.0, maxRetryDelay=PT3S, maxAttempts=0, jittered=true, initialRpcTimeout=PT0S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT0S}
at com.google.api.gax.retrying.ExponentialPollAlgorithm.shouldRetry(ExponentialPollAlgorithm.java:70)
at com.google.api.gax.retrying.RetryAlgorithm.shouldRetry(RetryAlgorithm.java:115)

[Anonymous]

Hi,

    It looks like a timeout issue. Are you trying to load huge data volumes using tBigQueryOutput component? If the data volume is high, the recommendation will be to use Bulk components.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

[Anonymous]

Hi,

you need to change the tBigQueryBulkExec_begin.javajet file.

job_<%=cid%> = job_<%=cid%>.waitFor(com.google.cloud.RetryOption.initialRetryDelay(org.threeten.bp.Duration.ofSeconds(1)), com.google.cloud.RetryOption.totalTimeout(org.threeten.bp.Duration.ofSeconds(30)));
		

to

job_<%=cid%> = job_<%=cid%>.waitFor(com.google.cloud.RetryOption.initialRetryDelay(org.threeten.bp.Duration.ofSeconds(1)), com.google.cloud.RetryOption.totalTimeout(org.threeten.bp.Duration.ofSeconds(300)));