topic Re: urgent help needed. tbigqueryoutput error. in Talend Studio

urgent help needed. tbigqueryoutput error.

Anonymous — Sat, 16 Nov 2024 04:30:02 GMT

im getting the error below when trying to run my job. the data is coming in but for some reason its throwing an error. i couldnt find any helpful articles on the web about this error. can someone please help me?

Exception in component tBigQueryOutput_1_tBQBE (LoadInfareFiles)
com.google.cloud.bigquery.BigQueryException: com.google.api.gax.retrying.PollException: total timeout or maximum number of attempts exceeded; current settings: RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT1S, retryDelayMultiplier=1.0, maxRetryDelay=PT3S, maxAttempts=0, jittered=true, initialRpcTimeout=PT0S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT0S}
at com.google.cloud.bigquery.BigQueryException.translateAndThrow(BigQueryException.java:108)
at com.google.cloud.bigquery.Job.waitForJob(Job.java:351)
at com.google.cloud.bigquery.Job.waitFor(Job.java:240)
at etl.loadinfarefiles_0_1.LoadInfareFiles.tFileList_3Process(LoadInfareFiles.java:4067)
at etl.loadinfarefiles_0_1.LoadInfareFiles.tFileList_1Process(LoadInfareFiles.java:881)
at etl.loadinfarefiles_0_1.LoadInfareFiles.runJobInTOS(LoadInfareFiles.java:5118)
at etl.loadinfarefiles_0_1.LoadInfareFiles.main(LoadInfareFiles.java:4901)
Caused by: com.google.api.gax.retrying.PollException: total timeout or maximum number of attempts exceeded; current settings: RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT1S, retryDelayMultiplier=1.0, maxRetryDelay=PT3S, maxAttempts=0, jittered=true, initialRpcTimeout=PT0S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT0S}
at com.google.api.gax.retrying.ExponentialPollAlgorithm.shouldRetry(ExponentialPollAlgorithm.java:70)
at com.google.api.gax.retrying.RetryAlgorithm.shouldRetry(RetryAlgorithm.java:115)

Re: urgent help needed. tbigqueryoutput error.

Anonymous — Wed, 02 Oct 2019 17:13:16 GMT

Hi,

It looks like a timeout issue. Are you trying to load huge data volumes using tBigQueryOutput component? If the data volume is high, the recommendation will be to use Bulk components.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

Re: urgent help needed. tbigqueryoutput error.

Anonymous — Fri, 18 Oct 2019 16:07:02 GMT

Hi,

you need to change the tBigQueryBulkExec_begin.javajet file.

job_<%=cid%> = job_<%=cid%>.waitFor(com.google.cloud.RetryOption.initialRetryDelay(org.threeten.bp.Duration.ofSeconds(1)), com.google.cloud.RetryOption.totalTimeout(org.threeten.bp.Duration.ofSeconds(30)));

job_<%=cid%> = job_<%=cid%>.waitFor(com.google.cloud.RetryOption.initialRetryDelay(org.threeten.bp.Duration.ofSeconds(1)), com.google.cloud.RetryOption.totalTimeout(org.threeten.bp.Duration.ofSeconds(300)));