Timeout error when inserting data into tbigqueryoutput in 7.2V

rgowda — Sat, 16 Nov 2024 02:57:08 GMT

Hi All,

Facing error when inserting data into tBigqueryOutput on Enterprise version.

It works fine in the local studio for the same number of records being loaded.

But the data is getting loaded in the back end with the error on the console as below.

-----------------------------------------

java.net.ConnectException: Connection timed out (Connection timed out)
[root@ Jb_Master_Agent_Product]# sh Jb_Master_Agent_Product_run.sh
[WARN ]: org.jets3t.service.utils.Mimetypes - Unable to find 'mime.types' file in classpath
[FATAL]: broadcloud_new.jb_master_agent_product_0_1.Jb_Master_Agent_Product - tBigQueryOutput_3_tBQBE com.google.api.gax.retrying.PollException: total timeout or maximum number of attempts exceeded; current settings: RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT1S, retryDelayMultiplier=1.0, maxRetryDelay=PT3S, maxAttempts=0, jittered=true, initialRpcTimeout=PT0S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT0S}
com.google.cloud.bigquery.BigQueryException: com.google.api.gax.retrying.PollException: total timeout or maximum number of attempts exceeded; current settings: RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT1S, retryDelayMultiplier=1.0, maxRetryDelay=PT3S, maxAttempts=0, jittered=true, initialRpcTimeout=PT0S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT0S}
at com.google.cloud.bigquery.BigQueryException.translateAndThrow(BigQueryException.java:108)
at com.google.cloud.bigquery.Job.waitForJob(Job.java:351)
at com.google.cloud.bigquery.Job.waitFor(Job.java:240)
at broadcloud_new.jb_master_agent_product_0_1.Jb_Master_Agent_Product.tPostgresqlInput_2Process(Jb_Master_Agent_Product.java:3344)
at broadcloud_new.jb_master_agent_product_0_1.Jb_Master_Agent_Product.context_load_1_tJava_1Process(Jb_Master_Agent_Product.java:4741)
at broadcloud_new.jb_master_agent_product_0_1.Jb_Master_Agent_Product.context_load_1_tFileInputDelimited_1Process(Jb_Master_Agent_Product.java:4502)
at broadcloud_new.jb_master_agent_product_0_1.Jb_Master_Agent_Product$2.run(Jb_Master_Agent_Product.java:11331)
Caused by: com.google.api.gax.retrying.PollException: total timeout or maximum number of attempts exceeded; current settings: RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT1S, retryDelayMultiplier=1.0, maxRetryDelay=PT3S, maxAttempts=0, jittered=true, initialRpcTimeout=PT0S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT0S}
at com.google.api.gax.retrying.ExponentialPollAlgorithm.shouldRetry(ExponentialPollAlgorithm.java:70)
at com.google.api.gax.retrying.RetryAlgorithm.shouldRetry(RetryAlgorithm.java:115)
at com.google.api.gax.retrying.BasicRetryingFuture.handleAttempt(BasicRetryingFuture.java:151)
at com.google.api.gax.retrying.BasicRetryingFuture.setAttemptFuture(BasicRetryingFuture.java:87)
at com.google.api.gax.retrying.DirectRetryingExecutor.submit(DirectRetryingExecutor.java:90)
at com.google.cloud.RetryHelper.run(RetryHelper.java:74)
at com.google.cloud.RetryHelper.poll(RetryHelper.java:63)
at com.google.cloud.bigquery.Job.waitForJob(Job.java:328)
... 5 more
Exception in component tBigQueryOutput_3_tBQBE (Jb_Master_Agent_Product)
com.google.cloud.bigquery.BigQueryException: com.google.api.gax.retrying.PollException: total timeout or maximum number of attempts exceeded; current settings: RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT1S, retryDelayMultiplier=1.0, maxRetryDelay=PT3S, maxAttempts=0, jittered=true, initialRpcTimeout=PT0S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT0S}
at com.google.cloud.bigquery.BigQueryException.translateAndThrow(BigQueryException.java:108)
at com.google.cloud.bigquery.Job.waitForJob(Job.java:351)
at com.google.cloud.bigquery.Job.waitFor(Job.java:240)
at broadcloud_new.jb_master_agent_product_0_1.Jb_Master_Agent_Product.tPostgresqlInput_2Process(Jb_Master_Agent_Product.java:3344)
at broadcloud_new.jb_master_agent_product_0_1.Jb_Master_Agent_Product.context_load_1_tJava_1Process(Jb_Master_Agent_Product.java:4741)
at broadcloud_new.jb_master_agent_product_0_1.Jb_Master_Agent_Product.context_load_1_tFileInputDelimited_1Process(Jb_Master_Agent_Product.java:4502)
at broadcloud_new.jb_master_agent_product_0_1.Jb_Master_Agent_Product$2.run(Jb_Master_Agent_Product.java:11331)
Caused by: com.google.api.gax.retrying.PollException: total timeout or maximum number of attempts exceeded; current settings: RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT1S, retryDelayMultiplier=1.0, maxRetryDelay=PT3S, maxAttempts=0, jittered=true, initialRpcTimeout=PT0S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT0S}
at com.google.api.gax.retrying.ExponentialPollAlgorithm.shouldRetry(ExponentialPollAlgorithm.java:70)
at com.google.api.gax.retrying.RetryAlgorithm.shouldRetry(RetryAlgorithm.java:115)
at com.google.api.gax.retrying.BasicRetryingFuture.handleAttempt(BasicRetryingFuture.java:151)
at com.google.api.gax.retrying.BasicRetryingFuture.setAttemptFuture(BasicRetryingFuture.java:87)
at com.google.api.gax.retrying.DirectRetryingExecutor.submit(DirectRetryingExecutor.java:90)
at com.google.cloud.RetryHelper.run(RetryHelper.java:74)
at com.google.cloud.RetryHelper.poll(RetryHelper.java:63)
at com.google.cloud.bigquery.Job.waitForJob(Job.java:328)
... 5 more

topic Timeout error when inserting data into tbigqueryoutput in 7.2V in Talend Studio

Timeout error when inserting data into tbigqueryoutput in 7.2V