Failed on BigQuery Partitioned Table

lke27 — Fri, 15 Nov 2024 22:55:01 GMT

My job which is to insert data into a BigQuery table was running well, but after I modified the table to become a partitioned table, the job failed with error:

Exception in component tBigQueryOutput_5_tBQBE (test_bigquery)

java.lang.IllegalArgumentException: No enum constant com.google.cloud.bigquery.TimePartitioning.Type.MONTH

at java.lang.Enum.valueOf(Unknown Source)

at com.google.cloud.bigquery.TimePartitioning$Type.valueOf(TimePartitioning.java:45)

at com.google.cloud.bigquery.TimePartitioning.fromPb(TimePartitioning.java:148)

at com.google.cloud.bigquery.StandardTableDefinition.fromPb(StandardTableDefinition.java:228)

at com.google.cloud.bigquery.TableDefinition.fromPb(TableDefinition.java:155)

at com.google.cloud.bigquery.TableInfo$BuilderImpl.<init>(TableInfo.java:183)

at com.google.cloud.bigquery.Table.fromPb(Table.java:591)

at com.google.cloud.bigquery.BigQueryImpl.getTable(BigQueryImpl.java:415)

at local_project_new.test_bigquery_0_1.test_bigquery.tDBInput_4Process(test_bigquery.java:3057)

at local_project_new.test_bigquery_0_1.test_bigquery.runJobInTOS(test_bigquery.java:5806)

at local_project_new.test_bigquery_0_1.test_bigquery.main(test_bigquery.java:5630)

I'm using TOS 7.3.1. Does Talend support BigQuery partitioned tables?

Re: Failed on BigQuery Partitioned Table

Shepherd69 — Wed, 18 May 2022 06:24:12 GMT

It's important to note that, when using a query, you can only copy an existing BigQuery table and partition it either by an integer-range column or by a time-unit column, as it's not possible to use ingestion-time partitioning.

Re: Failed on BigQuery Partitioned Table

lke27 — Thu, 19 May 2022 03:12:03 GMT

@Jacob Gordon The table is partitioned by a date column, not ingestion time, but still thanks for you information.

topic Re: Failed on BigQuery Partitioned Table in Talend Studio

Failed on BigQuery Partitioned Table

Re: Failed on BigQuery Partitioned Table

Re: Failed on BigQuery Partitioned Table