topic tBiqQueryInput asking for elevated permission to run select queries in Talend Studio

tBiqQueryInput asking for elevated permission to run select queries

DJose1656543464 — Fri, 15 Nov 2024 22:46:38 GMT

Hi,

I am running a select query (Eg select * from dataset.tablename) using the tBigQueryInput Component. Big query read only permissions on the data set, should be enough to perform a query like this, but its asking for 'bigquery dataset create permission' as well. Could you please confirm on the minimum permissions required on BigQuery for this particular use case?

-Error Log

'google.cloud.bigquery.BigQueryException: Access Denied: User do no have bigquery.dataset.create permission in project

Re: tBiqQueryInput asking for elevated permission to run select queries

Anonymous — Thu, 30 Jun 2022 04:31:05 GMT

Hello,

Could you please clarify in which Talend version/edition you are?

There is a limitation from BigQuery-connector.

As it was explained BigQuery configuration needs to be able to write temporary info into datasets which is impossible with "viewer" role for datasets.

Our Admin rights are able to perform BigQuery operation

Best regards

Sabrina

Re: tBiqQueryInput asking for elevated permission to run select queries

DJose1656543464 — Thu, 30 Jun 2022 04:35:07 GMT

I'm using Talend studio 7.3.1 (Talend Cloud Big Data)

Re: tBiqQueryInput asking for elevated permission to run select queries

Anonymous — Thu, 30 Jun 2022 04:41:49 GMT

Hello,

You need 'bigquery.datasets.create' permission for your Bigquery account when performing BigQuery operation.

It is the limitation from BigQuery-connector not talend.

Best regards

Sabrina

Re: tBiqQueryInput asking for elevated permission to run select queries

Tins1980 — Mon, 12 Sep 2022 10:16:06 GMT

I got this to work by removing the space between "#standardSQL and \r\n.

Works:

"#standardSQL\r\n

Doesn't work:

"#standardSQL \r\n

RTFM:

"Must be separated from the query by a newline character"

My update to the FM:

"Must be separated from the query by ONLY a newline character"