topic Re: JDBC for Google BigQuery in Talend Studio

JDBC for Google BigQuery

Anonymous — Sat, 16 Nov 2024 06:37:37 GMT

Hello everyone,

I configured my job to run with google bigquery via JDBC DB (because i want to use table schema).

I connected to the google big query environment but when i want to insert the data i came across with the error "

java.lang.RuntimeException: [Simba][JDBC](10220) Driver does not support this optional feature.

so please help thanks

Re: JDBC for Google BigQuery

vapukov — Mon, 11 Feb 2019 20:26:07 GMT

does you use autocommit or manual commit?

Re: JDBC for Google BigQuery

Anonymous — Tue, 12 Feb 2019 07:28:49 GMT

Hi Vapukov;

I could not see auto commit tick in the component only I see commit every ... rows section

Re: JDBC for Google BigQuery

Anonymous — Tue, 12 Feb 2019 10:22:07 GMT

I found a solution using a tdbinput component before tdbinput i used tdbconnection in the tdbconnection component i deactivated "auto commit" and it is done for insert but when i want to use update or insert then another error show up ```

message" : "Syntax error: Unexpected end of statement at [1:53] ```

Re: JDBC for Google BigQuery

vapukov — Tue, 12 Feb 2019 10:32:46 GMT

let's fist check 2 moments:

- can you extract table schema with jdbc driver? (because you mention this as primary reason)

- do you test standard BigQueryOutput component, is it work for you?

if yes for both - you can use schema from repository from any type of connection, it is just a schema

if not - need to test disable batch window, set commit to 1 and look what sql generated by job

Re: JDBC for Google BigQuery

Anonymous — Tue, 12 Feb 2019 10:38:57 GMT

i can use extract schema from jdbc driver no problem.

the BigQuery component is not working properly the error is "empty key"

"if not - need to test disable batch window, set commit to 1 and look what sql generated by job" how can i do that i do not know please help thanks

Re: JDBC for Google BigQuery

Anonymous — Fri, 22 Mar 2019 15:11:41 GMT

Hi Vapukov, Aztec

I could able to use tBigQueryOutput to connect to BQ and write the data.

But I used the 'Schema' - 'built-in'. That is good. But the downside is, I must fill in each column name, data type.

I want to use the 'Repository', so I can browse and add the target table.

do you know how I can do ? how I do create BQ schema in talend?

any documentation pointers ?

I would like to use the jdbc drivers.

Thanks

Shanker

Re: JDBC for Google BigQuery

XULACS96 — Tue, 24 Aug 2021 18:17:22 GMT

Aztec,

I know this is an old post but hopefully you are still out there and can answer my question. I'm trying to create a DB Connection to Google BigQuery using JDBC driver from Simba drivers. I'm getting the error of No suitable drive for. Clearly I'm missing a driver/jar file but I have no idea what I'm missing and I'm hoping you can help since you successfully created a connection.