BigQuery input error

andmattia — Sat, 16 Nov 2024 03:10:14 GMT

I try to read a simple table with 10 rows

but I still have an error

the configuration is

this is the full stack of excetpion

Starting job J_test_BigQ at 12:11 26/02/2020.

[statistics] connecting to socket on port 4039
[statistics] connected
IxFDcG
2DTewd
zMgVj4
XMxfil
IuJZx0
Aeq50q
yfGOJW
fQ79vV
bcvZuI
gXeO4Z
Exception in component tBigQueryInput_1 (J_test_BigQ)
com.google.cloud.bigquery.BigQueryException: Invalid dataset ID "ECT gameId FROM tab1". Dataset IDs must be alphanumeric (plus underscores and dashes) and must be at most 1024 characters long.
	at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.translate(HttpBigQueryRpc.java:99)
	at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.deleteTable(HttpBigQueryRpc.java:274)
	at com.google.cloud.bigquery.BigQueryImpl$9.call(BigQueryImpl.java:352)
	at com.google.cloud.bigquery.BigQueryImpl$9.call(BigQueryImpl.java:349)
	at com.google.api.gax.retrying.DirectRetryingExecutor.submit(DirectRetryingExecutor.java:89)
	at com.google.cloud.RetryHelper.run(RetryHelper.java:74)
	at com.google.cloud.RetryHelper.runWithRetries(RetryHelper.java:51)
	at com.google.cloud.bigquery.BigQueryImpl.delete(BigQueryImpl.java:349)
	at big.j_test_bigq_0_1.J_test_BigQ.tBigQueryInput_1Process(J_test_BigQ.java:640)
	at big.j_test_bigq_0_1.J_test_BigQ.runJobInTOS(J_test_BigQ.java:914)
	at big.j_test_bigq_0_1.J_test_BigQ.main(J_test_BigQ.java:764)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
  "code" : 400,
  "errors" : [ {
    "domain" : "global",
    "message" : "Invalid dataset ID \"ECT gameId FROM tab1\". Dataset IDs must be alphanumeric (plus underscores and dashes) and must be at most 1024 characters long.",
    "reason" : "invalid"
  } ],
  "message" : "Invalid dataset ID \"ECT gameId FROM tab1\". Dataset IDs must be alphanumeric (plus underscores and dashes) and must be at most 1024 characters long.",
  "status" : "INVALID_ARGUMENT"
}
	at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:145)
	at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
	at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:312)
	at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1049)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:410)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:343)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:460)
	at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.deleteTable(HttpBigQueryRpc.java:271)
	... 9 more
[statistics] disconnected

Job J_test_BigQ ended at 12:11 26/02/2020. [exit code=1]

Re: BigQuery input error

andmattia — Wed, 26 Feb 2020 17:07:05 GMT

@manodwhb I check all parameters, but I don't understand why my job print 10 row on big table but give me the error.

Project_id is the same write on auth file but not work.

Re: BigQuery input error

jagadish_dasari — Wed, 08 Jul 2020 07:07:52 GMT

Hi,

Seems there is some bug with QUERY section in TOS-BD-7.2.1.

Try this: write the key words of query in lower-case

Default: SELECT * FROM <DATASET_NAME>.<TABLE_NAME> LIMIT 10;

Change to: select * from <DATASET_NAME>.<TABLE_NAME> limit 10;

Don't actually know how this is different but this is working for now.

Thanks,

Jagadish.

Re: BigQuery input error

jagadish_dasari — Wed, 08 Jul 2020 07:07:52 GMT

Hi,

Seems there is some bug with QUERY section in TOS-BD-7.2.1.

Try this: write the key words of query in lower-case

Default: SELECT * FROM <DATASET_NAME>.<TABLE_NAME> LIMIT 10;

Change to: select * from <DATASET_NAME>.<TABLE_NAME> limit 10;

Don't actually know how this is different but this is working for now.

Thanks,

Jagadish.

topic Re: BigQuery input error in Talend Studio

BigQuery input error

Re: BigQuery input error

Re: BigQuery input error

Re: BigQuery input error

Re: BigQuery input error