topic Re: "Variable can not be resolved" error for multiple tBigQueryInput's in Talend Studio

"Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Sat, 16 Nov 2024 06:47:32 GMT

I am getting the following error if there are more than one tBigQueryInput's:

Detail Message: jobId_tBigQueryInput_2 cannot be resolved to a variable

This is my job and the configuration of tBigQueryInput_2. But the config of tBigQueryInput_1 is the same:

In the source code, I am getting the following for tBigQueryInput_1, which is correct:

com.google.cloud.bigquery.JobId jobId_tBigQueryInput_1 = com.google.cloud.bigquery.JobId
		.of(java.util.UUID.randomUUID().toString());
com.google.cloud.bigquery.Job job_tBigQueryInput_1 = bigquery_tBigQueryInput_1
		.create(com.google.cloud.bigquery.JobInfo
			.newBuilder(queryConfiguration_tBigQueryInput_1)
			.setJobId(jobId_tBigQueryInput_1).build());

For tBigQueryInput_2, I am getting an error on the last line of the following code:

com.google.cloud.bigquery.JobId jobId_tBigQueryInput_1 = com.google.cloud.bigquery.JobId
		.of(java.util.UUID.randomUUID().toString());
com.google.cloud.bigquery.Job job_tBigQueryInput_2 = bigquery_tBigQueryInput_2
		.create(com.google.cloud.bigquery.JobInfo
			.newBuilder(queryConfiguration_tBigQueryInput_2)
			.setJobId(jobId_tBigQueryInput_2).build());

The error is on the first line of the above code. Variable `jobId_tBigQueryInput_1` is beeing initialized, but on the last line it references `jobId_tBigQueryInput_2`, which does not exist.

It works for tBigQueryInput_1, but fails for any other tBigQueryInput's.

Talend Version used: 7.1.1.20181026_1147

The same job has worked on Taled Version 7.0.1.2018.0411_1414

Best regards,

Simon

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

dipanjan93 — Tue, 22 Jan 2019 16:34:55 GMT

I think it is because of the Group By clause. Since, in the query no aggregation is involved to support a group by. Could you please check and confirm?

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Thu, 24 Jan 2019 09:30:42 GMT

Thank dipanjan93 for the reply. But I do not see how that can solve the problem. The job does not compile. So the query is never evaluated.

IMO it is an error in how Talend creates the code for tBigQueryInput processors.

Anyway, I tried your suggestion by simply removing the GROUP BY clause in both queries. The problem persists.

I've created a bug report: https://jira.talendforge.org/browse/TBD-8265

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Thu, 24 Jan 2019 10:47:09 GMT

Thank you for the reply dipanjan93. I tried removing the GROUP BY clause in the queries. It did not solve the problem.

But the problem is, that the job does not even build. I have the error in the Code view of the job, so the queries are not evaluated or executed.

I created a bug report: https://jira.talendforge.org/browse/TBD-8265

(my first response has vanished. No idea what happend)

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Tue, 29 Jan 2019 07:14:31 GMT

Hello,

It seems to be having troubles with the jobId for the second and additional tBigQueryInput components.

It is a bug on V 7.1.1 and our developpers are working on this issue. It could be fixed on V 7.2.1.

We will keep you posted.

Best regards

Sabrina

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Mon, 04 Feb 2019 11:53:40 GMT

Hi Sabrina,

I have just encountered the exact same issue with my job also - and spotted the same issue with the generated java code re-intantiating the previously defined

jobId_tBigQueryInput_1 instead of jobId_tBigQueryInput_2.

What is the workaround for this whilst we wait for the bugfix?

Richard

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

badri-nair — Tue, 05 Feb 2019 09:08:52 GMT

I have encountered the same issue where in a tExtractxml component its trying to cast datatypes which has not been coded to cast. Like casting a decimal to Date and Date to a Big Decimal.

Thanks

Badri Nair

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Thu, 21 Mar 2019 14:36:39 GMT

I have too same problem and it is indeed a feature which is important. Glad that it is addressed as defect. But is there a temporary solution for it ? Thank you in advance.

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Fri, 22 Mar 2019 03:18:14 GMT

Hello @ssomanchi,

It is a bug and the fix versions are 7.1.2 and 7.2.1. Could you please clarify in which Talend version/edition you are?

Best regards

Sabrina

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Fri, 22 Mar 2019 06:37:24 GMT

Hi Sabrina.

Thanks for this information, I am on version 7.1.1.

also I raised this issue, if you can confirm if this is known issue.

https://community.talend.com/t5/Design-and-Development/Issue-when-Using-2-tBigQueryOutput-in-1-job/m-p/155480#M95066

we are in phase of evaluating the ETL as Talend. These are important tests and we are using BQ as our source/target.

thanks in advance

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Fri, 22 Mar 2019 08:21:46 GMT

Hello @ssomanchi,

We need more information about your another issue:https://community.talend.com/t5/Design-and-Development/Issue-when-Using-2-tBigQueryOutput-in-1-job/m-p/155480#M95066.

Best regards

Sabrina

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Fri, 29 Mar 2019 12:49:37 GMT

Hi,

Will this be fixed in 7.3 or 8.0?

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Fri, 29 Mar 2019 12:54:11 GMT

Hi,

I have also this bug in 7.1.

Can I give you the details you need?

Is there any way to have th bug's link so we can now whats the resolution state?

Thanks.

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Fri, 29 Mar 2019 13:22:47 GMT

The link to my ticket is given above. It has been closed as duplicate of TBD-8102.
I guess the link to this issue is https://jira.talendforge.org/plugins/servlet/mobile#issue/TBD-8102
But I don't have access to see it.

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Fri, 29 Mar 2019 14:56:14 GMT

Neither do I

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Mon, 01 Apr 2019 03:44:03 GMT

Hello @Moe

TBD-8102 is fixed in 7.2.1, 7.1.2 and the security level is Talend internal.

Best regards

Sabrina

Re: "Variable can not be resolved" error for multiple tBigQueryInput's

Anonymous — Mon, 01 Apr 2019 03:54:21 GMT

Hello @amarhaba

Here exists a jira issue: TBD-8102 "tBigQueryInput - Always fails when you have more than one".It's fixed in 7.2.1, 7.1.2

The security level is Talend internal. Only Talend employees will be able to see the issue. Let us know if there is any help we can give.

Best regards

Sabrina