topic tBigQueryOutput error for Big Data Batch Job in Talend Studio

tBigQueryOutput error for Big Data Batch Job

Anonymous — Sat, 16 Nov 2024 06:12:00 GMT

I've created Big Data Batch Job which return error in tBigQueryOutput:

"The operator + is undefined for the argument type(s) null, UUID";

The corresponding java generated code is :

//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

com.google.cloud.hadoop.io.bigquery.output.BigQueryOutputConfiguration

.configure(

config_tBigQueryOutput_2,

projectId_tBigQueryOutput_2,

"staging",

"maria_test",

tableSchema_tBigQueryOutput_2,

null + java.util.UUID.randomUUID(),

com.google.cloud.hadoop.io.bigquery.BigQueryFileFormat.NEWLINE_DELIMITED_JSON,

org.apache.hadoop.mapreduce.lib.output.TextOutputFormat.class);

///////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

Google Storage Staging Bucket in the Spark Configuration tab of Run tab is:

"gs://bla-bla/talend/jars"

Job layout is below.

Can you please suggest on how the above error should be fixed.

Thank you,

Re: tBigQueryOutput error for Big Data Batch Job

Anonymous — Tue, 02 Apr 2019 06:38:25 GMT

Hello,

Are you trying to generate random UUID numbers in a certain format for insertion in a database? Could you please give us more description about your current job design? How did you define your schema structure in your tBigQueryOutput component? What's your custom code in your tJava component?

Best regards

Sabrina

Re: tBigQueryOutput error for Big Data Batch Job

Anonymous — Tue, 02 Apr 2019 16:09:35 GMT

The solution has been found : tBigQueryConfiguration has to be added, then the job is building successfully. Please see the screenshot:

Re: tBigQueryOutput error for Big Data Batch Job

Anonymous — Wed, 03 Apr 2019 08:23:07 GMT

Hello,

Thanks for sharing your solution with us.

Best regards

Sabrina