topic Re: concatenate context variable in a table name in Talend Studio

concatenate context variable in a table name

dwhdeveloper — Sat, 16 Nov 2024 09:35:00 GMT

I have to extract data daily from big query. There is a new table created daily with the timestamp in it.

for example [dw-bigquery:45234.ga_table_20170626]

I am using a context variable which receives the date from a table in YYYY-mm-dd format.

Following is my query.

select * from

'[dw-bigquery:45234.ga_table_' +TalendDate.formatDate("yyyyMMdd", context.load_date)+ ']'

I get an error for invalid assignment operator.

TRF — Tue, 27 Jun 2017 15:40:23 GMT

Try this:

"select * from 
[dw-bigquery:45234.ga_table_" +TalendDate.formatDate("yyyyMMdd", context.load_date)+ "]"

because each string part must be enclosed between "" (don't know if you need ' and [] for big query).

dwhdeveloper — Wed, 28 Jun 2017 11:09:55 GMT

I was still getting errors.

So I made it more simple

"select * from 
[dw-bigquery:45234.ga_table_" +context.load_date+ "]"

When I run it does not recognise context variable and the table looks like following

[dw-bigquery:45234.ga_table_]

Anonymous — Wed, 28 Jun 2017 11:57:51 GMT

Your context variable appears to be holding an empty String.

cterenzi — Wed, 28 Jun 2017 13:57:24 GMT

Can you show us the part of your job that retrieves the date and sets the context variable?

dwhdeveloper — Wed, 28 Jun 2017 14:06:25 GMT

I set a value where I define my context. Somehow it is not being passed.
But when I set it from sql in tjavarow it works

dwhdeveloper — Wed, 28 Jun 2017 14:08:33 GMT

I found a way by using tposgresqlinput and tjavarow

Anonymous — Tue, 29 Aug 2017 20:12:35 GMT

What was your solution using tjavarow?

dwhdeveloper — Wed, 30 Aug 2017 10:26:50 GMT

First I select the date from my table using tPostgresqlInput and then assign it to context variable in t_javarow.

context.load_date=input.load_date

and later in tBigQueryInput I use the context variable as following for table name

[project-bigquery:123456.ga_sessions_" + context.load_date + "]