topic [resolved]How to pass records to output based on a dynamic column value ? in Talend Studio

[resolved]How to pass records to output based on a dynamic column value ?

HemanthSai — Fri, 15 Nov 2024 23:56:13 GMT

I have a requirement to output records with a certain column value which is dynamic.

ColA ColB ColC ColE

1 A 09/15/2021 L

2 B 09/15/2021 M

3 C 09/15/2021 N

4 D 09/15/2021 O

5 E 09/14/2021 P

6 F 09/14/2021 Q

Data is similar to the above table.I want all the records with date 09/15/2021 to output and I do not need rest of the data. In essence I need all the records with the date value in the first record.

I have experimented using tmemorizerows and tjavarow but it did not worked,

Can any one help me with the issue ?

Edit:

Date field is not constant. It comes from a file and then I sort the data based on Date in descending order.

tfileInputDelimited-->tSortorder(based on date)-->somecomponent-->Outputfile(which should have all the records for the top date field )

Re: [resolved]How to pass records to output based on a dynamic column value ?

gjeremy1617088143 — Mon, 19 Jul 2021 12:14:14 GMT

hi, if your field colB is a String you can use a tFilteRow component,

you Use advanced mode and in the texbox you can set :

"09/15/2021".equals(input_row.ColB)

Send me love and Kudos

Re: [resolved]How to pass records to output based on a dynamic column value ?

HemanthSai — Mon, 19 Jul 2021 12:40:55 GMT

Hi Jeremy,

It is not a string field. It is a date field and it is not constant.

Re: [resolved]How to pass records to output based on a dynamic column value ?

gjeremy1617088143 — Mon, 19 Jul 2021 12:50:16 GMT

TalendDate.compareDate(input_row.ColB,TalendDate.parseDate("MM/dd/YYYY", "09/15/2021"),"MM/dd/YYYY")==0

Re: [resolved]How to pass records to output based on a dynamic column value ?

HemanthSai — Mon, 19 Jul 2021 12:54:14 GMT

I cannot hardcode it, whatever the date that is in the first record, I need all the records for that date.

Re: [resolved]How to pass records to output based on a dynamic column value ?

gjeremy1617088143 — Mon, 19 Jul 2021 13:09:18 GMT

you can read the file (just the first line) (you can set header,footer and limit in tfileinputdelimited)

then you stock it in a globalmap (you can use tSetGlobalVar component then you call it in the t filterRow :

TalendDate.compareDate(input_row.ColB,your globalvar,"MM/dd/YYYY")==0

Re: [resolved]How to pass records to output based on a dynamic column value ?

HemanthSai — Mon, 19 Jul 2021 14:04:06 GMT

then I need to load my input file two times right. For storing first record date I will set the limit to 1 and store that in tsetglobalvar. for filtering the data I need to load the input file again,because we had set the limit to 1. I do not want to load the twice. Job should look something like this

Input file-->sort data on date-->logic/component to filter all line items for date in first record-->output file

Re: [resolved]How to pass records to output based on a dynamic column value ?

gjeremy1617088143 — Mon, 19 Jul 2021 14:12:49 GMT

you can create a new globalmap named firstDate with null value:

then you add this a the top a tjavarow code after push the synchronize button and generate code button:

if((Date)(globalMap.get("firstDate") ==null)

{

globalMap.put("firstDate",input_row.colB);

}

finally you can use tfilter row :

TalendDate.compareDate(input_row.ColB,(Date)(globalMap.get("firstDate"),"MM/dd/YYYY")==0

Re: [resolved]How to pass records to output based on a dynamic column value ?

HemanthSai — Tue, 20 Jul 2021 08:56:07 GMT

Here in this logic

if((Date)(globalMap.get("firstDate") ==null)

{

globalMap.put("firstDate",input_row.colB);

}

I am not able to store one value into the globalmap,it will store entire column.So I have tried something like this but it giving an error

if((Date)(globalMap.get("firstDate") ==null)

{

globalMap.put("firstDate",input_row.colB[1]);

}

My job is like this:

Inputfile-->tsortrow-->tsetglobalvar-->tjavarow-->tfilerrows-->tlogrow.

Re: [resolved]How to pass records to output based on a dynamic column value ?

gjeremy1617088143 — Tue, 20 Jul 2021 12:29:59 GMT

your tjava row will be like this

if((Date)(globalMap.get("firstDate") ==null)

{

globalMap.put("firstDate",input_row.colB);

}

output_row.colA = input_row.colA;

output_row.colB = input_row.colB;

....

output_row.colD= input_row.colD;

so when the first row pass it will read "firstDate" see it's a null value and set it with the date of the first row

then each next row will don't pass in the if cause firstDate is no more null

tsetglobalvar-->on component ok-->inputfile-->tsortrow-->tjavarow-->tfilterrow-->tlogrow

Re: [resolved]How to pass records to output based on a dynamic column value ?

HemanthSai — Thu, 22 Jul 2021 08:14:37 GMT

that solved my issue jeremy thank you.

Re: [resolved]How to pass records to output based on a dynamic column value ?

gjeremy1617088143 — Thu, 22 Jul 2021 08:36:32 GMT

you're welcome, i'm happy it works