topic Re: Blank value using tfilterrow in Talend Studio

Blank value using tfilterrow

BA621858188 — Fri, 15 Nov 2024 22:01:04 GMT

Hi All,

I want to check and filter blank values from a file based on an integer column and using the tfilterrow component. How can I use the tfilter row component properties. Can anyone help me on this?

I am doing currently as below:

column - (integer column)

function - empty.

operator - equals

value - ""/'' (this is giving me an error)

Appreciate your help.

Re: Blank value using tfilterrow

rhall1 — Thu, 09 Mar 2023 14:30:04 GMT

Your value suggests that the column is not an Integer or int column.

Re: Blank value using tfilterrow

BA621858188 — Fri, 10 Mar 2023 02:32:19 GMT

The column is integer. I need your help to know how can I check blank in it using tfilter row.

Re: Blank value using tfilterrow

BA621858188 — Fri, 10 Mar 2023 02:32:43 GMT

@Shicong Hong , can you please help here?

Re: Blank value using tfilterrow

rhall1 — Fri, 10 Mar 2023 02:36:50 GMT

Are you sure that the column is set to Integer? This value....

""/''

...is not what you would expect of an Integer. It looks more like a String.

I am talking about the column type, not the expected the value.

Re: Blank value using tfilterrow

Anonymous — Fri, 10 Mar 2023 02:38:52 GMT

set the value as null, and make sure the key box of the column is checked on the schema of input component.

Re: Blank value using tfilterrow

BA621858188 — Fri, 10 Mar 2023 03:45:00 GMT

@Shicong Hong ,

I tried this. getting below error:

The operator == is undefined for the argument type(s) int, null

column - (integer column)

function - empty.

operator - equals

value - null

selected key box for the column as well

Re: Blank value using tfilterrow

Anonymous — Sat, 11 Mar 2023 03:39:58 GMT

sorry, it is the 'nullable' box, this option should be checked on the schema.

Re: Blank value using tfilterrow

BA621858188 — Sat, 11 Mar 2023 05:20:57 GMT

Hi @Shicong Hong ,

I tried this as well but no luck. Kindly help.

Below is the design:

tDBInput-->tfileoutputdelimited-->tfilterrow-->tfileoutputdelimited

tfilterrow

ID Empty not equal to null

Re: Blank value using tfilterrow

tnewbie — Sat, 11 Mar 2023 14:53:28 GMT

I am able to filter rows easily where a specific column is null.

I have taken 2 integer columns c1 and c2. I have inserted 2 rows, 1st row where both c1 and c2 have values, 2nd row where c2 is null

I am able to take forward only the 2 row where c2 is null

Please try this

Hope this helps

Re: Blank value using tfilterrow

Anonymous — Sun, 12 Mar 2023 01:15:03 GMT

Make sure the nullable box is checked on tDBInput component, while this option is enable, the component will read the null value as null, otherwise, it is 0 for int type.

Re: Blank value using tfilterrow

BA621858188 — Sun, 12 Mar 2023 10:38:08 GMT

@Richard Hall

I was just trying by putting value as ""/"" but its not the correct one. The data type at source and target both end is integer only.

Re: Blank value using tfilterrow

BA621858188 — Sun, 12 Mar 2023 10:45:35 GMT

Hi @tech seeker ,

Is the col1 and col2 are of integer type?

Can you put value for both cols as blank as you gave the value 345 for col1?

I have completed full blank line at the end and need to remove it using filter row

Re: Blank value using tfilterrow

BA621858188 — Sun, 12 Mar 2023 12:13:03 GMT

Hi @tech seeker ,

This is the same as Scenario where need to ignore the last line from pipe delimited file.

where you have mentioned to use tsystem component to use. I am trying the same using filter row. Is it possible to ignore the end line (blank).

Re: Blank value using tfilterrow

BA621858188 — Sun, 12 Mar 2023 12:26:35 GMT

@Shicong Hong ,

I did this as well, but it didn't work.

Re: Blank value using tfilterrow

Anonymous — Sun, 12 Mar 2023 23:50:04 GMT

OK, for debugging, try to print the value on a on tJavaRow to see what value it is, null or empty string?

System.out.println(input_row.columnName);

or check if the value is null or empty string, eg:

if(input_row.columnName==null){

System.out.println("It is null value");

}

if(input_row.columnName.equals("")){

System.out.println("It is empty string");

}

Check and confirm what value it is before you do the filter.

Regards

Shong

Re: Blank value using tfilterrow

rhall1 — Sun, 12 Mar 2023 23:58:38 GMT

@Vrushabh Malbari It might also help to see a screenshot of the schema setup of the source, target and the tFilterRow components. It sounds to me like there is an issue here. If you can supply ""/'' to the column, it isn't an integer.

Also, int cannot be null. Integer can be null. So you need to make sure that your column is set to Integer and not int.

Re: Blank value using tfilterrow

BA621858188 — Mon, 13 Mar 2023 09:42:15 GMT

Hi @Richard Hall ,

Its integer in schema. I am supplying null in value and not "/"".

Re: Blank value using tfilterrow

BA621858188 — Mon, 13 Mar 2023 14:29:30 GMT

Hi @rhall (Customer) ,

Its integer in schema. I am supplying null in value and not "/"".

Re: Blank value using tfilterrow

BA621858188 — Mon, 13 Mar 2023 14:36:07 GMT

Hi @Shicong Hong ,

OK, for debugging, try to print the value on a on tJavaRow to see what value it is, null or empty string?

System.out.println(input_row.columnName);

or check if the value is null or empty string, eg:

if(input_row.columnName==null){

System.out.println("It is null value");

}

if(input_row.columnName.equals("")){

System.out.println("It is empty string");

}

Check and confirm what value it is before you do the filter.

where I need to use the above code in my design.

My design is as below:

tdbinput--> tfileoutputdelimited --> tfilterrow --> tfileoutputdelimited

So you want me to use tjava in between tfileoutputdelimited-->tfilterrow?

If yes, I have done that, but I just got the values, not "it is null" or "it is empty."

But still, I am getting one extra line (blank) in my target output file.