topic Re: [resolved] how to remove rows containing null values from a CSV file to mysql in Talend Studio

[resolved] how to remove rows containing null values from a CSV file to mysql

joseng_62 — Sat, 16 Nov 2024 12:05:08 GMT

Good day. I need some help. I have a CSV file that contains data as shown on the uploaded image.
The fields are Key, first_name, last_name, city, gross salary.
Some of the columns contains data that shows as null on the CSV file.
I want to filter the rows so data if any of the first_name, last_name or city columns contains null, the whole row must not be imported to the mysql database.
I'm am stuck as to I am no sure if i should be using tmap or tfilterrow and which expressions to use exactly.
Please I have been checking the forums for about 4 hours now and have been "google"ing my behind of.
Any assistance would be appreciated.
Thanks

Re: [resolved] how to remove rows containing null values from a CSV file to mysql

janhess — Wed, 13 Mar 2013 11:48:06 GMT

You can do it in Expression filter in output tMap.
! Relational.ISNULL(fieldname1) | ! Relational.ISNULL(fieldname2) etc.

Re: [resolved] how to remove rows containing null values from a CSV file to mysql

Anonymous — Wed, 13 Mar 2013 11:56:04 GMT

HI joseng
You can use expression fillter to fillter you incoming records in tMAP between source and destination, find the screen shot for your understanding.

thanks
B. Anil Kumar

Re: [resolved] how to remove rows containing null values from a CSV file to mysql

joseng_62 — Wed, 13 Mar 2013 12:26:33 GMT

Thanks all, i seems to have figured it out with tfilterrow - using the and functions and selecting the particular row, stating not equal to "null".
I appreciate the fast reply janhess and anilmca4