topic Re: Loading CSV file which have new line with blank columns in Talend Studio

Loading CSV file which have new line with blank columns

Anonymous — Sat, 16 Nov 2024 11:17:27 GMT

Hi,
I have CSV file which has a new line in middle of the column and the rest of the data in that row has gone to next line.
because of which i am facing issue while loading the data into DB.
please see the below screen shot.
I need to remove the spaces after column with data "MANJUN" and append the rest of the data after it.

Thanks,
Tulasi

Re: Loading CSV file which have new line with blank columns

Anonymous — Mon, 16 Mar 2015 11:23:41 GMT

Hi,
You screenshot is missing. Please make sure that y our file must not be bigger than 2 MB.
Is it OK with you when check out "Trim" option in tfileinputdelimited to trim the leading and trailing white space?

Best regards
Sabrina

Re: Loading CSV file which have new line with blank columns

Anonymous — Mon, 16 Mar 2015 11:41:49 GMT

Hi Sabrina,
I am attaching the screenshot.
Yeah, i have tried it with the Trim Option, but no luck.
Thanks,
Tulasi

Re: Loading CSV file which have new line with blank columns

Anonymous — Mon, 16 Mar 2015 12:01:43 GMT

Screen shot uploaded

Re: Loading CSV file which have new line with blank columns

Anonymous — Mon, 16 Mar 2015 12:06:42 GMT

screenshot for reference.

Re: Loading CSV file which have new line with blank columns

Anonymous — Mon, 16 Mar 2015 12:08:31 GMT

i am unable to upload the screen shot.
Can you please me without the screen shot

Re: Loading CSV file which have new line with blank columns

Anonymous — Mon, 16 Mar 2015 12:13:54 GMT

select check csv options in advance tab of tFileInputDelimited. if your file has string data enclosed with double quotes.

Re: Loading CSV file which have new line with blank columns

Anonymous — Mon, 16 Mar 2015 12:17:58 GMT

Hi Umesh,
There are no string data in my csv file enclosed in double quotes.
There is a complete blank line after the first two columns and the next line contains the data.
Thanks,
Tulasi

Re: Loading CSV file which have new line with blank columns

Anonymous — Mon, 16 Mar 2015 12:32:27 GMT

Can you show us, source row or paste the raw row here?

Re: Loading CSV file which have new line with blank columns

Anonymous — Mon, 16 Mar 2015 12:35:47 GMT

Thanks,
Tulasi

Re: Loading CSV file which have new line with blank columns

Anonymous — Mon, 16 Mar 2015 12:41:03 GMT

please open file in notepad then locate the row which causing the problem.

Re: Loading CSV file which have new line with blank columns

Anonymous — Tue, 17 Mar 2015 06:06:47 GMT

I know the line numbers of the row which are causing the problem.

Re: Loading CSV file which have new line with blank columns

Anonymous — Tue, 17 Mar 2015 06:29:30 GMT

then would you like to share that line with us?

Re: Loading CSV file which have new line with blank columns

Anonymous — Tue, 17 Mar 2015 09:39:23 GMT

Thanks,
Tulasi

Re: Loading CSV file which have new line with blank columns

Anonymous — Tue, 17 Mar 2015 11:07:10 GMT

Can you please provide a solution since it is urgent

Re: Loading CSV file which have new line with blank columns

Anonymous — Tue, 17 Mar 2015 11:18:54 GMT

design job as below,
tFileInputFullRow----tjavarow---textractDelmitedField---youroutput.
in tJavaRow add following code to replace multiple white spaces with one space.

yourcolumn.replaceAll("+", " ");

Note: please make copy of source file before doing test.

Re: Loading CSV file which have new line with blank columns

Anonymous — Wed, 18 Mar 2015 11:09:34 GMT

Hi Umesh,
I test above code with sample data.It's not removing new line in string.Pls see attached pics.
1st image have sample data.
2nd image talend generated output.

Regards,
kumar.talend

Re: Loading CSV file which have new line with blank columns

Anonymous — Wed, 18 Mar 2015 11:43:36 GMT

Hi Tulasi,
Use below code in tamp:
row1.Customer_name.replaceAll("\\r\\n|\\r|\\n", " ") (Replace row1.Customer_name with your column)..See attached screen

Regards,
kumar.talend

Re: Loading CSV file which have new line with blank columns

Anonymous — Wed, 18 Mar 2015 11:48:15 GMT

Hi Kumar.Talend,
Thank you for testing it, but you tested it with wrong data.
As I asked Tulsi earlier, if he show us raw data of file then we can suggest, the images he shared previously showing from excel open view.
he has to open same file in notepad or notepad++ and then locate the problematic row. then take snap and share with us.

Either your file row delimiter is different?
Column has long spaces.
may be Filed delimiter is different?
or anything else.
please share the actual data not the created one, last solution provided to replace multiple white spaces with single one.

Re: Loading CSV file which have new line with blank columns

_AnonymousUser — Fri, 03 Apr 2015 07:05:30 GMT

Hi Umesh,
I have attached the screen shot of the file. i am attaching i once again.
The screen shot i have attached is the one form the notepad++ only.
The delimited file is tab separated.
Thanks,
Tulasi