Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi All,
I'm currently facing an issue while reading an input csv file where the data is enclosed within double quotes.
Below is a scenario where the data is as follows :
id;name;desc
1;"Mark";"Test Data"
2;"David";"Test Data Ha.""
3;"Steven";"\"
Here , within the data there are double quotes and a backslash within the desc column and I'm unable to escape both and hence the data is being shifted.
Ex : Escape char -
"""
Text Enclosure -
"""
Escape char - "\\" Text Enclosure - """
Also, the input files are huge (30+ GB) so would like to avoid having to use script. Other escape characters were also tried , but with no success. ("\"")
Any suggestions?
Thanks
@Nauman Hussain , you do one thing after tfileinputdelimited use the tJavarow or tMap to replace " with empty ,so that you can avoid the extra " .
Thanks,
Manohar
Hi @Manohar B ,
Thank you.
That's an option for the 2nd record , but the 3rd record with desc column "\" is being shifted.
I can remove the double quote, but is there a way to handle the 3rd record ?
Here, the escape character and text enclosure are used as """
Input :
Output :
Thanks
Nauman