CSV file with LF in columns.

[JSadasivam1614976104]

I have a CSV file as in the attached image. One of the columns has LF characters in it. The row seaparator is a LF as well. I have tried using tfileinputdelimited with CSV OPtions checked and the the Text Enclosure as """. tfilenputdelimited seems to ignore the text enclosure property.

Any suggestions on how to parse the file ?

[JSadasivam1614976104]

@gjeremy1617088143  i am getting a Java Heap error while reading the file . The file size is around 500 MB .

How do I resolve the Heap Error. I increased the JVM max to about 4 GB. Still getting the error.

[gjeremy1617088143]

Cut it in as many csv you can (5to10) and iterate the job on all of them. It will reduce the heap state (500 mo begin to be huge for csv, i already Work with 10go csv it consume all the memory if you don’t partition the data in smaller files).