Pig problem - Dealing with two delimiters. Please help.
I'm new to to Pig. I have a problem -
My input textfile.txt ->
aaaa,bbbb,cccc
aaaa,'xxxx,yyyy',zzzz
qqqq,wwww,eeee
Output should have three columns only. Anything in single quotes should be treated as single column. 'xxxx,yyyy' to be treated as one field data only.
If I use below -
A = load textfile.txt PigStorage(,) as (col1:chararray, col2:chararray ,col3:chararray)
I get -
(aaaa,bbbb,cccc)
(aaaa,'xxxx,yyyy')
(qqqq,wwww,eeee)
Please help me with this.