I'm trying to read in a comma-separated file with a simple command:
a = load 'myfile' using PigStorage(',');
However, some lines in my file have the , inside a quoted string, and
Pig is picking it up as 2 separate tokens:
I get the "string-with" and "comma" as 2 separate tokens.
Is there a way to configure the load using PigStorage command to respect
"escaped" delimeters? Or do I need to write my loader? Or is there a
better way of doing this?