I am trying to write Pig scripts for my project. Problem I ma facing is I
want to load different files to same variable .Can it be possible to do
without modifying the Loader. I read about Hadoop globbing . Does anyone
have solution to these.
I know I can load all files of a given directory to single variable.
But is it possible to load specific files from that directory? Or specific
files from different directories to same load variable?
I also know about UNION strategy but that increase one map-reduce job and I
want to avoid that.
Any kind of suggestions are welcomed.