Grokbase Groups Pig user August 2009
Hello Everyone,

I am trying to write Pig scripts for my project. Problem I ma facing is I
want to load different files to same variable .Can it be possible to do
without modifying the Loader. I read about Hadoop globbing . Does anyone
have solution to these.

I know I can load all files of a given directory to single variable.
But is it possible to load specific files from that directory? Or specific
files from different directories to same load variable?

I also know about UNION strategy but that increase one map-reduce job and I
want to avoid that.

Any kind of suggestions are welcomed.


Search Discussions

Discussion Posts

Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 1 of 7 | next ›
Discussion Overview
groupuser @
categoriespig, hadoop
postedAug 26, '09 at 5:22p
activeSep 3, '09 at 2:03p



site design / logo © 2021 Grokbase