[Pig-user] Select x amount of input paths/files

You could use separate statements and then use UNION to add them together.

Otherwise you could write an UDF that loads multiple fiels at once.

Best regards,
Nathan


---
nathan@nathan.gs : http://nathan.gs : http://twitter.com/nathan_gs

You should be able to do it using some bash trickery.

%declare inputs `hls | cut -d '/' -f 2- | sort | tail -n $num | sed
's/^/\//' | sed 's/$/,/' `

Where $num is the number of files you want.
Then you can use $inputs in your LOAD statement.

I haven't tried this, so it might (will) contain bugs.