FAQ
As defined in http://hadoop.apache.org/mailing_lists.html , please
send user questions to
mapreduce-user@hadoop.apache.org.

-- Owen
On Jan 20, 2011, at 10:21 AM, Eric Sammer wrote:

LiuLei:

Yes. What you're looking for is TextInputFormat.addPath() (assuming
you're
talking about text). You can call this multiple times and add
multiple input
paths if they are all of the same data format (i.e. text). If you have
multiple paths that contain different format data, you'll need to use
MultipleInputs. See the javadoc for details on usage.
On Thu, Jan 20, 2011 at 1:52 AM, lei liu wrote:

There are two input paths, example: /user/test1/ and /user/test2/
path.
Can
one map instance handle many data of input paths at the same time?


Thanks,

LiuLei


--
Eric Sammer
twitter: esammer
data: www.cloudera.com

Search Discussions

  • Harsh J at Jan 20, 2011 at 8:23 pm
    If you meant a single Mapper instance reading files/splits from those
    two sources, it should be doable too.
    On Thu, Jan 20, 2011 at 1:52 AM, lei liu wrote:

    There are two input paths, example: /user/test1/ and /user/test2/ path.

    Can

    one map instance handle many data of input paths at the same time?


    Thanks,

    LiuLei




    --
    Eric Sammer
    twitter: esammer
    data: www.cloudera.com


    --
    Harsh J
    www.harshj.com

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupmapreduce-user @
categorieshadoop
postedJan 20, '11 at 6:33p
activeJan 20, '11 at 8:23p
posts2
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Harsh J: 1 post Owen O'Malley: 1 post

People

Translate

site design / logo © 2022 Grokbase