Grokbase › Groups › Hadoop › common-dev › April 2009
FAQ
Hi everyone,

I am interested in understanding how the language bindings
work in Hadoop and how I might contribute some. As Hadoop is built in Java, Java is the natural language to interface to it. However, I am interested in interfacing from other languages. My Hadoop back-end installation would remain the same, but the code I write that uses it would be built in a non-Java language. If you have any information on how I might approach this, please let me know.

Can anyone give me
some initial help on this, where to look in the codebase and some
pointers to any documents?

Thanks.
Huw Evans

Search Discussions

  • Wang Zhong at Apr 30, 2009 at 1:53 am ⇧
    Hi

    You can read Hadoop Streaming in Hadoop Documentation which allows
    running MapReduce with any executable. The mappers and reducers get
    input from stdin and output to stdout.

    On Wed, Apr 29, 2009 at 11:12 PM, Huw Evans wrote:
    Hi everyone,

    I am interested in understanding how the language bindings
    work in Hadoop and how I might contribute some.  As Hadoop is built in Java, Java is the natural language to interface to it.  However, I am interested in interfacing from other languages.  My Hadoop back-end installation would remain the same, but the code I write that uses it would be built in a non-Java language.  If you have any information on how I might approach this, please let me know.

    Can anyone give me
    some initial help on this,  where to look in the codebase and some
    pointers to any documents?

    Thanks.
    Huw Evans




    --
    Wang Zhong
  • Steve Loughran at Apr 30, 2009 at 12:22 pm ⇧
    I think some script language bindings would be nice. Java6 has
    JavaScript out the box, for examples and testing, but with the right
    JARs you could do mappers and reducers in-VM in Jython, JRuby, groovy, etc.
  • Sharad Agarwal at May 11, 2009 at 5:27 am ⇧
    After the commit of HADOOP-5135 (Separate the core, hdfs and mapred
    junit tests), the directory structure of src/test has changed. Folder
    src/test/org has been removed. All patches which touches a test case or
    add a new one, need to refactor their patches as per the new structure.

    - Sharad

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedApr 29, '09 at 3:31p
activeMay 11, '09 at 5:27a
posts4
users4
websitehadoop.apache.org...
irc#hadoop

4 users in discussion

Wang Zhong: 1 post Steve Loughran: 1 post Huw Evans: 1 post Sharad Agarwal: 1 post

Content

People

Support

Translate

site design / logo © 2022 Grokbase