FAQ
Hi Hao.

Yes, you should be able to instrument any part of Hadoop including
mapreduce daemons. A good examples of how to inject faults to Hadoop
are fault inject tests you can find in Hdfs (under
src/test/aop/org/apache/hadoop). I believe Mapreduce doesn't have any
fault injections tests yet for most of our focus until now was on HDFS
side.

Please keep in mind that you need to write your own aspectj
implementation of the faults (for the weaving) and the you have to
make sure that the instrumented jar files are deployed to the cluster
(e.g. the weaved faults are present in the actual cluster jar files)

Out of the three on second one is in aop.xml.
% ant jar-fault-inject
% ant jar-test-fault-inject
% ant run-test-hdfs-fault-inject
The rest is located in the main build.xml. Pretty ugly I think but I
had to work around certain ant limitation and that was less harmful
workaround of all.

Please feel free to ask further questions if something won't be clear.
--
  Take care,
Konstantin (Cos) Boudnik


On Mon, Feb 21, 2011 at 05:30, Hao Zhu wrote:
Dear cos:

     Nice to meet you.
     I have a couple of questions about your great job: fault injection
project.
     First,  is this framework possible to inject a Node-failure fault into
mapreduce? Because i would like to simulate node failure described in
Google's paper in my cluster.
          if it possible, please give me some clues to achieve that goal.
     Second, i am a New to AOP. So, I just do not quite understand the
following command written in your guide:
           % ant jar-fault-inject
           % ant jar-test-fault-inject
           % ant run-test-hdfs-fault-inject
           but i check out the file: hdfs/src/test/aop/build/aop.xml, i
could not find out the corresponding code in that file.
     I work a project to run gridmix workload on my cluster with some node's
random failure. So the first question is really important to me.

     Finally, look forward to hear from you.
Best Regards
Hao Zhu

Search Discussions

  • Sangroya at Dec 29, 2011 at 11:05 am
    Hi,

    Is there any good documentation to start with fault injection. Please share
    if there is any link to any examples that demonstrate the use of fault
    injection.


    Thanks,
    Amit






    --
    View this message in context: http://lucene.472066.n3.nabble.com/Re-Some-question-about-fault-Injection-tp2555954p3618633.html
    Sent from the Hadoop lucene-users mailing list archive at Nabble.com.
  • Konstantin Boudnik at Dec 29, 2011 at 6:58 pm
    I suggest to start with fault injection tests. They can found under
    src/test/aop/org/apache/hadoop
    for HDFS in 0.22. Hdfs has been has the best coverage by fault injection.

    Test exists in the similar location in the trunk, but they aren't hooked up to
    maven build system yet.

    Cos
    On Thu, Dec 29, 2011 at 03:04AM, sangroya wrote:
    Hi,

    Is there any good documentation to start with fault injection. Please share
    if there is any link to any examples that demonstrate the use of fault
    injection.


    Thanks,
    Amit






    --
    View this message in context: http://lucene.472066.n3.nabble.com/Re-Some-question-about-fault-Injection-tp2555954p3618633.html
    Sent from the Hadoop lucene-users mailing list archive at Nabble.com.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedFeb 22, '11 at 10:08p
activeDec 29, '11 at 6:58p
posts3
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Konstantin Boudnik: 2 posts Sangroya: 1 post

People

Translate

site design / logo © 2022 Grokbase