FAQ
CompositeInputFormat: Unable to wrap custom InputFormats
--------------------------------------------------------

Key: HADOOP-3706
URL: https://issues.apache.org/jira/browse/HADOOP-3706
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.17.0
Reporter: Jingkei Ly


I am unable to use a custom InputFormat with the CompositeInputFormat as the classloader that is used by Parser is unable to find my class.

To reproduce (although I've got an example program, if that's preferred?):
1) Create a custom InputFormat (I made a copy of SequenceFileInputFormat and named it MyInputFormat)
2) Create a program using CompositeInputFormat [Set "mapred.join.expr" to CompositeInputFormat.compose("outer", MyInputFormat.class, plist)]
3) Create jar file
4) Run job (must be via the jar - the problem cannot be reproduced in Local mode)

Doing so causes the following exception:
{code}
Caused by: java.io.IOException
at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:274)
at org.apache.hadoop.mapred.join.Parser.reduce(Parser.java:463)
at org.apache.hadoop.mapred.join.Parser.parse(Parser.java:481)
at org.apache.hadoop.mapred.join.CompositeInputFormat.setFormat(CompositeInputFormat.java:77)
at org.apache.hadoop.mapred.join.CompositeInputFormat.validateInput(CompositeInputFormat.java:118)

Caused by: java.lang.ClassNotFoundException: my.custom.input.format.MyInputFormat
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:164)
at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:270)
{code}

Should the line on Parser.java:271 be something like:
{code}
jobConf.getClassByName(sb.toString());
{code}
instead of:
{code}
Class.forName(sb.toString()).asSubclass(InputFormat.class)
{code}
to ensure the correct classloader is used?


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Chris Douglas (JIRA) at Jul 7, 2008 at 9:06 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611347#action_12611347 ]

    Chris Douglas commented on HADOOP-3706:
    ---------------------------------------

    That looks likely. Have you tested your hypothesis? Could you attach a patch once you've confirmed it?
    CompositeInputFormat: Unable to wrap custom InputFormats
    --------------------------------------------------------

    Key: HADOOP-3706
    URL: https://issues.apache.org/jira/browse/HADOOP-3706
    Project: Hadoop Core
    Issue Type: Bug
    Components: mapred
    Affects Versions: 0.17.0
    Reporter: Jingkei Ly

    I am unable to use a custom InputFormat with the CompositeInputFormat as the classloader that is used by Parser is unable to find my class.
    To reproduce (although I've got an example program, if that's preferred?):
    1) Create a custom InputFormat (I made a copy of SequenceFileInputFormat and named it MyInputFormat)
    2) Create a program using CompositeInputFormat [Set "mapred.join.expr" to CompositeInputFormat.compose("outer", MyInputFormat.class, plist)]
    3) Create jar file
    4) Run job (must be via the jar - the problem cannot be reproduced in Local mode)
    Doing so causes the following exception:
    {code}
    Caused by: java.io.IOException
    at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:274)
    at org.apache.hadoop.mapred.join.Parser.reduce(Parser.java:463)
    at org.apache.hadoop.mapred.join.Parser.parse(Parser.java:481)
    at org.apache.hadoop.mapred.join.CompositeInputFormat.setFormat(CompositeInputFormat.java:77)
    at org.apache.hadoop.mapred.join.CompositeInputFormat.validateInput(CompositeInputFormat.java:118)
    Caused by: java.lang.ClassNotFoundException: my.custom.input.format.MyInputFormat
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:164)
    at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:270)
    {code}
    Should the line on Parser.java:271 be something like:
    {code}
    jobConf.getClassByName(sb.toString());
    {code}
    instead of:
    {code}
    Class.forName(sb.toString()).asSubclass(InputFormat.class)
    {code}
    to ensure the correct classloader is used?
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Jingkei Ly (JIRA) at Jul 8, 2008 at 11:36 am
    [ https://issues.apache.org/jira/browse/HADOOP-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Jingkei Ly updated HADOOP-3706:
    -------------------------------

    Attachment: HADOOP-3706-0.patch

    I've attached a patch to fix the problem. I have tested it by building a new jar from trunk, and it has fixed the problem for me.

    (Unfortunately, I've been having trouble getting a Hadoop development environment in Eclipse working fully in order to write a JUnit test, so no unit test is available in this patch.)
    CompositeInputFormat: Unable to wrap custom InputFormats
    --------------------------------------------------------

    Key: HADOOP-3706
    URL: https://issues.apache.org/jira/browse/HADOOP-3706
    Project: Hadoop Core
    Issue Type: Bug
    Components: mapred
    Affects Versions: 0.17.0
    Reporter: Jingkei Ly
    Attachments: HADOOP-3706-0.patch


    I am unable to use a custom InputFormat with the CompositeInputFormat as the classloader that is used by Parser is unable to find my class.
    To reproduce (although I've got an example program, if that's preferred?):
    1) Create a custom InputFormat (I made a copy of SequenceFileInputFormat and named it MyInputFormat)
    2) Create a program using CompositeInputFormat [Set "mapred.join.expr" to CompositeInputFormat.compose("outer", MyInputFormat.class, plist)]
    3) Create jar file
    4) Run job (must be via the jar - the problem cannot be reproduced in Local mode)
    Doing so causes the following exception:
    {code}
    Caused by: java.io.IOException
    at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:274)
    at org.apache.hadoop.mapred.join.Parser.reduce(Parser.java:463)
    at org.apache.hadoop.mapred.join.Parser.parse(Parser.java:481)
    at org.apache.hadoop.mapred.join.CompositeInputFormat.setFormat(CompositeInputFormat.java:77)
    at org.apache.hadoop.mapred.join.CompositeInputFormat.validateInput(CompositeInputFormat.java:118)
    Caused by: java.lang.ClassNotFoundException: my.custom.input.format.MyInputFormat
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:164)
    at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:270)
    {code}
    Should the line on Parser.java:271 be something like:
    {code}
    jobConf.getClassByName(sb.toString());
    {code}
    instead of:
    {code}
    Class.forName(sb.toString()).asSubclass(InputFormat.class)
    {code}
    to ensure the correct classloader is used?
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Chris Douglas (JIRA) at Jul 8, 2008 at 6:35 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Chris Douglas updated HADOOP-3706:
    ----------------------------------

    Fix Version/s: 0.19.0
    Assignee: Jingkei Ly
    Hadoop Flags: [Reviewed]
    Status: Patch Available (was: Open)

    +1
    CompositeInputFormat: Unable to wrap custom InputFormats
    --------------------------------------------------------

    Key: HADOOP-3706
    URL: https://issues.apache.org/jira/browse/HADOOP-3706
    Project: Hadoop Core
    Issue Type: Bug
    Components: mapred
    Affects Versions: 0.17.0
    Reporter: Jingkei Ly
    Assignee: Jingkei Ly
    Fix For: 0.19.0

    Attachments: HADOOP-3706-0.patch


    I am unable to use a custom InputFormat with the CompositeInputFormat as the classloader that is used by Parser is unable to find my class.
    To reproduce (although I've got an example program, if that's preferred?):
    1) Create a custom InputFormat (I made a copy of SequenceFileInputFormat and named it MyInputFormat)
    2) Create a program using CompositeInputFormat [Set "mapred.join.expr" to CompositeInputFormat.compose("outer", MyInputFormat.class, plist)]
    3) Create jar file
    4) Run job (must be via the jar - the problem cannot be reproduced in Local mode)
    Doing so causes the following exception:
    {code}
    Caused by: java.io.IOException
    at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:274)
    at org.apache.hadoop.mapred.join.Parser.reduce(Parser.java:463)
    at org.apache.hadoop.mapred.join.Parser.parse(Parser.java:481)
    at org.apache.hadoop.mapred.join.CompositeInputFormat.setFormat(CompositeInputFormat.java:77)
    at org.apache.hadoop.mapred.join.CompositeInputFormat.validateInput(CompositeInputFormat.java:118)
    Caused by: java.lang.ClassNotFoundException: my.custom.input.format.MyInputFormat
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:164)
    at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:270)
    {code}
    Should the line on Parser.java:271 be something like:
    {code}
    jobConf.getClassByName(sb.toString());
    {code}
    instead of:
    {code}
    Class.forName(sb.toString()).asSubclass(InputFormat.class)
    {code}
    to ensure the correct classloader is used?
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Chris Douglas (JIRA) at Jul 9, 2008 at 1:25 am
    [ https://issues.apache.org/jira/browse/HADOOP-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Chris Douglas updated HADOOP-3706:
    ----------------------------------

    Fix Version/s: (was: 0.19.0)
    0.18.0
    CompositeInputFormat: Unable to wrap custom InputFormats
    --------------------------------------------------------

    Key: HADOOP-3706
    URL: https://issues.apache.org/jira/browse/HADOOP-3706
    Project: Hadoop Core
    Issue Type: Bug
    Components: mapred
    Affects Versions: 0.17.0
    Reporter: Jingkei Ly
    Assignee: Jingkei Ly
    Fix For: 0.18.0

    Attachments: HADOOP-3706-0.patch


    I am unable to use a custom InputFormat with the CompositeInputFormat as the classloader that is used by Parser is unable to find my class.
    To reproduce (although I've got an example program, if that's preferred?):
    1) Create a custom InputFormat (I made a copy of SequenceFileInputFormat and named it MyInputFormat)
    2) Create a program using CompositeInputFormat [Set "mapred.join.expr" to CompositeInputFormat.compose("outer", MyInputFormat.class, plist)]
    3) Create jar file
    4) Run job (must be via the jar - the problem cannot be reproduced in Local mode)
    Doing so causes the following exception:
    {code}
    Caused by: java.io.IOException
    at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:274)
    at org.apache.hadoop.mapred.join.Parser.reduce(Parser.java:463)
    at org.apache.hadoop.mapred.join.Parser.parse(Parser.java:481)
    at org.apache.hadoop.mapred.join.CompositeInputFormat.setFormat(CompositeInputFormat.java:77)
    at org.apache.hadoop.mapred.join.CompositeInputFormat.validateInput(CompositeInputFormat.java:118)
    Caused by: java.lang.ClassNotFoundException: my.custom.input.format.MyInputFormat
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:164)
    at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:270)
    {code}
    Should the line on Parser.java:271 be something like:
    {code}
    jobConf.getClassByName(sb.toString());
    {code}
    instead of:
    {code}
    Class.forName(sb.toString()).asSubclass(InputFormat.class)
    {code}
    to ensure the correct classloader is used?
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Chris Douglas (JIRA) at Jul 9, 2008 at 1:30 am
    [ https://issues.apache.org/jira/browse/HADOOP-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611868#action_12611868 ]

    Chris Douglas commented on HADOOP-3706:
    ---------------------------------------

    {noformat}
    [exec] -1 overall.
    [exec]
    [exec] +1 @author. The patch does not contain any @author tags.
    [exec]
    [exec] -1 tests included. The patch doesn't appear to include any new or modified tests.
    [exec] Please justify why no tests are needed for this patch.
    [exec]
    [exec] +1 javadoc. The javadoc tool did not generate any warning messages.
    [exec]
    [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
    [exec]
    [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
    {noformat}

    This doesn't break any relevant testcases on my machine.
    CompositeInputFormat: Unable to wrap custom InputFormats
    --------------------------------------------------------

    Key: HADOOP-3706
    URL: https://issues.apache.org/jira/browse/HADOOP-3706
    Project: Hadoop Core
    Issue Type: Bug
    Components: mapred
    Affects Versions: 0.17.0
    Reporter: Jingkei Ly
    Assignee: Jingkei Ly
    Fix For: 0.18.0

    Attachments: HADOOP-3706-0.patch


    I am unable to use a custom InputFormat with the CompositeInputFormat as the classloader that is used by Parser is unable to find my class.
    To reproduce (although I've got an example program, if that's preferred?):
    1) Create a custom InputFormat (I made a copy of SequenceFileInputFormat and named it MyInputFormat)
    2) Create a program using CompositeInputFormat [Set "mapred.join.expr" to CompositeInputFormat.compose("outer", MyInputFormat.class, plist)]
    3) Create jar file
    4) Run job (must be via the jar - the problem cannot be reproduced in Local mode)
    Doing so causes the following exception:
    {code}
    Caused by: java.io.IOException
    at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:274)
    at org.apache.hadoop.mapred.join.Parser.reduce(Parser.java:463)
    at org.apache.hadoop.mapred.join.Parser.parse(Parser.java:481)
    at org.apache.hadoop.mapred.join.CompositeInputFormat.setFormat(CompositeInputFormat.java:77)
    at org.apache.hadoop.mapred.join.CompositeInputFormat.validateInput(CompositeInputFormat.java:118)
    Caused by: java.lang.ClassNotFoundException: my.custom.input.format.MyInputFormat
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:164)
    at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:270)
    {code}
    Should the line on Parser.java:271 be something like:
    {code}
    jobConf.getClassByName(sb.toString());
    {code}
    instead of:
    {code}
    Class.forName(sb.toString()).asSubclass(InputFormat.class)
    {code}
    to ensure the correct classloader is used?
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Chris Douglas (JIRA) at Jul 9, 2008 at 1:37 am
    [ https://issues.apache.org/jira/browse/HADOOP-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Chris Douglas updated HADOOP-3706:
    ----------------------------------

    Resolution: Fixed
    Status: Resolved (was: Patch Available)

    I just committed this. Thanks, Jingkei
    CompositeInputFormat: Unable to wrap custom InputFormats
    --------------------------------------------------------

    Key: HADOOP-3706
    URL: https://issues.apache.org/jira/browse/HADOOP-3706
    Project: Hadoop Core
    Issue Type: Bug
    Components: mapred
    Affects Versions: 0.17.0
    Reporter: Jingkei Ly
    Assignee: Jingkei Ly
    Fix For: 0.18.0

    Attachments: HADOOP-3706-0.patch


    I am unable to use a custom InputFormat with the CompositeInputFormat as the classloader that is used by Parser is unable to find my class.
    To reproduce (although I've got an example program, if that's preferred?):
    1) Create a custom InputFormat (I made a copy of SequenceFileInputFormat and named it MyInputFormat)
    2) Create a program using CompositeInputFormat [Set "mapred.join.expr" to CompositeInputFormat.compose("outer", MyInputFormat.class, plist)]
    3) Create jar file
    4) Run job (must be via the jar - the problem cannot be reproduced in Local mode)
    Doing so causes the following exception:
    {code}
    Caused by: java.io.IOException
    at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:274)
    at org.apache.hadoop.mapred.join.Parser.reduce(Parser.java:463)
    at org.apache.hadoop.mapred.join.Parser.parse(Parser.java:481)
    at org.apache.hadoop.mapred.join.CompositeInputFormat.setFormat(CompositeInputFormat.java:77)
    at org.apache.hadoop.mapred.join.CompositeInputFormat.validateInput(CompositeInputFormat.java:118)
    Caused by: java.lang.ClassNotFoundException: my.custom.input.format.MyInputFormat
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:164)
    at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:270)
    {code}
    Should the line on Parser.java:271 be something like:
    {code}
    jobConf.getClassByName(sb.toString());
    {code}
    instead of:
    {code}
    Class.forName(sb.toString()).asSubclass(InputFormat.class)
    {code}
    to ensure the correct classloader is used?
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hudson (JIRA) at Aug 22, 2008 at 12:42 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12624804#action_12624804 ]

    Hudson commented on HADOOP-3706:
    --------------------------------

    Integrated in Hadoop-trunk #581 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/581/])
    CompositeInputFormat: Unable to wrap custom InputFormats
    --------------------------------------------------------

    Key: HADOOP-3706
    URL: https://issues.apache.org/jira/browse/HADOOP-3706
    Project: Hadoop Core
    Issue Type: Bug
    Components: mapred
    Affects Versions: 0.17.0
    Reporter: Jingkei Ly
    Assignee: Jingkei Ly
    Fix For: 0.18.0

    Attachments: HADOOP-3706-0.patch


    I am unable to use a custom InputFormat with the CompositeInputFormat as the classloader that is used by Parser is unable to find my class.
    To reproduce (although I've got an example program, if that's preferred?):
    1) Create a custom InputFormat (I made a copy of SequenceFileInputFormat and named it MyInputFormat)
    2) Create a program using CompositeInputFormat [Set "mapred.join.expr" to CompositeInputFormat.compose("outer", MyInputFormat.class, plist)]
    3) Create jar file
    4) Run job (must be via the jar - the problem cannot be reproduced in Local mode)
    Doing so causes the following exception:
    {code}
    Caused by: java.io.IOException
    at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:274)
    at org.apache.hadoop.mapred.join.Parser.reduce(Parser.java:463)
    at org.apache.hadoop.mapred.join.Parser.parse(Parser.java:481)
    at org.apache.hadoop.mapred.join.CompositeInputFormat.setFormat(CompositeInputFormat.java:77)
    at org.apache.hadoop.mapred.join.CompositeInputFormat.validateInput(CompositeInputFormat.java:118)
    Caused by: java.lang.ClassNotFoundException: my.custom.input.format.MyInputFormat
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:164)
    at org.apache.hadoop.mapred.join.Parser$WNode.parse(Parser.java:270)
    {code}
    Should the line on Parser.java:271 be something like:
    {code}
    jobConf.getClassByName(sb.toString());
    {code}
    instead of:
    {code}
    Class.forName(sb.toString()).asSubclass(InputFormat.class)
    {code}
    to ensure the correct classloader is used?
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedJul 7, '08 at 5:04p
activeAug 22, '08 at 12:42p
posts8
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Hudson (JIRA): 8 posts

People

Translate

site design / logo © 2022 Grokbase