FAQ
Has anyone seen this error? Any help is appreciated, thanks;

hive> select * from apachelog where host ="64.62.191.114";
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201001211744_0002, Tracking URL =
http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
Kill Command = /u01/hadoop/bin/../bin/hadoop job
-Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
2010-01-21 07:24:38,198 map = 0%, reduce =0%
2010-01-21 07:25:15,029 map = 100%, reduce =100%
Ended Job = job_201001211744_0002 with errors
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.ExecDriver

Search Discussions

  • John Villa at Jan 21, 2010 at 8:51 pm
    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient
    (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver
    (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
    errors
    2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279))
    - FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver

    On Thu, Jan 21, 2010 at 3:37 PM, John Villa wrote:

    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL =
    http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job
    -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver
  • Ning Zhang at Jan 21, 2010 at 9:17 pm
    It may be because you have 2 copies of Hive's jar files (e.g., one in Hadoop's lib directory and one in Hive's lib directory) and they are from different releases. If you have compiled Hive trunk yoruself please make sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with errors
    2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver


    On Thu, Jan 21, 2010 at 3:37 PM, John Villa wrote:
    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL = http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
  • John Villa at Jan 21, 2010 at 9:37 pm
    I did not see any hive jar files within hadoop lib directory. I compiled it
    using ant and the basic readme.
    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:

    It may be because you have 2 copies of Hive's jar files (e.g., one in
    Hadoop's lib directory and one in Hive's lib directory) and they are from
    different releases. If you have compiled Hive trunk yoruself please make
    sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient
    (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver
    (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
    errors
    2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279))
    - FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver

    On Thu, Jan 21, 2010 at 3:37 PM, John Villa wrote:

    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL =
    http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job
    -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver
  • Ning Zhang at Jan 21, 2010 at 10:04 pm
    Which hadoop version are you using (you can see it by running 'hadoop version')? Have you specified hadoop.version when you compile Hive? Are they match?

    Also can you post the log file found through the Tracking URL when you launch the job (in your example http://master:50030/jobdetails.jsp...)? The log files can be found by click through the mappers/reducers and at the rightmost column of the mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I compiled it using ant and the basic readme.

    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:
    It may be because you have 2 copies of Hive's jar files (e.g., one in Hadoop's lib directory and one in Hive's lib directory) and they are from different releases. If you have compiled Hive trunk yoruself please make sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with errors
    2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver


    On Thu, Jan 21, 2010 at 3:37 PM, John Villa wrote:
    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL = http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
  • John Villa at Jan 21, 2010 at 10:33 pm
    I am currently using hadoop 0.20.1. When I installed ant I did
    -Dhadoop.version="0.20.0"
    I will try and get you that output but my connection is rough right now and
    I need to do a little port forwarding. I will get it to you when i can.

    On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang wrote:

    Which hadoop version are you using (you can see it by running 'hadoop
    version')? Have you specified hadoop.version when you compile Hive? Are they
    match?

    Also can you post the log file found through the Tracking URL when you
    launch the job (in your example http://master:50030/jobdetails.jsp...)?
    The log files can be found by click through the mappers/reducers and at the
    rightmost column of the mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I compiled it
    using ant and the basic readme.
    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:

    It may be because you have 2 copies of Hive's jar files (e.g., one in
    Hadoop's lib directory and one in Hive's lib directory) and they are from
    different releases. If you have compiled Hive trunk yoruself please make
    sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient
    (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver
    (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
    errors
    2010-01-21 20:49:55,550 ERROR ql.Driver
    (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
    from org.apache.hadoop.hive.ql.exec.ExecDriver

    On Thu, Jan 21, 2010 at 3:37 PM, John Villa wrote:

    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL =
    http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job
    -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver
  • John Villa at Jan 21, 2010 at 10:49 pm
    Here is the output;

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more
    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more







    On Thu, Jan 21, 2010 at 5:33 PM, John Villa wrote:

    I am currently using hadoop 0.20.1. When I installed ant I did
    -Dhadoop.version="0.20.0"
    I will try and get you that output but my connection is rough right now and
    I need to do a little port forwarding. I will get it to you when i can.


    On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang wrote:

    Which hadoop version are you using (you can see it by running 'hadoop
    version')? Have you specified hadoop.version when you compile Hive? Are they
    match?

    Also can you post the log file found through the Tracking URL when you
    launch the job (in your example http://master:50030/jobdetails.jsp...)?
    The log files can be found by click through the mappers/reducers and at the
    rightmost column of the mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I compiled
    it using ant and the basic readme.
    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:

    It may be because you have 2 copies of Hive's jar files (e.g., one in
    Hadoop's lib directory and one in Hive's lib directory) and they are from
    different releases. If you have compiled Hive trunk yoruself please make
    sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient
    (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver
    (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
    errors
    2010-01-21 20:49:55,550 ERROR ql.Driver
    (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
    from org.apache.hadoop.hive.ql.exec.ExecDriver

    On Thu, Jan 21, 2010 at 3:37 PM, John Villa wrote:

    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL =
    http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job
    -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver
  • John Villa at Jan 21, 2010 at 11:02 pm
    I just ran the job again and looking at the raw logs on the filesystem I get
    the same;
    2010-01-21 22:52:17,490 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 22:52:17,490 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 22:52:17,492 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 22:52:17,492 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 22:52:17,492 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 22:52:17,492 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 22:52:49,430 ERROR ql.Driver (SessionState.java:printError(279))
    - FAILED: Parse Error: line 1:0 cannot recognize input 'clear'

    org.apache.hadoop.hive.ql.parse.ParseException: line 1:0 cannot recognize
    input 'clear'

    at
    org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:357)
    at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:241)
    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:281)
    at
    org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:123)
    at
    org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:181)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:287)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

    2010-01-21 22:53:21,144 WARN mapred.JobClient
    (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 22:53:53,788 ERROR exec.ExecDriver
    (SessionState.java:printError(279)) - Ended Job = job_201001211744_0018 with
    errors
    2010-01-21 22:53:53,815 ERROR ql.Driver (SessionState.java:printError(279))
    - FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver

    Thanks a lot for looking into this.
    Thanks,
    -John
    On Thu, Jan 21, 2010 at 5:48 PM, John Villa wrote:

    Here is the output;

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)

    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)

    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)

    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more
    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more







    On Thu, Jan 21, 2010 at 5:33 PM, John Villa wrote:

    I am currently using hadoop 0.20.1. When I installed ant I did
    -Dhadoop.version="0.20.0"
    I will try and get you that output but my connection is rough right now
    and I need to do a little port forwarding. I will get it to you when i can.


    On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang wrote:

    Which hadoop version are you using (you can see it by running 'hadoop
    version')? Have you specified hadoop.version when you compile Hive? Are they
    match?

    Also can you post the log file found through the Tracking URL when you
    launch the job (in your example http://master:50030/jobdetails.jsp...)?
    The log files can be found by click through the mappers/reducers and at the
    rightmost column of the mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I compiled
    it using ant and the basic readme.
    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:

    It may be because you have 2 copies of Hive's jar files (e.g., one in
    Hadoop's lib directory and one in Hive's lib directory) and they are from
    different releases. If you have compiled Hive trunk yoruself please make
    sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient
    (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver
    (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
    errors
    2010-01-21 20:49:55,550 ERROR ql.Driver
    (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
    from org.apache.hadoop.hive.ql.exec.ExecDriver

    On Thu, Jan 21, 2010 at 3:37 PM, John Villa wrote:

    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL =
    http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job
    -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver
  • Ning Zhang at Jan 21, 2010 at 11:19 pm
    This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    The RegexSerDe is included in hive_contrib.jar. There may be an bug of the name here because all other jar files are following the same convention hive-*-0.6.0.jar. If you see all the other jar files in the lib directory following the convention, you probably need to rename hive_contrib.jar to hive-contrib-0.6.0.jar. Can you try that and let us know the result?

    Thanks,
    Ning

    On Jan 21, 2010, at 2:48 PM, John Villa wrote:


    Here is the output;

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)

    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)

    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)

    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more
    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more







    On Thu, Jan 21, 2010 at 5:33 PM, John Villa wrote:
    I am currently using hadoop 0.20.1. When I installed ant I did -Dhadoop.version="0.20.0"
    I will try and get you that output but my connection is rough right now and I need to do a little port forwarding. I will get it to you when i can.



    On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang wrote:
    Which hadoop version are you using (you can see it by running 'hadoop version')? Have you specified hadoop.version when you compile Hive? Are they match?

    Also can you post the log file found through the Tracking URL when you launch the job (in your example http://master:50030/jobdetails.jsp...)? The log files can be found by click through the mappers/reducers and at the rightmost column of the mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I compiled it using ant and the basic readme.

    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:
    It may be because you have 2 copies of Hive's jar files (e.g., one in Hadoop's lib directory and one in Hive's lib directory) and they are from different releases. If you have compiled Hive trunk yoruself please make sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with errors
    2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver


    On Thu, Jan 21, 2010 at 3:37 PM, John Villa wrote:
    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL = http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
  • Carl Steinbach at Jan 21, 2010 at 11:35 pm
    Hi John,

    I think you forgot to add hive_contrib.jar to the distributed cache using
    the "add jar" command? I recommend looking at the RegexSerDe testcase
    located in contrib/src/test/queries/clientpositive/serde_regex.q for an
    example of how to register the hive_contrib jar.

    Thanks.

    Carl
    On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang wrote:

    This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    The RegexSerDe is included in hive_contrib.jar. There may be an bug of the
    name here because all other jar files are following the same convention
    hive-*-0.6.0.jar. If you see all the other jar files in the lib directory
    following the convention, you probably need to rename hive_contrib.jar to
    hive-contrib-0.6.0.jar. Can you try that and let us know the result?

    Thanks,
    Ning

    On Jan 21, 2010, at 2:48 PM, John Villa wrote:

    Here is the output;

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)

    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)

    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)

    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more
    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more







    On Thu, Jan 21, 2010 at 5:33 PM, John Villa wrote:

    I am currently using hadoop 0.20.1. When I installed ant I did
    -Dhadoop.version="0.20.0"
    I will try and get you that output but my connection is rough right now
    and I need to do a little port forwarding. I will get it to you when i can.


    On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang wrote:

    Which hadoop version are you using (you can see it by running 'hadoop
    version')? Have you specified hadoop.version when you compile Hive? Are they
    match?

    Also can you post the log file found through the Tracking URL when you
    launch the job (in your example http://master:50030/jobdetails.jsp...)?
    The log files can be found by click through the mappers/reducers and at the
    rightmost column of the mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I compiled
    it using ant and the basic readme.
    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:

    It may be because you have 2 copies of Hive's jar files (e.g., one in
    Hadoop's lib directory and one in Hive's lib directory) and they are from
    different releases. If you have compiled Hive trunk yoruself please make
    sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient
    (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver
    (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
    errors
    2010-01-21 20:49:55,550 ERROR ql.Driver
    (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
    from org.apache.hadoop.hive.ql.exec.ExecDriver

    On Thu, Jan 21, 2010 at 3:37 PM, John Villa wrote:

    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL =
    http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job
    -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver
  • Carl Steinbach at Jan 21, 2010 at 11:45 pm
    The naming convention for Hive jar files was changed in HIVE-978 from
    hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive
    jars *except* hive_contrib.jar which was not changed because the
    hive_contrib.jar filename is referenced in several test cases. HIVE-1063
    fixes this problem by providing the ability to reference system property
    variables in test case qfiles.

    Thanks.

    Carl
    On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang wrote:

    This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    The RegexSerDe is included in hive_contrib.jar. There may be an bug of the
    name here because all other jar files are following the same convention
    hive-*-0.6.0.jar. If you see all the other jar files in the lib directory
    following the convention, you probably need to rename hive_contrib.jar to
    hive-contrib-0.6.0.jar. Can you try that and let us know the result?

    Thanks,
    Ning

    On Jan 21, 2010, at 2:48 PM, John Villa wrote:

    Here is the output;

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)

    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)

    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)

    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more
    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)

    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)

    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)

    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)

    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)

    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)

    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)

    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more







    On Thu, Jan 21, 2010 at 5:33 PM, John Villa wrote:

    I am currently using hadoop 0.20.1. When I installed ant I did
    -Dhadoop.version="0.20.0"
    I will try and get you that output but my connection is rough right now
    and I need to do a little port forwarding. I will get it to you when i can.


    On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang wrote:

    Which hadoop version are you using (you can see it by running 'hadoop
    version')? Have you specified hadoop.version when you compile Hive? Are they
    match?

    Also can you post the log file found through the Tracking URL when you
    launch the job (in your example http://master:50030/jobdetails.jsp...)?
    The log files can be found by click through the mappers/reducers and at the
    rightmost column of the mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I compiled
    it using ant and the basic readme.
    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:

    It may be because you have 2 copies of Hive's jar files (e.g., one in
    Hadoop's lib directory and one in Hive's lib directory) and they are from
    different releases. If you have compiled Hive trunk yoruself please make
    sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient
    (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver
    (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
    errors
    2010-01-21 20:49:55,550 ERROR ql.Driver
    (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
    from org.apache.hadoop.hive.ql.exec.ExecDriver

    On Thu, Jan 21, 2010 at 3:37 PM, John Villa wrote:

    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL =
    http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job
    -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver
  • Ning Zhang at Jan 22, 2010 at 12:01 am
    Thanks Carl. I'll take a look at the patch for HIVE-1063.

    Ning
    On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:


    The naming convention for Hive jar files was changed in HIVE-978 from hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive jars *except* hive_contrib.jar which was not changed because the hive_contrib.jar filename is referenced in several test cases. HIVE-1063 fixes this problem by providing the ability to reference system property variables in test case qfiles.

    Thanks.

    Carl

    On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang wrote:
    This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    The RegexSerDe is included in hive_contrib.jar. There may be an bug of the name here because all other jar files are following the same convention hive-*-0.6.0.jar. If you see all the other jar files in the lib directory following the convention, you probably need to rename hive_contrib.jar to hive-contrib-0.6.0.jar. Can you try that and let us know the result?

    Thanks,
    Ning

    On Jan 21, 2010, at 2:48 PM, John Villa wrote:


    Here is the output;


    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)


    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)


    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)


    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)


    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)


    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)


    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)


    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)


    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)


    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)


    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more
    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)


    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)


    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)


    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)


    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)


    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)


    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)


    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)


    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more







    On Thu, Jan 21, 2010 at 5:33 PM, John Villa wrote:
    I am currently using hadoop 0.20.1. When I installed ant I did -Dhadoop.version="0.20.0"
    I will try and get you that output but my connection is rough right now and I need to do a little port forwarding. I will get it to you when i can.



    On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang wrote:
    Which hadoop version are you using (you can see it by running 'hadoop version')? Have you specified hadoop.version when you compile Hive? Are they match?

    Also can you post the log file found through the Tracking URL when you launch the job (in your example http://master:50030/jobdetails.jsp...)? The log files can be found by click through the mappers/reducers and at the rightmost column of the mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I compiled it using ant and the basic readme.

    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:
    It may be because you have 2 copies of Hive's jar files (e.g., one in Hadoop's lib directory and one in Hive's lib directory) and they are from different releases. If you have compiled Hive trunk yoruself please make sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with errors
    2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver


    On Thu, Jan 21, 2010 at 3:37 PM, John Villa wrote:
    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL = http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
  • John Villa at Jan 22, 2010 at 12:35 am
    Thanks for the info. The only adding of jar files I did was this when
    creating a tables;

    add jar ../build/contrib/hive_contrib.jar;



    On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang wrote:

    Thanks Carl. I'll take a look at the patch for HIVE-1063.

    Ning

    On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:


    The naming convention for Hive jar files was changed in HIVE-978 from
    hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive
    jars *except* hive_contrib.jar which was not changed because the
    hive_contrib.jar filename is referenced in several test cases. HIVE-1063
    fixes this problem by providing the ability to reference system property
    variables in test case qfiles.

    Thanks.

    Carl
    On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang wrote:

    This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    The RegexSerDe is included in hive_contrib.jar. There may be an bug of the
    name here because all other jar files are following the same convention
    hive-*-0.6.0.jar. If you see all the other jar files in the lib directory
    following the convention, you probably need to rename hive_contrib.jar to
    hive-contrib-0.6.0.jar. Can you try that and let us know the result?

    Thanks,
    Ning

    On Jan 21, 2010, at 2:48 PM, John Villa wrote:

    Here is the output;

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)


    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)


    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)


    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)


    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)


    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)


    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)


    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)


    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)


    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)


    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more
    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)


    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)


    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)


    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)


    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)


    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)


    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)


    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)


    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)


    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)


    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)


    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)


    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe


    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)


    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)


    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more







    On Thu, Jan 21, 2010 at 5:33 PM, John Villa wrote:

    I am currently using hadoop 0.20.1. When I installed ant I did
    -Dhadoop.version="0.20.0"
    I will try and get you that output but my connection is rough right now
    and I need to do a little port forwarding. I will get it to you when i can.


    On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang wrote:

    Which hadoop version are you using (you can see it by running 'hadoop
    version')? Have you specified hadoop.version when you compile Hive? Are they
    match?

    Also can you post the log file found through the Tracking URL when you
    launch the job (in your example http://master:50030/jobdetails.jsp...)?
    The log files can be found by click through the mappers/reducers and at the
    rightmost column of the mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I compiled
    it using ant and the basic readme.
    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:

    It may be because you have 2 copies of Hive's jar files (e.g., one in
    Hadoop's lib directory and one in Hive's lib directory) and they are from
    different releases. If you have compiled Hive trunk yoruself please make
    sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient
    (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver
    (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
    errors
    2010-01-21 20:49:55,550 ERROR ql.Driver
    (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
    from org.apache.hadoop.hive.ql.exec.ExecDriver

    On Thu, Jan 21, 2010 at 3:37 PM, John Villa wrote:

    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL =
    http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job
    -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver
  • John Villa at Jan 22, 2010 at 12:38 am
    I will change the names soon and let you guys know. Home with the dogs
    bothering me hehe.
    Thanks,
    On Thu, Jan 21, 2010 at 7:34 PM, John Villa wrote:

    Thanks for the info. The only adding of jar files I did was this when
    creating a tables;

    add jar ../build/contrib/hive_contrib.jar;



    On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang wrote:

    Thanks Carl. I'll take a look at the patch for HIVE-1063.

    Ning

    On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:


    The naming convention for Hive jar files was changed in HIVE-978 from
    hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive
    jars *except* hive_contrib.jar which was not changed because the
    hive_contrib.jar filename is referenced in several test cases. HIVE-1063
    fixes this problem by providing the ability to reference system property
    variables in test case qfiles.

    Thanks.

    Carl
    On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang wrote:

    This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    The RegexSerDe is included in hive_contrib.jar. There may be an bug of
    the name here because all other jar files are following the same convention
    hive-*-0.6.0.jar. If you see all the other jar files in the lib directory
    following the convention, you probably need to rename hive_contrib.jar to
    hive-contrib-0.6.0.jar. Can you try that and let us know the result?

    Thanks,
    Ning

    On Jan 21, 2010, at 2:48 PM, John Villa wrote:

    Here is the output;

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)



    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)



    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)



    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object



    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)



    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)



    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)



    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)



    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)



    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)



    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)



    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)



    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)



    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)



    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)



    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)



    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)



    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)



    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)



    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)



    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)



    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)



    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)



    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)



    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)



    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)



    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)



    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)



    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)



    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)



    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)



    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)



    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)



    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)



    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)



    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)



    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)



    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)



    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)



    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more
    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)



    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)



    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)



    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)



    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)



    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)



    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)



    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)



    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)



    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)



    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)



    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)



    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)



    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)



    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)



    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)



    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)



    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)



    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)



    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)



    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)



    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)



    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)



    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)



    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)



    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)



    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)



    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)



    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)



    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)



    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)



    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)



    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)



    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)



    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)



    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)



    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)



    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)



    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe



    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)



    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)



    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)



    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more







    On Thu, Jan 21, 2010 at 5:33 PM, John Villa wrote:

    I am currently using hadoop 0.20.1. When I installed ant I did
    -Dhadoop.version="0.20.0"
    I will try and get you that output but my connection is rough right now
    and I need to do a little port forwarding. I will get it to you when i can.


    On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang wrote:

    Which hadoop version are you using (you can see it by running 'hadoop
    version')? Have you specified hadoop.version when you compile Hive? Are they
    match?

    Also can you post the log file found through the Tracking URL when you
    launch the job (in your example http://master:50030/jobdetails.jsp...)?
    The log files can be found by click through the mappers/reducers and at the
    rightmost column of the mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I
    compiled it using ant and the basic readme.
    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:

    It may be because you have 2 copies of Hive's jar files (e.g., one in
    Hadoop's lib directory and one in Hive's lib directory) and they are from
    different releases. If you have compiled Hive trunk yoruself please make
    sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient
    (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver
    (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
    errors
    2010-01-21 20:49:55,550 ERROR ql.Driver
    (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
    from org.apache.hadoop.hive.ql.exec.ExecDriver


    On Thu, Jan 21, 2010 at 3:37 PM, John Villa <john.joe.villa@gmail.com
    wrote:
    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL =
    http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job
    -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver
  • John Villa at Jan 22, 2010 at 12:43 am
    I cant even remember which version of hive I have installed but I believe
    it is release 4. How to I go about renaming these hive jar files?
    hive_foo-0.4.0.jar ?
    Thanks,
    On Thu, Jan 21, 2010 at 7:38 PM, John Villa wrote:

    I will change the names soon and let you guys know. Home with the dogs
    bothering me hehe.
    Thanks,

    On Thu, Jan 21, 2010 at 7:34 PM, John Villa wrote:

    Thanks for the info. The only adding of jar files I did was this when
    creating a tables;

    add jar ../build/contrib/hive_contrib.jar;



    On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang wrote:

    Thanks Carl. I'll take a look at the patch for HIVE-1063.

    Ning

    On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:


    The naming convention for Hive jar files was changed in HIVE-978 from
    hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive
    jars *except* hive_contrib.jar which was not changed because the
    hive_contrib.jar filename is referenced in several test cases. HIVE-1063
    fixes this problem by providing the ability to reference system property
    variables in test case qfiles.

    Thanks.

    Carl
    On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang wrote:

    This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    The RegexSerDe is included in hive_contrib.jar. There may be an bug of
    the name here because all other jar files are following the same convention
    hive-*-0.6.0.jar. If you see all the other jar files in the lib directory
    following the convention, you probably need to rename hive_contrib.jar to
    hive-contrib-0.6.0.jar. Can you try that and let us know the result?

    Thanks,
    Ning

    On Jan 21, 2010, at 2:48 PM, John Villa wrote:

    Here is the output;

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)




    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)




    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)




    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object




    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)




    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)




    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)




    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)




    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)




    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)




    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)




    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)




    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)




    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)




    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)




    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)




    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)




    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)




    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)




    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)




    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)




    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)




    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)




    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)




    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)




    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)




    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)




    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)




    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)




    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)




    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)




    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)




    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)




    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)




    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)




    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)




    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)




    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)




    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)




    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more
    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)




    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)




    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)




    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)




    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)




    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)




    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)




    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)




    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)




    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)




    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)




    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)




    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)




    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)




    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)




    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)




    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)




    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)




    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)




    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)




    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)




    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)




    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)




    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)




    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)




    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)




    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)




    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)




    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)




    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)




    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)




    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)




    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)




    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)




    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)




    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)




    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)




    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)




    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe




    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)




    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)




    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)




    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more







    On Thu, Jan 21, 2010 at 5:33 PM, John Villa wrote:

    I am currently using hadoop 0.20.1. When I installed ant I did
    -Dhadoop.version="0.20.0"
    I will try and get you that output but my connection is rough right now
    and I need to do a little port forwarding. I will get it to you when i can.


    On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang wrote:

    Which hadoop version are you using (you can see it by running 'hadoop
    version')? Have you specified hadoop.version when you compile Hive? Are they
    match?

    Also can you post the log file found through the Tracking URL when you
    launch the job (in your example http://master:50030/jobdetails.jsp...)?
    The log files can be found by click through the mappers/reducers and at the
    rightmost column of the mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I
    compiled it using ant and the basic readme.
    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:

    It may be because you have 2 copies of Hive's jar files (e.g., one
    in Hadoop's lib directory and one in Hive's lib directory) and they are from
    different releases. If you have compiled Hive trunk yoruself please make
    sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient
    (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver
    (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
    errors
    2010-01-21 20:49:55,550 ERROR ql.Driver
    (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
    from org.apache.hadoop.hive.ql.exec.ExecDriver


    On Thu, Jan 21, 2010 at 3:37 PM, John Villa <
    john.joe.villa@gmail.com> wrote:
    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL =
    http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job
    -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver
  • Ning Zhang at Jan 22, 2010 at 12:51 am
    John, you don't need to change the jar file names if it is release 0.4.0. As Carl just pointed out, you can just run add jar... in the same way you have done when you create the table. This will distribute the jar file distributed to the Hadoop cluster.


    On Jan 21, 2010, at 4:43 PM, John Villa wrote:

    I cant even remember which version of hive I have installed but I believe it is release 4. How to I go about renaming these hive jar files? hive_foo-0.4.0.jar ?
    Thanks,

    On Thu, Jan 21, 2010 at 7:38 PM, John Villa wrote:
    I will change the names soon and let you guys know. Home with the dogs bothering me hehe.
    Thanks,


    On Thu, Jan 21, 2010 at 7:34 PM, John Villa wrote:
    Thanks for the info. The only adding of jar files I did was this when creating a tables;

    add jar ../build/contrib/hive_contrib.jar;




    On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang wrote:
    Thanks Carl. I'll take a look at the patch for HIVE-1063.

    Ning

    On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:


    The naming convention for Hive jar files was changed in HIVE-978 from hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive jars *except* hive_contrib.jar which was not changed because the hive_contrib.jar filename is referenced in several test cases. HIVE-1063 fixes this problem by providing the ability to reference system property variables in test case qfiles.

    Thanks.

    Carl

    On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang wrote:
    This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    The RegexSerDe is included in hive_contrib.jar. There may be an bug of the name here because all other jar files are following the same convention hive-*-0.6.0.jar. If you see all the other jar files in the lib directory following the convention, you probably need to rename hive_contrib.jar to hive-contrib-0.6.0.jar. Can you try that and let us know the result?

    Thanks,
    Ning

    On Jan 21, 2010, at 2:48 PM, John Villa wrote:


    Here is the output;


    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)





    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)





    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)





    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)





    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more
    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more







    On Thu, Jan 21, 2010 at 5:33 PM, John Villa wrote:
    I am currently using hadoop 0.20.1. When I installed ant I did -Dhadoop.version="0.20.0"
    I will try and get you that output but my connection is rough right now and I need to do a little port forwarding. I will get it to you when i can.



    On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang wrote:
    Which hadoop version are you using (you can see it by running 'hadoop version')? Have you specified hadoop.version when you compile Hive? Are they match?

    Also can you post the log file found through the Tracking URL when you launch the job (in your example http://master:50030/jobdetails.jsp...)? The log files can be found by click through the mappers/reducers and at the rightmost column of the mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I compiled it using ant and the basic readme.

    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:
    It may be because you have 2 copies of Hive's jar files (e.g., one in Hadoop's lib directory and one in Hive's lib directory) and they are from different releases. If you have compiled Hive trunk yoruself please make sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with errors
    2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver


    On Thu, Jan 21, 2010 at 3:37 PM, John Villa wrote:
    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL = http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
  • John Villa at Jan 22, 2010 at 12:54 pm
    Thanks a lot I appreciate that! It works :) I will be doing testing today
    and thankyou. Is there a way to auto implement adding the jar file? Are
    there any other jar files I may need within the /lib directory? Again thanks
    for the help.
    Thanks,
    On Thu, Jan 21, 2010 at 7:50 PM, Ning Zhang wrote:

    John, you don't need to change the jar file names if it is release 0.4.0.
    As Carl just pointed out, you can just run add jar... in the same way you
    have done when you create the table. This will distribute the jar file
    distributed to the Hadoop cluster.


    On Jan 21, 2010, at 4:43 PM, John Villa wrote:

    I cant even remember which version of hive I have installed but I believe
    it is release 4. How to I go about renaming these hive jar files?
    hive_foo-0.4.0.jar ?
    Thanks,
    On Thu, Jan 21, 2010 at 7:38 PM, John Villa wrote:

    I will change the names soon and let you guys know. Home with the dogs
    bothering me hehe.
    Thanks,

    On Thu, Jan 21, 2010 at 7:34 PM, John Villa wrote:

    Thanks for the info. The only adding of jar files I did was this when
    creating a tables;

    add jar ../build/contrib/hive_contrib.jar;



    On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang wrote:

    Thanks Carl. I'll take a look at the patch for HIVE-1063.

    Ning

    On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:


    The naming convention for Hive jar files was changed in HIVE-978 from
    hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive
    jars *except* hive_contrib.jar which was not changed because the
    hive_contrib.jar filename is referenced in several test cases. HIVE-1063
    fixes this problem by providing the ability to reference system property
    variables in test case qfiles.

    Thanks.

    Carl
    On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang wrote:

    This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    The RegexSerDe is included in hive_contrib.jar. There may be an bug of
    the name here because all other jar files are following the same convention
    hive-*-0.6.0.jar. If you see all the other jar files in the lib directory
    following the convention, you probably need to rename hive_contrib.jar to
    hive-contrib-0.6.0.jar. Can you try that and let us know the result?

    Thanks,
    Ning

    On Jan 21, 2010, at 2:48 PM, John Villa wrote:

    Here is the output;

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)





    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)





    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)





    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)





    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more
    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more







    On Thu, Jan 21, 2010 at 5:33 PM, John Villa wrote:

    I am currently using hadoop 0.20.1. When I installed ant I did
    -Dhadoop.version="0.20.0"
    I will try and get you that output but my connection is rough right
    now and I need to do a little port forwarding. I will get it to you when i
    can.


    On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang wrote:

    Which hadoop version are you using (you can see it by running 'hadoop
    version')? Have you specified hadoop.version when you compile Hive? Are they
    match?

    Also can you post the log file found through the Tracking URL when
    you launch the job (in your example
    http://master:50030/jobdetails.jsp...)? The log files can be found
    by click through the mappers/reducers and at the rightmost column of the
    mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I
    compiled it using ant and the basic readme.
    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:

    It may be because you have 2 copies of Hive's jar files (e.g., one
    in Hadoop's lib directory and one in Hive's lib directory) and they are from
    different releases. If you have compiled Hive trunk yoruself please make
    sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient
    (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver
    (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
    errors
    2010-01-21 20:49:55,550 ERROR ql.Driver
    (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
    from org.apache.hadoop.hive.ql.exec.ExecDriver


    On Thu, Jan 21, 2010 at 3:37 PM, John Villa <
    john.joe.villa@gmail.com> wrote:
    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL =
    http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job
    -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver
  • Edward Capriolo at Jan 22, 2010 at 2:24 pm
    John,

    Just a side note a couple people have mentioned that the regex serde
    is much slower then the standard serde, you may want to consider pre
    processing the logs and inserting cntl+a or some other single byte
    delimeter.
    On 1/22/10, John Villa wrote:
    Thanks a lot I appreciate that! It works :) I will be doing testing today
    and thankyou. Is there a way to auto implement adding the jar file? Are
    there any other jar files I may need within the /lib directory? Again thanks
    for the help.
    Thanks,
    On Thu, Jan 21, 2010 at 7:50 PM, Ning Zhang wrote:

    John, you don't need to change the jar file names if it is release 0.4.0.
    As Carl just pointed out, you can just run add jar... in the same way you
    have done when you create the table. This will distribute the jar file
    distributed to the Hadoop cluster.


    On Jan 21, 2010, at 4:43 PM, John Villa wrote:

    I cant even remember which version of hive I have installed but I believe
    it is release 4. How to I go about renaming these hive jar files?
    hive_foo-0.4.0.jar ?
    Thanks,

    On Thu, Jan 21, 2010 at 7:38 PM, John Villa
    wrote:
    I will change the names soon and let you guys know. Home with the dogs
    bothering me hehe.
    Thanks,


    On Thu, Jan 21, 2010 at 7:34 PM, John Villa
    wrote:
    Thanks for the info. The only adding of jar files I did was this when
    creating a tables;

    add jar ../build/contrib/hive_contrib.jar;



    On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang wrote:

    Thanks Carl. I'll take a look at the patch for HIVE-1063.

    Ning

    On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:


    The naming convention for Hive jar files was changed in HIVE-978 from
    hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all
    Hive
    jars *except* hive_contrib.jar which was not changed because the
    hive_contrib.jar filename is referenced in several test cases.
    HIVE-1063
    fixes this problem by providing the ability to reference system
    property
    variables in test case qfiles.

    Thanks.

    Carl
    On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang wrote:

    This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    The RegexSerDe is included in hive_contrib.jar. There may be an bug of
    the name here because all other jar files are following the same
    convention
    hive-*-0.6.0.jar. If you see all the other jar files in the lib
    directory
    following the convention, you probably need to rename hive_contrib.jar
    to
    hive-contrib-0.6.0.jar. Can you try that and let us know the result?

    Thanks,
    Ning

    On Jan 21, 2010, at 2:48 PM, John Villa wrote:

    Here is the output;

    java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)





    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)





    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)





    at java.lang.reflect.Method.invoke(Method.java:597)
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object





    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)





    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization
    failed
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at
    org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at
    org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization
    failed
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at
    org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at
    org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization
    failed
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at
    org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at
    org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization
    failed
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at
    org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at
    org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more
    java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization
    failed
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at
    org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at
    org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization
    failed
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at
    org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at
    org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization
    failed
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at
    org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at
    org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)





    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)





    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)





    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)





    at
    org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at
    org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)





    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)





    at
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at
    org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)





    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization
    failed
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
    java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at
    org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException:
    org.apache.hadoop.hive.contrib.serde2.RegexSerDe





    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)





    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)





    at java.lang.Class.forName(Class.java:247)
    at
    org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at
    org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)





    at
    org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more








    On Thu, Jan 21, 2010 at 5:33 PM, John Villa
    wrote:
    I am currently using hadoop 0.20.1. When I installed ant I did
    -Dhadoop.version="0.20.0"
    I will try and get you that output but my connection is rough right
    now and I need to do a little port forwarding. I will get it to you
    when i
    can.



    On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang
    wrote:
    Which hadoop version are you using (you can see it by running
    'hadoop
    version')? Have you specified hadoop.version when you compile Hive?
    Are they
    match?

    Also can you post the log file found through the Tracking URL when
    you launch the job (in your example
    http://master:50030/jobdetails.jsp...)? The log files can be found
    by click through the mappers/reducers and at the rightmost column of
    the
    mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I
    compiled it using ant and the basic readme.

    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang
    wrote:
    It may be because you have 2 copies of Hive's jar files (e.g., one
    in Hadoop's lib directory and one in Hive's lib directory) and they
    are from
    different releases. If you have compiled Hive trunk yoruself please
    make
    sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core"
    requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core"
    requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core"
    requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core"
    requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core"
    requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core"
    requires
    "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient
    (JobClient.java:configureCommandLineOptions(539)) - Use
    GenericOptionsParser
    for parsing the arguments. Applications should implement Tool for
    the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver
    (SessionState.java:printError(279)) - Ended Job =
    job_201001211744_0008 with
    errors
    2010-01-21 20:49:55,550 ERROR ql.Driver
    (SessionState.java:printError(279)) - FAILED: Execution Error,
    return code 2
    from org.apache.hadoop.hive.ql.exec.ExecDriver


    On Thu, Jan 21, 2010 at 3:37 PM, John Villa <
    john.joe.villa@gmail.com> wrote:
    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce
    operator
    Starting Job = job_201001211744_0002, Tracking URL =
    http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job
    -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from
    org.apache.hadoop.hive.ql.exec.ExecDriver
  • Ning Zhang at Jan 22, 2010 at 7:15 pm
    HIVE-1063 is just for that to solve this problem. After that is committed, you don't need to manually add this jar files. There shouldn't be any other hive jar files that need to be manually added. If there are it should be fixed. The only jar files that need to be added by the users are those that the users developed for their UDFs etc.

    Thanks,
    Ning

    On Jan 22, 2010, at 4:53 AM, John Villa wrote:

    Thanks a lot I appreciate that! It works :) I will be doing testing today and thankyou. Is there a way to auto implement adding the jar file? Are there any other jar files I may need within the /lib directory? Again thanks for the help.
    Thanks,

    On Thu, Jan 21, 2010 at 7:50 PM, Ning Zhang wrote:
    John, you don't need to change the jar file names if it is release 0.4.0. As Carl just pointed out, you can just run add jar... in the same way you have done when you create the table. This will distribute the jar file distributed to the Hadoop cluster.


    On Jan 21, 2010, at 4:43 PM, John Villa wrote:

    I cant even remember which version of hive I have installed but I believe it is release 4. How to I go about renaming these hive jar files? hive_foo-0.4.0.jar ?
    Thanks,

    On Thu, Jan 21, 2010 at 7:38 PM, John Villa wrote:
    I will change the names soon and let you guys know. Home with the dogs bothering me hehe.
    Thanks,


    On Thu, Jan 21, 2010 at 7:34 PM, John Villa wrote:
    Thanks for the info. The only adding of jar files I did was this when creating a tables;

    add jar ../build/contrib/hive_contrib.jar;




    On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang wrote:
    Thanks Carl. I'll take a look at the patch for HIVE-1063.

    Ning

    On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:


    The naming convention for Hive jar files was changed in HIVE-978 from hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive jars *except* hive_contrib.jar which was not changed because the hive_contrib.jar filename is referenced in several test cases. HIVE-1063 fixes this problem by providing the ability to reference system property variables in test case qfiles.

    Thanks.

    Carl

    On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang wrote:
    This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

    The RegexSerDe is included in hive_contrib.jar. There may be an bug of the name here because all other jar files are following the same convention hive-*-0.6.0.jar. If you see all the other jar files in the lib directory following the convention, you probably need to rename hive_contrib.jar to hive-contrib-0.6.0.jar. Can you try that and let us know the result?

    Thanks,
    Ning

    On Jan 21, 2010, at 2:48 PM, John Villa wrote:


    Here is the output;


    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)






    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)






    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)






    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object






    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)






    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)






    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)






    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)






    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)






    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)






    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)






    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)






    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)






    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)






    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)






    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)






    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)






    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)






    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)






    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)






    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)






    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)






    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)






    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)






    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)






    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)






    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)






    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)






    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)






    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)






    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)






    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)






    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)






    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)






    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)






    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)






    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)






    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)






    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)






    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more
    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)






    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)






    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)






    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)






    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)






    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)






    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)






    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)






    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)






    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)






    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)






    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)






    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)






    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)






    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)






    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)






    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)






    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)






    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)






    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)






    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)






    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)






    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)






    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)






    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)






    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)






    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)






    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)






    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)






    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)






    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more

    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)






    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)






    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)






    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)






    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
    ... 5 more
    Caused by: java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)






    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)






    ... 10 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)






    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)






    ... 13 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
    ... 18 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
    at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
    ... 18 more
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe






    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:307)






    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
    at java.lang.Class.forName0(Native Method)






    at java.lang.Class.forName(Class.java:247)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
    at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)






    at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
    ... 19 more







    On Thu, Jan 21, 2010 at 5:33 PM, John Villa wrote:
    I am currently using hadoop 0.20.1. When I installed ant I did -Dhadoop.version="0.20.0"
    I will try and get you that output but my connection is rough right now and I need to do a little port forwarding. I will get it to you when i can.



    On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang wrote:
    Which hadoop version are you using (you can see it by running 'hadoop version')? Have you specified hadoop.version when you compile Hive? Are they match?

    Also can you post the log file found through the Tracking URL when you launch the job (in your example http://master:50030/jobdetails.jsp...)? The log files can be found by click through the mappers/reducers and at the rightmost column of the mapper/reducer stats.


    On Jan 21, 2010, at 1:37 PM, John Villa wrote:

    I did not see any hive jar files within hadoop lib directory. I compiled it using ant and the basic readme.

    On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang wrote:
    It may be because you have 2 copies of Hive's jar files (e.g., one in Hadoop's lib directory and one in Hive's lib directory) and they are from different releases. If you have compiled Hive trunk yoruself please make sure no Hive's jar files in the Hadoop's directory.


    On Jan 21, 2010, at 12:51 PM, John Villa wrote:

    Here is what I got from the hive log;
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
    2010-01-21 20:49:18,719 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
    2010-01-21 20:49:55,514 ERROR exec.ExecDriver (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with errors
    2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver


    On Thu, Jan 21, 2010 at 3:37 PM, John Villa wrote:
    Has anyone seen this error? Any help is appreciated, thanks;

    hive> select * from apachelog where host ="64.62.191.114";
    Total MapReduce jobs = 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201001211744_0002, Tracking URL = http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
    Kill Command = /u01/hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
    2010-01-21 07:24:38,198 map = 0%, reduce =0%
    2010-01-21 07:25:15,029 map = 100%, reduce =100%
    Ended Job = job_201001211744_0002 with errors
    FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categorieshive, hadoop
postedJan 21, '10 at 8:38p
activeJan 22, '10 at 7:15p
posts19
users4
websitehive.apache.org

People

Translate

site design / logo © 2021 Grokbase