FAQ

Hive Server2 and Beeline MapReduce

Ben
Jan 22, 2013 at 7:36 pm
I am getting an error when trying to submit a query that launches a
mapreduce job using the Hive Beeline interface. I am connected to a Hive
Server2 service. The query is simple.

SELECT COUNT(*) FROM sample_07;

Error: Error while processing statement: FAILED: Execution Error, return
code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask (state=08S01,code=1)
Error: Error while processing statement: FAILED: Execution Error, return
code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask (state=08S01,code=1)

We used Cloudera Manager Free Edition 4.1.2 to install CDH4.1.2. We are
using MRv1 and not YARN.

All other basic queries work like the ones below.

SHOW TABLES;
SELECT * FROM sample_07 LIMIT 10;

After working with my coworker, we got it to work on his local VM by
messing with permissions. We don't know exactly what we did, but I would
like an official response that tells us exactly what permissions to set.

Thanks,
Ben

--
reply

Search Discussions

9 responses

  • Ben at Jan 23, 2013 at 3:54 pm
    To add...

    I modified the /etc/init.d/hive-server2 script to set the variables
    HIVE_USER and USER to be "hdfs" instead of "hive"; then, I changed the
    group owner to "hdfs" from "hive" along with group permissions for the
    folders: /var/run/hive and /var/log/hive, so that the hdfs user can write
    to them.

    After starting the hive-server2 service, this was no longer a problem.

    The question is: what permissions does the "hive" user need to be able to
    launch mapreduce jobs? This would be good to know instead of giving
    wholesale access.

    Cheers,
    Ben
    On Tuesday, January 22, 2013 11:36:55 AM UTC-8, ben wrote:

    I am getting an error when trying to submit a query that launches a
    mapreduce job using the Hive Beeline interface. I am connected to a Hive
    Server2 service. The query is simple.

    SELECT COUNT(*) FROM sample_07;

    Error: Error while processing statement: FAILED: Execution Error, return
    code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask (state=08S01,code=1)
    Error: Error while processing statement: FAILED: Execution Error, return
    code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask (state=08S01,code=1)

    We used Cloudera Manager Free Edition 4.1.2 to install CDH4.1.2. We are
    using MRv1 and not YARN.

    All other basic queries work like the ones below.

    SHOW TABLES;
    SELECT * FROM sample_07 LIMIT 10;

    After working with my coworker, we got it to work on his local VM by
    messing with permissions. We don't know exactly what we did, but I would
    like an official response that tells us exactly what permissions to set.

    Thanks,
    Ben
    --
  • Harsh J at Jan 23, 2013 at 4:46 pm
    Hi Ben,

    Since HS2 runs the job from its own service, can you check the
    hive-server2.log file to see why the actions/jobs failed to run?

    Permission-wise, on HDFS, it would require writable access to its
    configured warehouse directory, any external table locations, and the
    configured scratch directory locations.

    On Wed, Jan 23, 2013 at 9:24 PM, ben wrote:

    To add...

    I modified the /etc/init.d/hive-server2 script to set the variables
    HIVE_USER and USER to be "hdfs" instead of "hive"; then, I changed the
    group owner to "hdfs" from "hive" along with group permissions for the
    folders: /var/run/hive and /var/log/hive, so that the hdfs user can write
    to them.

    After starting the hive-server2 service, this was no longer a problem.

    The question is: what permissions does the "hive" user need to be able to
    launch mapreduce jobs? This would be good to know instead of giving
    wholesale access.

    Cheers,
    Ben

    On Tuesday, January 22, 2013 11:36:55 AM UTC-8, ben wrote:

    I am getting an error when trying to submit a query that launches a
    mapreduce job using the Hive Beeline interface. I am connected to a Hive
    Server2 service. The query is simple.

    SELECT COUNT(*) FROM sample_07;

    Error: Error while processing statement: FAILED: Execution Error, return
    code 1 from org.apache.hadoop.hive.ql.**exec.MapRedTask
    (state=08S01,code=1)
    Error: Error while processing statement: FAILED: Execution Error, return
    code 1 from org.apache.hadoop.hive.ql.**exec.MapRedTask
    (state=08S01,code=1)

    We used Cloudera Manager Free Edition 4.1.2 to install CDH4.1.2. We are
    using MRv1 and not YARN.

    All other basic queries work like the ones below.

    SHOW TABLES;
    SELECT * FROM sample_07 LIMIT 10;

    After working with my coworker, we got it to work on his local VM by
    messing with permissions. We don't know exactly what we did, but I would
    like an official response that tells us exactly what permissions to set.

    Thanks,
    Ben
    --




    --
    Harsh J

    --
  • Ben at Jan 23, 2013 at 4:47 pm
    To close...

    All it took was changing the /user folder in HDFS to be writable by all.

    hdfs dfs -chmod 1777 /user

    That was it! It needed to create the /user/hive/.staging directory. I can
    see why this was a problem for me because I'm using the /user/beeswax
    directory as the Hive metastore.

    Cheers,
    Ben
    On Wednesday, January 23, 2013 7:54:52 AM UTC-8, ben wrote:

    To add...

    I modified the /etc/init.d/hive-server2 script to set the variables
    HIVE_USER and USER to be "hdfs" instead of "hive"; then, I changed the
    group owner to "hdfs" from "hive" along with group permissions for the
    folders: /var/run/hive and /var/log/hive, so that the hdfs user can write
    to them.

    After starting the hive-server2 service, this was no longer a problem.

    The question is: what permissions does the "hive" user need to be able to
    launch mapreduce jobs? This would be good to know instead of giving
    wholesale access.

    Cheers,
    Ben
    On Tuesday, January 22, 2013 11:36:55 AM UTC-8, ben wrote:

    I am getting an error when trying to submit a query that launches a
    mapreduce job using the Hive Beeline interface. I am connected to a Hive
    Server2 service. The query is simple.

    SELECT COUNT(*) FROM sample_07;

    Error: Error while processing statement: FAILED: Execution Error, return
    code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask (state=08S01,code=1)
    Error: Error while processing statement: FAILED: Execution Error, return
    code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask (state=08S01,code=1)

    We used Cloudera Manager Free Edition 4.1.2 to install CDH4.1.2. We are
    using MRv1 and not YARN.

    All other basic queries work like the ones below.

    SHOW TABLES;
    SELECT * FROM sample_07 LIMIT 10;

    After working with my coworker, we got it to work on his local VM by
    messing with permissions. We don't know exactly what we did, but I would
    like an official response that tells us exactly what permissions to set.

    Thanks,
    Ben
    --
  • Marty Lurie at Jun 12, 2013 at 3:59 pm
    I prefer not to 777 directories.

    Below is a worked example of how creating a home directory /user/foo for
    the "foo" user solves the problem:


    marty@hakshev:~$ beeline
    Beeline version 0.10.0-cdh4.2.0 by Apache Hive

    # log in and create sample table

    beeline> !connect jdbc:hive2://localhost:10000 foo bar
    scan complete in 2ms
    Connecting to jdbc:hive2://localhost:10000
    Connected to: Hive (version 0.10.0)
    Driver: Hive (version 0.10.0-cdh4.2.0)
    Transaction isolation: TRANSACTION_REPEATABLE_READ
    0: jdbc:hive2://localhost:10000> create table homedir ( mykey int );
    No rows affected (1.222 seconds)
    0: jdbc:hive2://localhost:10000> Closing:
    org.apache.hive.jdbc.HiveConnection

    # throw some data into the table

    marty@hakshev:~$ hadoop fs -ls /user/hive/warehouse/homedir
    marty@hakshev:~$ cat sampledata
    5
    4
    3
    marty@hakshev:~$ hadoop fs -put sampledata /user/hive/warehouse/homedir

    # try and query the table - it fails with
    # error state=08S01,code=1

    marty@hakshev:~$ beeline
    Beeline version 0.10.0-cdh4.2.0 by Apache Hive
    beeline> !connect jdbc:hive2://localhost:10000 foo bar
    scan complete in 2ms
    Connecting to jdbc:hive2://localhost:10000
    Connected to: Hive (version 0.10.0)
    Driver: Hive (version 0.10.0-cdh4.2.0)
    Transaction isolation: TRANSACTION_REPEATABLE_READ
    0: jdbc:hive2://localhost:10000> select count(*) from homedir;
    Error: Error while processing statement: FAILED: Execution Error, return
    code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask (state=08S01,code=1)
    Error: Error while processing statement: FAILED: Execution Error, return
    code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask (state=08S01,code=1)
    0: jdbc:hive2://localhost:10000> Closing:
    org.apache.hive.jdbc.HiveConnection

    # provision /user/foo in HDFS

    marty@hakshev:~$ sudo su - hdfs
    hdfs@hakshev:~$ hadoop fs -mkdir /user/foo
    hdfs@hakshev:~$ hadoop fs -chown foo:foo /user/foo
    hdfs@hakshev:~$ logout

    # try again - all is OK :-)

    marty@hakshev:~$ beeline
    Beeline version 0.10.0-cdh4.2.0 by Apache Hive
    beeline> !connect jdbc:hive2://localhost:10000 foo bar
    scan complete in 1ms
    Connecting to jdbc:hive2://localhost:10000
    Connected to: Hive (version 0.10.0)
    Driver: Hive (version 0.10.0-cdh4.2.0)
    Transaction isolation: TRANSACTION_REPEATABLE_READ
    0: jdbc:hive2://localhost:10000> select count(*) from homedir;
    +------+
    _c0 | +------+
    3 |
    +------+
    1 row selected (12.199 seconds)

    --
    --
    Marty
    --
    Marty Lurie

    --
  • Benjamin Kim at Jun 12, 2013 at 4:09 pm
    Hi Marty,

    It turned out that I did not have to change the permissions at all. With
    the latest version of CDH4, I just add the user in Hue, and it creates it
    for them.

    Thanks,
    Ben
    On Wednesday, June 12, 2013 8:58:39 AM UTC-7, Marty Lurie wrote:

    I prefer not to 777 directories.

    Below is a worked example of how creating a home directory /user/foo for
    the "foo" user solves the problem:


    marty@hakshev:~$ beeline
    Beeline version 0.10.0-cdh4.2.0 by Apache Hive

    # log in and create sample table

    beeline> !connect jdbc:hive2://localhost:10000 foo bar
    scan complete in 2ms
    Connecting to jdbc:hive2://localhost:10000
    Connected to: Hive (version 0.10.0)
    Driver: Hive (version 0.10.0-cdh4.2.0)
    Transaction isolation: TRANSACTION_REPEATABLE_READ
    0: jdbc:hive2://localhost:10000> create table homedir ( mykey int );
    No rows affected (1.222 seconds)
    0: jdbc:hive2://localhost:10000> Closing:
    org.apache.hive.jdbc.HiveConnection

    # throw some data into the table

    marty@hakshev:~$ hadoop fs -ls /user/hive/warehouse/homedir
    marty@hakshev:~$ cat sampledata
    5
    4
    3
    marty@hakshev:~$ hadoop fs -put sampledata /user/hive/warehouse/homedir

    # try and query the table - it fails with
    # error state=08S01,code=1

    marty@hakshev:~$ beeline
    Beeline version 0.10.0-cdh4.2.0 by Apache Hive
    beeline> !connect jdbc:hive2://localhost:10000 foo bar
    scan complete in 2ms
    Connecting to jdbc:hive2://localhost:10000
    Connected to: Hive (version 0.10.0)
    Driver: Hive (version 0.10.0-cdh4.2.0)
    Transaction isolation: TRANSACTION_REPEATABLE_READ
    0: jdbc:hive2://localhost:10000> select count(*) from homedir;
    Error: Error while processing statement: FAILED: Execution Error, return
    code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask (state=08S01,code=1)
    Error: Error while processing statement: FAILED: Execution Error, return
    code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask (state=08S01,code=1)
    0: jdbc:hive2://localhost:10000> Closing:
    org.apache.hive.jdbc.HiveConnection

    # provision /user/foo in HDFS

    marty@hakshev:~$ sudo su - hdfs
    hdfs@hakshev:~$ hadoop fs -mkdir /user/foo
    hdfs@hakshev:~$ hadoop fs -chown foo:foo /user/foo
    hdfs@hakshev:~$ logout

    # try again - all is OK :-)

    marty@hakshev:~$ beeline
    Beeline version 0.10.0-cdh4.2.0 by Apache Hive
    beeline> !connect jdbc:hive2://localhost:10000 foo bar
    scan complete in 1ms
    Connecting to jdbc:hive2://localhost:10000
    Connected to: Hive (version 0.10.0)
    Driver: Hive (version 0.10.0-cdh4.2.0)
    Transaction isolation: TRANSACTION_REPEATABLE_READ
    0: jdbc:hive2://localhost:10000> select count(*) from homedir;
    +------+
    _c0 | +------+
    3 |
    +------+
    1 row selected (12.199 seconds)

    --
    --
    Marty
    --
    Marty Lurie
    --
  • Marty Lurie at Jun 12, 2013 at 4:43 pm
    Ben,
    Hue is provisioning the HDFS home directory in the latest release :-)

    Glad you escaped the 777 thing.

    --
    Marty
    --
    Marty Lurie mar...@...com cell: (617) 797 3138
    On 06/12/2013 12:08 PM, Benjamin Kim wrote:
    Hi Marty,

    It turned out that I did not have to change the permissions at all. With
    the latest version of CDH4, I just add the user in Hue, and it creates
    it for them.

    Thanks,
    Ben

    On Wednesday, June 12, 2013 8:58:39 AM UTC-7, Marty Lurie wrote:

    I prefer not to 777 directories.

    Below is a worked example of how creating a home directory /user/foo
    for
    the "foo" user solves the problem:


    marty@hakshev:~$ beeline
    Beeline version 0.10.0-cdh4.2.0 by Apache Hive

    # log in and create sample table

    beeline> !connect jdbc:hive2://localhost:10000 foo bar
    scan complete in 2ms
    Connecting to jdbc:hive2://localhost:10000
    Connected to: Hive (version 0.10.0)
    Driver: Hive (version 0.10.0-cdh4.2.0)
    Transaction isolation: TRANSACTION_REPEATABLE_READ
    0: jdbc:hive2://localhost:10000> create table homedir ( mykey int );
    No rows affected (1.222 seconds)
    0: jdbc:hive2://localhost:10000> Closing:
    org.apache.hive.jdbc.HiveConnection

    # throw some data into the table

    marty@hakshev:~$ hadoop fs -ls /user/hive/warehouse/homedir
    marty@hakshev:~$ cat sampledata
    5
    4
    3
    marty@hakshev:~$ hadoop fs -put sampledata /user/hive/warehouse/homedir

    # try and query the table - it fails with
    # error state=08S01,code=1

    marty@hakshev:~$ beeline
    Beeline version 0.10.0-cdh4.2.0 by Apache Hive
    beeline> !connect jdbc:hive2://localhost:10000 foo bar
    scan complete in 2ms
    Connecting to jdbc:hive2://localhost:10000
    Connected to: Hive (version 0.10.0)
    Driver: Hive (version 0.10.0-cdh4.2.0)
    Transaction isolation: TRANSACTION_REPEATABLE_READ
    0: jdbc:hive2://localhost:10000> select count(*) from homedir;
    Error: Error while processing statement: FAILED: Execution Error,
    return
    code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
    (state=08S01,code=1)
    Error: Error while processing statement: FAILED: Execution Error,
    return
    code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
    (state=08S01,code=1)
    0: jdbc:hive2://localhost:10000> Closing:
    org.apache.hive.jdbc.HiveConnection

    # provision /user/foo in HDFS

    marty@hakshev:~$ sudo su - hdfs
    hdfs@hakshev:~$ hadoop fs -mkdir /user/foo
    hdfs@hakshev:~$ hadoop fs -chown foo:foo /user/foo
    hdfs@hakshev:~$ logout

    # try again - all is OK :-)

    marty@hakshev:~$ beeline
    Beeline version 0.10.0-cdh4.2.0 by Apache Hive
    beeline> !connect jdbc:hive2://localhost:10000 foo bar
    scan complete in 1ms
    Connecting to jdbc:hive2://localhost:10000
    Connected to: Hive (version 0.10.0)
    Driver: Hive (version 0.10.0-cdh4.2.0)
    Transaction isolation: TRANSACTION_REPEATABLE_READ
    0: jdbc:hive2://localhost:10000> select count(*) from homedir;
    +------+
    _c0 | +------+
    3 |
    +------+
    1 row selected (12.199 seconds)

    --
    --
    Marty
    --
    Marty Lurie
    --
  • Alex Tanti at Oct 6, 2013 at 8:49 am
    Hi,

    I am getting exactly this same issue. I tried switching user to 'hdfs', and
    adding more permissions on folders '/tmp', '/user/hive' on hdfs and
    '/var/log/hive' and '/var/run/hive' locally but still no luck. You
    mentioned that there is a simple procedure of just adding a hue user. Can
    you please post the exact procedure, cause I am trying that solution but
    still its not working.
    I am not sure whether it is a permission issue or any other issue. The
    stack trace is included below this message.

    Any help would be much appreciated.

    Thanks,

    Alex

    *

    *
    *Stack Trace*


    java.lang.RuntimeException: Error in configuring object
      at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
      at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
      at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
      at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:413)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
      at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
      at org.apache.hadoop.mapred.Child.main(Child.java:262)
    Caused by: java.lang.reflect.InvocationTargetException
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.ja


    ....
    ....
    ....

    PriviledgedActionException as:hive (auth:SIMPLE) cause:org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask









    On Wednesday, 12 June 2013 18:43:26 UTC+2, Marty Lurie wrote:

    Ben,
    Hue is provisioning the HDFS home directory in the latest release :-)

    Glad you escaped the 777 thing.

    --
    Marty
    --
    Marty Lurie ma...@cloudera.com <javascript:> cell: (617) 797 3138
    On 06/12/2013 12:08 PM, Benjamin Kim wrote:
    Hi Marty,

    It turned out that I did not have to change the permissions at all. With
    the latest version of CDH4, I just add the user in Hue, and it creates
    it for them.

    Thanks,
    Ben

    On Wednesday, June 12, 2013 8:58:39 AM UTC-7, Marty Lurie wrote:

    I prefer not to 777 directories.

    Below is a worked example of how creating a home directory /user/foo
    for
    the "foo" user solves the problem:


    marty@hakshev:~$ beeline
    Beeline version 0.10.0-cdh4.2.0 by Apache Hive

    # log in and create sample table

    beeline> !connect jdbc:hive2://localhost:10000 foo bar
    scan complete in 2ms
    Connecting to jdbc:hive2://localhost:10000
    Connected to: Hive (version 0.10.0)
    Driver: Hive (version 0.10.0-cdh4.2.0)
    Transaction isolation: TRANSACTION_REPEATABLE_READ
    0: jdbc:hive2://localhost:10000> create table homedir ( mykey int );
    No rows affected (1.222 seconds)
    0: jdbc:hive2://localhost:10000> Closing:
    org.apache.hive.jdbc.HiveConnection

    # throw some data into the table

    marty@hakshev:~$ hadoop fs -ls /user/hive/warehouse/homedir
    marty@hakshev:~$ cat sampledata
    5
    4
    3
    marty@hakshev:~$ hadoop fs -put sampledata
    /user/hive/warehouse/homedir
    # try and query the table - it fails with
    # error state=08S01,code=1

    marty@hakshev:~$ beeline
    Beeline version 0.10.0-cdh4.2.0 by Apache Hive
    beeline> !connect jdbc:hive2://localhost:10000 foo bar
    scan complete in 2ms
    Connecting to jdbc:hive2://localhost:10000
    Connected to: Hive (version 0.10.0)
    Driver: Hive (version 0.10.0-cdh4.2.0)
    Transaction isolation: TRANSACTION_REPEATABLE_READ
    0: jdbc:hive2://localhost:10000> select count(*) from homedir;
    Error: Error while processing statement: FAILED: Execution Error,
    return
    code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
    (state=08S01,code=1)
    Error: Error while processing statement: FAILED: Execution Error,
    return
    code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
    (state=08S01,code=1)
    0: jdbc:hive2://localhost:10000> Closing:
    org.apache.hive.jdbc.HiveConnection

    # provision /user/foo in HDFS

    marty@hakshev:~$ sudo su - hdfs
    hdfs@hakshev:~$ hadoop fs -mkdir /user/foo
    hdfs@hakshev:~$ hadoop fs -chown foo:foo /user/foo
    hdfs@hakshev:~$ logout

    # try again - all is OK :-)

    marty@hakshev:~$ beeline
    Beeline version 0.10.0-cdh4.2.0 by Apache Hive
    beeline> !connect jdbc:hive2://localhost:10000 foo bar
    scan complete in 1ms
    Connecting to jdbc:hive2://localhost:10000
    Connected to: Hive (version 0.10.0)
    Driver: Hive (version 0.10.0-cdh4.2.0)
    Transaction isolation: TRANSACTION_REPEATABLE_READ
    0: jdbc:hive2://localhost:10000> select count(*) from homedir;
    +------+
    _c0 | +------+
    3 |
    +------+
    1 row selected (12.199 seconds)

    --
    --
    Marty
    --
    Marty Lurie
    --

    ---
    You received this message because you are subscribed to the Google Groups "CDH Users" group.
    To unsubscribe from this group and stop receiving emails from it, send an email to cdh-user+unsubscribe@cloudera.org.
    For more options, visit https://groups.google.com/a/cloudera.org/groups/opt_out.
  • Alex Tanti at Oct 6, 2013 at 9:03 am
    Also,

    I forgot to mention a few more things

        - Running queries on the native Hive CLI work perfectly well.
        - I am using the csv-serde plugin in my hive tables and when I try to
        run a query on the Beeswax UI, it returns a clear Exception - OK FAILED:
        RuntimeException
        MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe
        com.bizo.hive.serde.csv.CSVSerde does not exist)
        - Tables created without the CSV serde does not return error - so I am
        suspecting that this might be a config issue in hiveserver2, something
        similar to *hive.aux.jars.path*



    On Sunday, 6 October 2013 10:49:46 UTC+2, Alex Tanti wrote:

    Hi,

    I am getting exactly this same issue. I tried switching user to 'hdfs',
    and adding more permissions on folders '/tmp', '/user/hive' on hdfs and
    '/var/log/hive' and '/var/run/hive' locally but still no luck. You
    mentioned that there is a simple procedure of just adding a hue user. Can
    you please post the exact procedure, cause I am trying that solution but
    still its not working.
    I am not sure whether it is a permission issue or any other issue. The
    stack trace is included below this message.

    Any help would be much appreciated.

    Thanks,

    Alex

    *

    *
    *Stack Trace*


    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:413)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
    at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
    at org.apache.hadoop.mapred.Child.main(Child.java:262)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.ja


    ....
    ....
    ....

    PriviledgedActionException as:hive (auth:SIMPLE) cause:org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
    --

    ---
    You received this message because you are subscribed to the Google Groups "CDH Users" group.
    To unsubscribe from this group and stop receiving emails from it, send an email to cdh-user+unsubscribe@cloudera.org.
    For more options, visit https://groups.google.com/a/cloudera.org/groups/opt_out.
  • Madhukar Bhilare at Mar 24, 2014 at 11:06 am
    Hi Alex today I faced same issue but I was able to solve this issue by
    modifying file permission and modifying hive-site.xml on location
      /etc/hive/conf.server this is different configuration file other than
    default configuration file( Location = /etc/hive/conf.dist) and add property
    <property>
           <name>hive.aux.jars.path</name>
           <value>/usr/lib/hive/lib/csv-serde-1.1.2-0.11.0-all.jar</value>
           <description>for csv files</description>
         </property>
    before that check same property is available in your default configuration
    file
    On Sunday, 6 October 2013 14:33:40 UTC+5:30, Alex Tanti wrote:



    Also,

    I forgot to mention a few more things

    - Running queries on the native Hive CLI work perfectly well.
    - I am using the csv-serde plugin in my hive tables and when I try to
    run a query on the Beeswax UI, it returns a clear Exception - OK
    FAILED: RuntimeException
    MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe
    com.bizo.hive.serde.csv.CSVSerde does not exist)
    - Tables created without the CSV serde does not return error - so I am
    suspecting that this might be a config issue in hiveserver2, something
    similar to *hive.aux.jars.path*



    On Sunday, 6 October 2013 10:49:46 UTC+2, Alex Tanti wrote:

    Hi,

    I am getting exactly this same issue. I tried switching user to 'hdfs',
    and adding more permissions on folders '/tmp', '/user/hive' on hdfs and
    '/var/log/hive' and '/var/run/hive' locally but still no luck. You
    mentioned that there is a simple procedure of just adding a hue user. Can
    you please post the exact procedure, cause I am trying that solution but
    still its not working.
    I am not sure whether it is a permission issue or any other issue. The
    stack trace is included below this message.

    Any help would be much appreciated.

    Thanks,

    Alex



    *Stack Trace*


    java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:413)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
    at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
    at org.apache.hadoop.mapred.Child.main(Child.java:262)
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.ja


    ....
    ....
    ....

    PriviledgedActionException as:hive (auth:SIMPLE) cause:org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
    --

    ---
    You received this message because you are subscribed to the Google Groups "CDH Users" group.
    To unsubscribe from this group and stop receiving emails from it, send an email to cdh-user+unsubscribe@cloudera.org.
    For more options, visit https://groups.google.com/a/cloudera.org/d/optout.

Related Discussions

Discussion Navigation
viewthread | post