FAQ
I am getting the following error while running Hive Queries using
HiveServer2 with Hive Metastore configured with oracle database.

2013-03-14 11:20:05.100 GMT Thread[pool-1-thread-5,5,main]
java.io.FileNotFoundException: derby.log (Permission denied)
2013-03-14 11:20:05.828 GMT Thread[pool-1-thread-5,5,main] Cleanup action
starting
ERROR XBM0H: Directory /var/lib/hive/TempStatsStore cannot be created.
at org.apache.derby.iapi.error.StandardException.newException(Unknown
Source)
at
org.apache.derby.impl.services.monitor.StorageFactoryService$9.run(Unknown
Source)
at java.security.AccessController.doPrivileged(Native Method)
at
org.apache.derby.impl.services.monitor.StorageFactoryService.createServiceRoot(Unknown
Source)
at org.apache.derby.impl.services.monitor.BaseMonitor.bootService(Unknown
Source)
at
org.apache.derby.impl.services.monitor.BaseMonitor.createPersistentService(Unknown
Source)
at
org.apache.derby.iapi.services.monitor.Monitor.createPersistentService(Unknown
Source)
at org.apache.derby.impl.jdbc.EmbedConnection.createDatabase(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection30.<init>(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source)
at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source)
at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source)
at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source)
at java.sql.DriverManager.getConnection(DriverManager.java:582)
at java.sql.DriverManager.getConnection(DriverManager.java:207)
at
org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher.init(JDBCStatsPublisher.java:265)
at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:435)
at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:138)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1352)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1138)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:951)
at
org.apache.hive.service.cli.operation.SQLOperation.run(SQLOperation.java:95)
at
org.apache.hive.service.cli.session.HiveSessionImpl.executeStatement(HiveSessionImpl.java:168)
at
org.apache.hive.service.cli.CLIService.executeStatement(CLIService.java:153)
at
org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:190)
at
org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1133)
at
org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1118)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.hive.service.cli.thrift.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:38)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)


Any pointers why I would be getting this error? Also please suggest a way
out.

--

Search Discussions

  • James Hogarth at Mar 20, 2013 at 2:36 pm

    Any pointers why I would be getting this error? Also please suggest a way
    out.
    The job is running as the 'hive' user (look into the ugi and new
    impersonate options to make it run as the connecting user for future
    benefits) and the home directory for the hive user is /var/lib/hive ...

    TempStatsStore is (only? I think?) used by INSERT OVERWRITE queries and as
    the name suggests is a temporary statistics store used in the intermediate
    steps...

    It is however completely uneeded (at least at this time)...

    The default hive option for hive.stats.autogather is true but if you set it
    to false in your job it will then disable trying to make this directory and
    make a cleaner looking log ;)


    --

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcdh-user @
categorieshadoop
postedMar 14, '13 at 4:08p
activeMar 20, '13 at 2:36p
posts2
users2
websitecloudera.com
irc#hadoop

2 users in discussion

James Hogarth: 1 post Jatin Bindra: 1 post

People

Translate

site design / logo © 2018 Grokbase