Re: Beeswax Server broken after upgrade from CDH4.1.3 to CDH4.2

On 3/4/13 12:32 AM, Christian Schneider wrote:
They Hive-Config looks like this:
<?xml version="1.0" encoding="UTF-8"?>

<!--Autogenerated by Cloudera CM on 2013-03-04T08:26:04.373Z-->
<configuration>
<property>
<name>hive.metastore.local</name>
<value>false</value>
</property>
<property>
<name>hive.metastore.uris</name>
<value>thrift://carolin.ixcloud.net:9083
<http://carolin.ixcloud.net:9083></value>
</property>
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
</property>
<property>
<name>hive.warehouse.subdir.inherit.perms</name>
<value>true</value>
</property>
<property>
<name>mapred.reduce.tasks</name>
<value>-1</value>
</property>
<property>
<name>hive.exec.reducers.bytes.per.reducer</name>
<value>1073741824</value>
</property>
<property>
<name>hive.exec.reducers.max</name>
<value>999</value>
</property>
<property>
<name>hive.metastore.execute.setugi</name>
<value>true</value>
</property>
</configuration>



This is the hue.ini (i removed all the commented out lines (starting
with #)

[desktop]
secret_key=
http_host=0.0.0.0
http_port=8888
time_zone=America/Los_Angeles
django_debug_mode=0
http_500_debug_mode=0

[[[users]]]

[[[groups]]]

[[database]]

[[smtp]]

host=localhost
port=25
user=
password=

tls=no

[[kerberos]]

[hadoop]

[[hdfs_clusters]]

[[[default]]]
fs_defaultfs=hdfs://localhost:8020

[[mapred_clusters]]

[[[default]]]
jobtracker_host=localhost
jobtracker_port=8021

[[yarn_clusters]]

[[[default]]]
resourcemanager_host=localhost
resourcemanager_port=8032

[liboozie]

[oozie]

[beeswax]

[jobsub]

[jobbrowser]

[shell]

[[ shelltypes ]]

[[[ flume ]]]
nice_name = "Flume Shell"
command = "/usr/bin/flume shell"
help = "The command-line Flume client interface."

[[[[ environment ]]]]

[[[ pig ]]]
nice_name = "Pig Shell (Grunt)"
command = "/usr/bin/pig -l /dev/null"
help = "The command-line interpreter for Pig"

[[[[ environment ]]]]

[[[[[ JAVA_HOME ]]]]]

[[[ hbase ]]]
nice_name = "HBase Shell"
command = "/usr/bin/hbase shell"
help = "The command-line HBase client interface."

[[[[ environment ]]]]

[useradmin]



Are there other config files you may need?


Best Regards,
Christian.


2013/3/1 Romain Rigaux <[email protected]
It seems that CM still expects some values from derby for some reason:

2013-03-01 09:07:33,427 WARN
[[email protected]:[email protected]] Unexpected null/empty
config setting: DbConfig{id=439, service=null, role=null,
host=null, configContainer=null, roleConfigGroup=null,
attr=hive_metastore_derby_path, value=, revision=null}

2013-03-01 09:07:42,558 WARN [[email protected]:model.
[email protected]] Unexpected null/empty config setting:
DbConfig{id=439, service=null, role=null, host=null,
configContainer=null, roleConfigGroup=null,
attr=hive_metastore_derby_path, value=, revision=null}

What does the Hive/Beeswax configuration look like in CM?

Romain



On Fri, Mar 1, 2013 at 7:20 AM, Christian Schneider
wrote:

Hi Shawn,
Thanks for the fast response.

I don't have this "Show recent logs" link. I guess it is
because there is no beeswax process running.

Inline-Bild 2


Now it's hard to get all the env. variables :(.

If i start the server like this:
/usr/share/hue/build/env/bin/hue beeswax_server
It fails because no variables are set.

Is there another way to get the variables CM would use?

Best Regards,
Chrsitian.


2013/3/1 Shawn Higgins <[email protected]

Hello Christian,

The next step I would take to troubleshoot would be to
attempt to start the beeswax server process manually. I
don't know if you'll be able to view this given your
symptoms, but go to Cloudera Manager interface --> Hue
service --> Beeswax server --> Instances --> Select the
beeswax server from the name column --> near the 'show
recent logs' click on " Full stdout
log"<http://bar-nn-01.int.westgroup.com:7180/cmf/process/1254/logs?filename=stdout.log>


Once you see the text command to start the hue and beeswax
process, take the first section that sets all of the
environment variables up until (and including) the line "

Executing /usr/share/hue/build/env/bin/hue beeswax_server". Run all of those commands manually. The output of the beeswax start command that you just ran should give you more feedback on what's going wrong.





Your start command should look something like this:

HUE_HOME=/usr/share/hue
HUE_CONF_DIR=/var/run/cloudera-scm-agent/process/1254-hue-BEESWAX_SERVER
HADOOP_HOME=/usr/lib/hadoop
HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/1254-hue-BEESWAX_SERVER/hadoop-conf




HIVE_HOME=/usr/lib/hive
HIVE_DEFAULT_XML=/usr/lib/hive/conf/hive-default.xml
HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/1254-hue-BEESWAX_SERVER/hive-conf
HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/1254-hue-BEESWAX_SERVER/hbase-conf




/usr/share/hue/build/env/bin/hue beeswax_server


-Shawn


On Friday, March 1, 2013 8:08:30 AM UTC-6, Christian
Schneider wrote:

Hi,
after our upgrade to CDH4.2 the Beeswax Server does
not start anymore.

The HUE Webinterface says:

Could not connect to michaela:8002

If i try to restart the server by CM4.5 it says:

Command failed to start: null


It's pretty hard to guess what happens. I couldn't
find a logfile with an exception of smth. like this...

Maybe it's related to the change from Derby to Mysql
on Hive/Hue?

Could you give me tips where to check what is happening?


Configuration:
CDH4.2
CM4.5
Debian 6
7 Node Cluster

Btw. Hive is running fine over cli.

Best Regards,
Christian.

--




--




--




--