Can't see Beeswax instance under Hue Service after successful upgrade to Cloudera Manager 5.0 and CDH5

Hi,

In CDH 5, you no longer need the beeswax daemon role. Hue talks to
HiveServer2 instead of the beeswax daemon.

Thanks,
Darren

To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Hi,

ok yea I didn't realize this immediately.

the problem is that when i try to access hive from hue, I am unable to
select one of the existing tables from the metastore db.

from the shell i can access hive but not from hue. The 'choose a database'
is grayed out.

any idea?

thanks



To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Strange. Can you verify that hue's configuration includes HS2's host and
port? Click on Hue Server -> Processes -> Show, then click on hue.ini.

Here's the relevant section from one that's working, where I replaced the
host name with <HS2_HOST>:
[beeswax]
hive_server_host=<HS2_HOST>
hive_server_port=10000
server_conn_timeout=120
hive_conf_dir={{HUE_CONF_DIR}}/hive-conf

If you have multiple Hive services, make sure the correct one is in use by
Hue.

Also make sure that when you were doing stuff on the hive shell that you
were actually interacting with the metastore and not with a local derby
database. You can verify this by looking at /etc/hive/conf/hive-site.xml
and making sure it has the uri for the metastore, and by running queries
like "show tables" and "show databases" on a different host.

If your /etc/hive/conf/hive-site.xml is not managed by CM, then make sure
you add a Hive and MR (or YARN) gateway to that host and deploy client
configuration from the dropdown next to your cluster name.

Thanks,
Darren

To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Would you have a screenshot?

What do you see on the Hue /logs page just after having opened /beeswax?

Romain

To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Hi,

Attached are two screenshots.

the hue.ini shows:

[beeswax]
hive_server_host=hadoopdev1.domain.intra
hive_server_port=10000
server_conn_timeout=120
hive_conf_dir={{HUE_CONF_DIR}}/hive-conf

I also noticed that when I try to click on any function in Hue, I often see displayed "Unmanageable server error occured:undefined" or "Check config failed"


When I go to hive via the terminal i get this:

[root@hadoopdev1 ~]# hive
14/05/07 08:38:20 WARN conf.HiveConf: DEPRECATED: Configuration property
hive.metastore.local no longer has any effect. Make sure to provide a valid
value for hive.metastore.uris if you are connecting to a remote metastore.

Logging initialized using configuration in
jar:file:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hive/lib/hive-common-0.12.0-cdh5.0.0.jar!/hive-log4j.properties

but then if i type 'show databases' i can see my databases.

Thx
To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

I am using hive0.12

anything related to this? https://issues.cloudera.org/browse/HUE-1561

Thx
To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

I am also seeing this logs:

[07/May/2014 10:26:25 -0500] middleware INFO Processing exception:
timed out (code THRIFTSOCKET): None: Traceback (most recent call last):
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/build/env/lib/python2.6/site-packages/Django-1.4.5-py2.6.egg/django/core/handlers/base.py",
line 111, in get_response
     response = callback(request, *callback_args, **callback_kwargs)
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/metastore/src/metastore/views.py",
line 108, in show_tables
     databases = db.get_databases()
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/beeswax/src/beeswax/server/dbms.py",
line 123, in get_databases
     return self.client.get_databases()
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/beeswax/src/beeswax/server/hive_server2_lib.py",
line 736, in get_databases
     return [table[col] for table in self._client.get_databases()]
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/beeswax/src/beeswax/server/hive_server2_lib.py",
line 442, in get_databases
     res = self.call(self._client.GetSchemas, req)
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/beeswax/src/beeswax/server/hive_server2_lib.py",
line 403, in call
     session = self.open_session(self.user)
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/beeswax/src/beeswax/server/hive_server2_lib.py",
line 377, in open_session
     res = self._client.OpenSession(req)
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/core/src/desktop/lib/thrift_util.py",
line 319, in wrapper
     raise StructuredException('THRIFTSOCKET', str(e), data=None,
error_code=502)
StructuredException: timed out (code THRIFTSOCKET): None
To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

The spinning wheel is typical of a HiveServer2 down. Did you check the HS2
logs?

You can also test HS2 with the beeline client:
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH5-Installation-Guide/cdh5ig_hiveserver2_start_stop.html

Romain

To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

the issue is fixed and it is our fault. A colleague in my team put the
following option in the advance configuration in hiveserver2 when testing
something in the previous version 4.6

  <property>
     <name>hive.server2.authentication</name>
     <value>NOSASL</value>
   </property>


sorry for wasting your time
To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Glad you sorted it out, and thanks for letting us know the fix.

To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

the logs show:

[07/May/2014 08:15:44 -0700] views ERROR Error in config
validation by hadoop: No module named nose.tools
Traceback (most recent call last):
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/core/src/desktop/views.py",
line 421, in _get_config_errors
     error_list.extend(validator(request.user))
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/hadoop/src/hadoop/conf.py",
line 145, in config_validator
     from hadoop.yarn import tests
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/hadoop/src/hadoop/yarn/tests.py",
line 20, in <module>
     from nose.tools import assert_true, assert_equal, assert_not_equal
ImportError: No module named nose.tools
[07/May/2014 08:20:50 -0700] views ERROR Error in config
validation by hadoop: No module named nose.tools
Traceback (most recent call last):
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/core/src/desktop/views.py",
line 421, in _get_config_errors
     error_list.extend(validator(request.user))
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/hadoop/src/hadoop/conf.py",
line 145, in config_validator
     from hadoop.yarn import tests
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/hadoop/src/hadoop/yarn/tests.py",
line 20, in <module>
     from nose.tools import assert_true, assert_equal, assert_not_equal
ImportError: No module named nose.tools
[07/May/2014 08:20:55 -0700] views ERROR Error in config
validation by hadoop: No module named nose.tools
Traceback (most recent call last):
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/core/src/desktop/views.py",
line 421, in _get_config_errors
     error_list.extend(validator(request.user))
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/hadoop/src/hadoop/conf.py",
line 145, in config_validator
     from hadoop.yarn import tests
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/hadoop/src/hadoop/yarn/tests.py",
line 20, in <module>
     from nose.tools import assert_true, assert_equal, assert_not_equal
ImportError: No module named nose.tools
[07/May/2014 10:25:06 -0500] views ERROR Error in config
validation by hadoop: No module named nose.tools
Traceback (most recent call last):
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/core/src/desktop/views.py",
line 421, in _get_config_errors
     error_list.extend(validator(request.user))
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/hadoop/src/hadoop/conf.py",
line 145, in config_validator
     from hadoop.yarn import tests
   File
"/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/hadoop/src/hadoop/yarn/tests.py",
line 20, in <module>
     from nose.tools import assert_true, assert_equal, assert_not_equal
ImportError: No module named nose.tools


Thx
To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.