FAQ
Hi, i already ask this question on CDH-Users list, but now I think it is
related to CM. The problem is, that after an upgrade to CDH4.2
Beeswax is not able to start. During the update we changed the metastore
from Derby to Mysql.

If we start Beeswax over CM, it *immediately* fails with:

Command failed to start: null


The CM config validation ends without any violation.

On the log i found this NullPointerException:

2013-03-07 09:33:08,780 INFO
[2044353087@scm-web-60:service.ServiceHandlerRegistry@656] Executing role
command Start BasicCmdArgs{args=[], alertConfig=null}. Service:
DbService{id=41, name=hue1, serviceT
ype=HUE, optimisticLockVersion=1, cluster=DbCluster{id=10, name=Pony
Circus, version=4, maintenanceCount=0}, maintenanceCount=0} Role:
DbRole{id=182, name=hue1-BEESWAX_SERVER-b4d2ad3dbec4360c224c91d0bd0ece
43, hostId=michaela.ixcloud.net, roleType=BEESWAX_SERVER,
configuredStatus=STOPPED, configGeneration=5, service=hue1,
maintenanceCount=0, decommissionCount=0}
2013-03-07 09:33:08,816 WARN
[2044353087@scm-web-60:service.AbstractBringUpBringDownCommands@587]
Unexpected exception in command execution
java.lang.NullPointerException
at
com.google.common.base.Preconditions.checkNotNull(Preconditions.java:191)
at
com.cloudera.cmf.protocol.ResourcesUtil.initDirectoryResource(ResourcesUtil.java:22)
at
com.cloudera.cmf.protocol.ResourcesUtil.newDirectoryResource(ResourcesUtil.java:12)
at
com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:373)
at
com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:352)
at
com.cloudera.cmf.service.hue.BeeswaxServerRoleHandler.makeResources(BeeswaxServerRoleHandler.java:157)
at
com.cloudera.cmf.service.hue.BaseHueRoleHandler.makeProcess(BaseHueRoleHandler.java:82)
at
com.cloudera.cmf.service.AbstractBringUpBringDownCommands$GenericBringUpRoleCommand.executeImpl(AbstractBringUpBringDownCommands.java:573)
at
com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:28)
at
com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:11)
...

As attachment you find the full Stacktrace (from cloudera-scm-server.log),
the hive-site.xml and the hui.ini.

Currently we are running on Debian 6.

Thanks for you help,
Christian.

Search Discussions

  • Christian Schneider at Mar 7, 2013 at 9:52 am
    Ups, i forgot the attachments. Here they are :).

    Best Regards,
    Christian.


    2013/3/7 Christian Schneider <cschneiderpublic@gmail.com>
    Hi, i already ask this question on CDH-Users list, but now I think it is
    related to CM. The problem is, that after an upgrade to CDH4.2
    Beeswax is not able to start. During the update we changed the metastore
    from Derby to Mysql.

    If we start Beeswax over CM, it *immediately* fails with:

    Command failed to start: null


    The CM config validation ends without any violation.

    On the log i found this NullPointerException:

    2013-03-07 09:33:08,780 INFO [2044353087
    @scm-web-60:service.ServiceHandlerRegistry@656] Executing role command
    Start BasicCmdArgs{args=[], alertConfig=null}. Service: DbService{id=41,
    name=hue1, serviceT
    ype=HUE, optimisticLockVersion=1, cluster=DbCluster{id=10, name=Pony
    Circus, version=4, maintenanceCount=0}, maintenanceCount=0} Role:
    DbRole{id=182, name=hue1-BEESWAX_SERVER-b4d2ad3dbec4360c224c91d0bd0ece
    43, hostId=michaela.ixcloud.net, roleType=BEESWAX_SERVER,
    configuredStatus=STOPPED, configGeneration=5, service=hue1,
    maintenanceCount=0, decommissionCount=0}
    2013-03-07 09:33:08,816 WARN [2044353087
    @scm-web-60:service.AbstractBringUpBringDownCommands@587] Unexpected
    exception in command execution
    java.lang.NullPointerException
    at
    com.google.common.base.Preconditions.checkNotNull(Preconditions.java:191)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.initDirectoryResource(ResourcesUtil.java:22)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.newDirectoryResource(ResourcesUtil.java:12)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:373)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:352)
    at
    com.cloudera.cmf.service.hue.BeeswaxServerRoleHandler.makeResources(BeeswaxServerRoleHandler.java:157)
    at
    com.cloudera.cmf.service.hue.BaseHueRoleHandler.makeProcess(BaseHueRoleHandler.java:82)
    at
    com.cloudera.cmf.service.AbstractBringUpBringDownCommands$GenericBringUpRoleCommand.executeImpl(AbstractBringUpBringDownCommands.java:573)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:28)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:11)
    ...

    As attachment you find the full Stacktrace (from cloudera-scm-server.log),
    the hive-site.xml and the hui.ini.

    Currently we are running on Debian 6.

    Thanks for you help,
    Christian.
  • Adam Smieszny at Mar 7, 2013 at 3:23 pm
    You are upgrading to 4.2 from what previous release?

    Thanks,
    Adam

    On Thu, Mar 7, 2013 at 4:52 AM, Christian Schneider wrote:

    Ups, i forgot the attachments. Here they are :).

    Best Regards,
    Christian.


    2013/3/7 Christian Schneider <cschneiderpublic@gmail.com>
    Hi, i already ask this question on CDH-Users list, but now I think it is
    related to CM. The problem is, that after an upgrade to CDH4.2
    Beeswax is not able to start. During the update we changed the metastore
    from Derby to Mysql.

    If we start Beeswax over CM, it *immediately* fails with:

    Command failed to start: null


    The CM config validation ends without any violation.

    On the log i found this NullPointerException:

    2013-03-07 09:33:08,780 INFO [2044353087
    @scm-web-60:service.ServiceHandlerRegistry@656] Executing role command
    Start BasicCmdArgs{args=[], alertConfig=null}. Service: DbService{id=41,
    name=hue1, serviceT
    ype=HUE, optimisticLockVersion=1, cluster=DbCluster{id=10, name=Pony
    Circus, version=4, maintenanceCount=0}, maintenanceCount=0} Role:
    DbRole{id=182, name=hue1-BEESWAX_SERVER-b4d2ad3dbec4360c224c91d0bd0ece
    43, hostId=michaela.ixcloud.net, roleType=BEESWAX_SERVER,
    configuredStatus=STOPPED, configGeneration=5, service=hue1,
    maintenanceCount=0, decommissionCount=0}
    2013-03-07 09:33:08,816 WARN [2044353087
    @scm-web-60:service.AbstractBringUpBringDownCommands@587] Unexpected
    exception in command execution
    java.lang.NullPointerException
    at
    com.google.common.base.Preconditions.checkNotNull(Preconditions.java:191)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.initDirectoryResource(ResourcesUtil.java:22)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.newDirectoryResource(ResourcesUtil.java:12)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:373)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:352)
    at
    com.cloudera.cmf.service.hue.BeeswaxServerRoleHandler.makeResources(BeeswaxServerRoleHandler.java:157)
    at
    com.cloudera.cmf.service.hue.BaseHueRoleHandler.makeProcess(BaseHueRoleHandler.java:82)
    at
    com.cloudera.cmf.service.AbstractBringUpBringDownCommands$GenericBringUpRoleCommand.executeImpl(AbstractBringUpBringDownCommands.java:573)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:28)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:11)
    ...

    As attachment you find the full Stacktrace (from
    cloudera-scm-server.log), the hive-site.xml and the hui.ini.

    Currently we are running on Debian 6.

    Thanks for you help,
    Christian.

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://www.linkedin.com/in/adamsmieszny
    917.830.4156
  • Darren Lo at Mar 7, 2013 at 3:33 pm
    In addition to the old CDH version, can you also let us know your Cloudera
    Manager version and whether you've upgraded Cloudera Manager as well? If
    you've recently upgraded Cloudera Manager, from what version?

    Thanks,
    Darren

    On Thu, Mar 7, 2013 at 7:23 AM, Adam Smieszny wrote:

    You are upgrading to 4.2 from what previous release?

    Thanks,
    Adam


    On Thu, Mar 7, 2013 at 4:52 AM, Christian Schneider <
    cschneiderpublic@gmail.com> wrote:
    Ups, i forgot the attachments. Here they are :).

    Best Regards,
    Christian.


    2013/3/7 Christian Schneider <cschneiderpublic@gmail.com>
    Hi, i already ask this question on CDH-Users list, but now I think it is
    related to CM. The problem is, that after an upgrade to CDH4.2
    Beeswax is not able to start. During the update we changed the metastore
    from Derby to Mysql.

    If we start Beeswax over CM, it *immediately* fails with:

    Command failed to start: null


    The CM config validation ends without any violation.

    On the log i found this NullPointerException:

    2013-03-07 09:33:08,780 INFO [2044353087
    @scm-web-60:service.ServiceHandlerRegistry@656] Executing role command
    Start BasicCmdArgs{args=[], alertConfig=null}. Service: DbService{id=41,
    name=hue1, serviceT
    ype=HUE, optimisticLockVersion=1, cluster=DbCluster{id=10, name=Pony
    Circus, version=4, maintenanceCount=0}, maintenanceCount=0} Role:
    DbRole{id=182, name=hue1-BEESWAX_SERVER-b4d2ad3dbec4360c224c91d0bd0ece
    43, hostId=michaela.ixcloud.net, roleType=BEESWAX_SERVER,
    configuredStatus=STOPPED, configGeneration=5, service=hue1,
    maintenanceCount=0, decommissionCount=0}
    2013-03-07 09:33:08,816 WARN [2044353087
    @scm-web-60:service.AbstractBringUpBringDownCommands@587] Unexpected
    exception in command execution
    java.lang.NullPointerException
    at
    com.google.common.base.Preconditions.checkNotNull(Preconditions.java:191)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.initDirectoryResource(ResourcesUtil.java:22)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.newDirectoryResource(ResourcesUtil.java:12)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:373)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:352)
    at
    com.cloudera.cmf.service.hue.BeeswaxServerRoleHandler.makeResources(BeeswaxServerRoleHandler.java:157)
    at
    com.cloudera.cmf.service.hue.BaseHueRoleHandler.makeProcess(BaseHueRoleHandler.java:82)
    at
    com.cloudera.cmf.service.AbstractBringUpBringDownCommands$GenericBringUpRoleCommand.executeImpl(AbstractBringUpBringDownCommands.java:573)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:28)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:11)
    ...

    As attachment you find the full Stacktrace (from
    cloudera-scm-server.log), the hive-site.xml and the hui.ini.

    Currently we are running on Debian 6.

    Thanks for you help,
    Christian.

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://www.linkedin.com/in/adamsmieszny
    917.830.4156


    --
    Thanks,
    Darren
  • Philip Zeyliger at Mar 7, 2013 at 4:12 pm
    Christian,

    Since this looks like a bug in how we're telling you about a missing or
    invalid config, could you also send us the output of
    http://your_cm_server:7180/api/v3/cm/deployment?view=EXPORT_REDACTED .
    That'll give us all of your configs, and we'll be able to reproduce
    locally.

    -- Philip

    On Thu, Mar 7, 2013 at 7:33 AM, Darren Lo wrote:

    In addition to the old CDH version, can you also let us know your Cloudera
    Manager version and whether you've upgraded Cloudera Manager as well? If
    you've recently upgraded Cloudera Manager, from what version?

    Thanks,
    Darren

    On Thu, Mar 7, 2013 at 7:23 AM, Adam Smieszny wrote:

    You are upgrading to 4.2 from what previous release?

    Thanks,
    Adam


    On Thu, Mar 7, 2013 at 4:52 AM, Christian Schneider <
    cschneiderpublic@gmail.com> wrote:
    Ups, i forgot the attachments. Here they are :).

    Best Regards,
    Christian.


    2013/3/7 Christian Schneider <cschneiderpublic@gmail.com>
    Hi, i already ask this question on CDH-Users list, but now I think it
    is related to CM. The problem is, that after an upgrade to CDH4.2
    Beeswax is not able to start. During the update we changed the
    metastore from Derby to Mysql.

    If we start Beeswax over CM, it *immediately* fails with:

    Command failed to start: null


    The CM config validation ends without any violation.

    On the log i found this NullPointerException:

    2013-03-07 09:33:08,780 INFO [2044353087
    @scm-web-60:service.ServiceHandlerRegistry@656] Executing role command
    Start BasicCmdArgs{args=[], alertConfig=null}. Service: DbService{id=41,
    name=hue1, serviceT
    ype=HUE, optimisticLockVersion=1, cluster=DbCluster{id=10, name=Pony
    Circus, version=4, maintenanceCount=0}, maintenanceCount=0} Role:
    DbRole{id=182, name=hue1-BEESWAX_SERVER-b4d2ad3dbec4360c224c91d0bd0ece
    43, hostId=michaela.ixcloud.net, roleType=BEESWAX_SERVER,
    configuredStatus=STOPPED, configGeneration=5, service=hue1,
    maintenanceCount=0, decommissionCount=0}
    2013-03-07 09:33:08,816 WARN [2044353087
    @scm-web-60:service.AbstractBringUpBringDownCommands@587] Unexpected
    exception in command execution
    java.lang.NullPointerException
    at
    com.google.common.base.Preconditions.checkNotNull(Preconditions.java:191)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.initDirectoryResource(ResourcesUtil.java:22)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.newDirectoryResource(ResourcesUtil.java:12)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:373)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:352)
    at
    com.cloudera.cmf.service.hue.BeeswaxServerRoleHandler.makeResources(BeeswaxServerRoleHandler.java:157)
    at
    com.cloudera.cmf.service.hue.BaseHueRoleHandler.makeProcess(BaseHueRoleHandler.java:82)
    at
    com.cloudera.cmf.service.AbstractBringUpBringDownCommands$GenericBringUpRoleCommand.executeImpl(AbstractBringUpBringDownCommands.java:573)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:28)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:11)
    ...

    As attachment you find the full Stacktrace (from
    cloudera-scm-server.log), the hive-site.xml and the hui.ini.

    Currently we are running on Debian 6.

    Thanks for you help,
    Christian.

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://www.linkedin.com/in/adamsmieszny
    917.830.4156


    --
    Thanks,
    Darren
  • Christian Schneider at Mar 7, 2013 at 5:18 pm
    We upgraded
    * CDH 4.1.3 to 4.2
    * CM 4.1 to 4.5 (updated with the parcel system)
    ** That's where the Hive Server was added and we had to replace Derby by
    Mysql

    @Philip: Nice way to get the config :).
    I attached the config.

    Best Regards,
    Christian.


    2013/3/7 Philip Zeyliger <philip@cloudera.com>
    Christian,

    Since this looks like a bug in how we're telling you about a missing or
    invalid config, could you also send us the output of
    http://your_cm_server:7180/api/v3/cm/deployment?view=EXPORT_REDACTED .
    That'll give us all of your configs, and we'll be able to reproduce
    locally.

    -- Philip

    On Thu, Mar 7, 2013 at 7:33 AM, Darren Lo wrote:

    In addition to the old CDH version, can you also let us know your
    Cloudera Manager version and whether you've upgraded Cloudera Manager as
    well? If you've recently upgraded Cloudera Manager, from what version?

    Thanks,
    Darren

    On Thu, Mar 7, 2013 at 7:23 AM, Adam Smieszny wrote:

    You are upgrading to 4.2 from what previous release?

    Thanks,
    Adam


    On Thu, Mar 7, 2013 at 4:52 AM, Christian Schneider <
    cschneiderpublic@gmail.com> wrote:
    Ups, i forgot the attachments. Here they are :).

    Best Regards,
    Christian.


    2013/3/7 Christian Schneider <cschneiderpublic@gmail.com>
    Hi, i already ask this question on CDH-Users list, but now I think it
    is related to CM. The problem is, that after an upgrade to CDH4.2
    Beeswax is not able to start. During the update we changed the
    metastore from Derby to Mysql.

    If we start Beeswax over CM, it *immediately* fails with:

    Command failed to start: null


    The CM config validation ends without any violation.

    On the log i found this NullPointerException:

    2013-03-07 09:33:08,780 INFO [2044353087
    @scm-web-60:service.ServiceHandlerRegistry@656] Executing role
    command Start BasicCmdArgs{args=[], alertConfig=null}. Service:
    DbService{id=41, name=hue1, serviceT
    ype=HUE, optimisticLockVersion=1, cluster=DbCluster{id=10, name=Pony
    Circus, version=4, maintenanceCount=0}, maintenanceCount=0} Role:
    DbRole{id=182, name=hue1-BEESWAX_SERVER-b4d2ad3dbec4360c224c91d0bd0ece
    43, hostId=michaela.ixcloud.net, roleType=BEESWAX_SERVER,
    configuredStatus=STOPPED, configGeneration=5, service=hue1,
    maintenanceCount=0, decommissionCount=0}
    2013-03-07 09:33:08,816 WARN [2044353087
    @scm-web-60:service.AbstractBringUpBringDownCommands@587] Unexpected
    exception in command execution
    java.lang.NullPointerException
    at
    com.google.common.base.Preconditions.checkNotNull(Preconditions.java:191)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.initDirectoryResource(ResourcesUtil.java:22)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.newDirectoryResource(ResourcesUtil.java:12)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:373)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:352)
    at
    com.cloudera.cmf.service.hue.BeeswaxServerRoleHandler.makeResources(BeeswaxServerRoleHandler.java:157)
    at
    com.cloudera.cmf.service.hue.BaseHueRoleHandler.makeProcess(BaseHueRoleHandler.java:82)
    at
    com.cloudera.cmf.service.AbstractBringUpBringDownCommands$GenericBringUpRoleCommand.executeImpl(AbstractBringUpBringDownCommands.java:573)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:28)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:11)
    ...

    As attachment you find the full Stacktrace (from
    cloudera-scm-server.log), the hive-site.xml and the hui.ini.

    Currently we are running on Debian 6.

    Thanks for you help,
    Christian.

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://www.linkedin.com/in/adamsmieszny
    917.830.4156


    --
    Thanks,
    Darren
  • Philip Zeyliger at Mar 7, 2013 at 6:07 pm
    Hi Christian,

    It's quite odd that hive_metastore_derby_path is set, but empty in your
    configs. Could you edit that setting in the config page (to something like
    /tmp/foo) and try restarting Beeswax again? I haven't yet been able to
    reproduce getting into that state.

    Cheers,

    -- Philip

    }, {
    "name" : "hive1",
    "type" : "HIVE",
    "config" : {
    "items" : [ {
    "name" : "hive_metastore_database_host",
    "value" : "michaela"
    }, {
    "name" : "hive_metastore_database_password",
    "value" : "XXX"
    }, {
    * "name" : "hive_metastore_derby_path",*
    * "value" : ""*
    }, {
    "name" : "mapreduce_yarn_service",
    "value" : "mapreduce1"
    } ]
    },

    On Thu, Mar 7, 2013 at 9:18 AM, Christian Schneider wrote:

    We upgraded
    * CDH 4.1.3 to 4.2
    * CM 4.1 to 4.5 (updated with the parcel system)
    ** That's where the Hive Server was added and we had to replace Derby by
    Mysql

    @Philip: Nice way to get the config :).
    I attached the config.

    Best Regards,
    Christian.


    2013/3/7 Philip Zeyliger <philip@cloudera.com>
    Christian,

    Since this looks like a bug in how we're telling you about a missing or
    invalid config, could you also send us the output of
    http://your_cm_server:7180/api/v3/cm/deployment?view=EXPORT_REDACTED .
    That'll give us all of your configs, and we'll be able to reproduce
    locally.

    -- Philip

    On Thu, Mar 7, 2013 at 7:33 AM, Darren Lo wrote:

    In addition to the old CDH version, can you also let us know your
    Cloudera Manager version and whether you've upgraded Cloudera Manager as
    well? If you've recently upgraded Cloudera Manager, from what version?

    Thanks,
    Darren

    On Thu, Mar 7, 2013 at 7:23 AM, Adam Smieszny wrote:

    You are upgrading to 4.2 from what previous release?

    Thanks,
    Adam


    On Thu, Mar 7, 2013 at 4:52 AM, Christian Schneider <
    cschneiderpublic@gmail.com> wrote:
    Ups, i forgot the attachments. Here they are :).

    Best Regards,
    Christian.


    2013/3/7 Christian Schneider <cschneiderpublic@gmail.com>
    Hi, i already ask this question on CDH-Users list, but now I think it
    is related to CM. The problem is, that after an upgrade to CDH4.2
    Beeswax is not able to start. During the update we changed the
    metastore from Derby to Mysql.

    If we start Beeswax over CM, it *immediately* fails with:

    Command failed to start: null


    The CM config validation ends without any violation.

    On the log i found this NullPointerException:

    2013-03-07 09:33:08,780 INFO [2044353087
    @scm-web-60:service.ServiceHandlerRegistry@656] Executing role
    command Start BasicCmdArgs{args=[], alertConfig=null}. Service:
    DbService{id=41, name=hue1, serviceT
    ype=HUE, optimisticLockVersion=1, cluster=DbCluster{id=10, name=Pony
    Circus, version=4, maintenanceCount=0}, maintenanceCount=0} Role:
    DbRole{id=182, name=hue1-BEESWAX_SERVER-b4d2ad3dbec4360c224c91d0bd0ece
    43, hostId=michaela.ixcloud.net, roleType=BEESWAX_SERVER,
    configuredStatus=STOPPED, configGeneration=5, service=hue1,
    maintenanceCount=0, decommissionCount=0}
    2013-03-07 09:33:08,816 WARN [2044353087
    @scm-web-60:service.AbstractBringUpBringDownCommands@587] Unexpected
    exception in command execution
    java.lang.NullPointerException
    at
    com.google.common.base.Preconditions.checkNotNull(Preconditions.java:191)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.initDirectoryResource(ResourcesUtil.java:22)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.newDirectoryResource(ResourcesUtil.java:12)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:373)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:352)
    at
    com.cloudera.cmf.service.hue.BeeswaxServerRoleHandler.makeResources(BeeswaxServerRoleHandler.java:157)
    at
    com.cloudera.cmf.service.hue.BaseHueRoleHandler.makeProcess(BaseHueRoleHandler.java:82)
    at
    com.cloudera.cmf.service.AbstractBringUpBringDownCommands$GenericBringUpRoleCommand.executeImpl(AbstractBringUpBringDownCommands.java:573)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:28)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:11)
    ...

    As attachment you find the full Stacktrace (from
    cloudera-scm-server.log), the hive-site.xml and the hui.ini.

    Currently we are running on Debian 6.

    Thanks for you help,
    Christian.

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://www.linkedin.com/in/adamsmieszny
    917.830.4156


    --
    Thanks,
    Darren
  • Darren Lo at Mar 7, 2013 at 11:55 pm
    Hi Christian,

    Please make sure that you have created the Hive Metastore Database tables
    and the Hive warehouse directory. There are commands available in CM to do
    this (click on the Hive service, look in Actions Menu). You may need to
    stop the Hive Metastore Server before the commands will become available.

    Thanks,
    Darren

    On Thu, Mar 7, 2013 at 10:06 AM, Philip Zeyliger wrote:

    Hi Christian,

    It's quite odd that hive_metastore_derby_path is set, but empty in your
    configs. Could you edit that setting in the config page (to something like
    /tmp/foo) and try restarting Beeswax again? I haven't yet been able to
    reproduce getting into that state.

    Cheers,

    -- Philip

    }, {
    "name" : "hive1",
    "type" : "HIVE",
    "config" : {
    "items" : [ {
    "name" : "hive_metastore_database_host",
    "value" : "michaela"
    }, {
    "name" : "hive_metastore_database_password",
    "value" : "XXX"
    }, {
    * "name" : "hive_metastore_derby_path",*
    * "value" : ""*
    }, {
    "name" : "mapreduce_yarn_service",
    "value" : "mapreduce1"
    } ]
    },


    On Thu, Mar 7, 2013 at 9:18 AM, Christian Schneider <
    cschneiderpublic@gmail.com> wrote:
    We upgraded
    * CDH 4.1.3 to 4.2
    * CM 4.1 to 4.5 (updated with the parcel system)
    ** That's where the Hive Server was added and we had to replace Derby by
    Mysql

    @Philip: Nice way to get the config :).
    I attached the config.

    Best Regards,
    Christian.


    2013/3/7 Philip Zeyliger <philip@cloudera.com>
    Christian,

    Since this looks like a bug in how we're telling you about a missing or
    invalid config, could you also send us the output of
    http://your_cm_server:7180/api/v3/cm/deployment?view=EXPORT_REDACTED .
    That'll give us all of your configs, and we'll be able to reproduce
    locally.

    -- Philip

    On Thu, Mar 7, 2013 at 7:33 AM, Darren Lo wrote:

    In addition to the old CDH version, can you also let us know your
    Cloudera Manager version and whether you've upgraded Cloudera Manager as
    well? If you've recently upgraded Cloudera Manager, from what version?

    Thanks,
    Darren

    On Thu, Mar 7, 2013 at 7:23 AM, Adam Smieszny wrote:

    You are upgrading to 4.2 from what previous release?

    Thanks,
    Adam


    On Thu, Mar 7, 2013 at 4:52 AM, Christian Schneider <
    cschneiderpublic@gmail.com> wrote:
    Ups, i forgot the attachments. Here they are :).

    Best Regards,
    Christian.


    2013/3/7 Christian Schneider <cschneiderpublic@gmail.com>
    Hi, i already ask this question on CDH-Users list, but now I think
    it is related to CM. The problem is, that after an upgrade to CDH4.2
    Beeswax is not able to start. During the update we changed the
    metastore from Derby to Mysql.

    If we start Beeswax over CM, it *immediately* fails with:

    Command failed to start: null


    The CM config validation ends without any violation.

    On the log i found this NullPointerException:

    2013-03-07 09:33:08,780 INFO [2044353087
    @scm-web-60:service.ServiceHandlerRegistry@656] Executing role
    command Start BasicCmdArgs{args=[], alertConfig=null}. Service:
    DbService{id=41, name=hue1, serviceT
    ype=HUE, optimisticLockVersion=1, cluster=DbCluster{id=10, name=Pony
    Circus, version=4, maintenanceCount=0}, maintenanceCount=0} Role:
    DbRole{id=182, name=hue1-BEESWAX_SERVER-b4d2ad3dbec4360c224c91d0bd0ece
    43, hostId=michaela.ixcloud.net, roleType=BEESWAX_SERVER,
    configuredStatus=STOPPED, configGeneration=5, service=hue1,
    maintenanceCount=0, decommissionCount=0}
    2013-03-07 09:33:08,816 WARN [2044353087
    @scm-web-60:service.AbstractBringUpBringDownCommands@587]
    Unexpected exception in command execution
    java.lang.NullPointerException
    at
    com.google.common.base.Preconditions.checkNotNull(Preconditions.java:191)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.initDirectoryResource(ResourcesUtil.java:22)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.newDirectoryResource(ResourcesUtil.java:12)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:373)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:352)
    at
    com.cloudera.cmf.service.hue.BeeswaxServerRoleHandler.makeResources(BeeswaxServerRoleHandler.java:157)
    at
    com.cloudera.cmf.service.hue.BaseHueRoleHandler.makeProcess(BaseHueRoleHandler.java:82)
    at
    com.cloudera.cmf.service.AbstractBringUpBringDownCommands$GenericBringUpRoleCommand.executeImpl(AbstractBringUpBringDownCommands.java:573)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:28)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:11)
    ...

    As attachment you find the full Stacktrace (from
    cloudera-scm-server.log), the hive-site.xml and the hui.ini.

    Currently we are running on Debian 6.

    Thanks for you help,
    Christian.

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://www.linkedin.com/in/adamsmieszny
    917.830.4156


    --
    Thanks,
    Darren

    --
    Thanks,
    Darren
  • Christian Schneider at Mar 8, 2013 at 9:19 am
    <3 Philip :).

    Thank you for the suggestion. That's it!
    I set it to the default and it runs fine :).

    Maybe CM should validate whether this option is set or not. Because it
    leads into a NullPointerException.

    Best Regards,
    Christian.


    2013/3/7 Philip Zeyliger <philip@cloudera.com>
    Hi Christian,

    It's quite odd that hive_metastore_derby_path is set, but empty in your
    configs. Could you edit that setting in the config page (to something like
    /tmp/foo) and try restarting Beeswax again? I haven't yet been able to
    reproduce getting into that state.

    Cheers,

    -- Philip

    }, {
    "name" : "hive1",
    "type" : "HIVE",
    "config" : {
    "items" : [ {
    "name" : "hive_metastore_database_host",
    "value" : "michaela"
    }, {
    "name" : "hive_metastore_database_password",
    "value" : "XXX"
    }, {
    * "name" : "hive_metastore_derby_path",*
    * "value" : ""*
    }, {
    "name" : "mapreduce_yarn_service",
    "value" : "mapreduce1"
    } ]
    },


    On Thu, Mar 7, 2013 at 9:18 AM, Christian Schneider <
    cschneiderpublic@gmail.com> wrote:
    We upgraded
    * CDH 4.1.3 to 4.2
    * CM 4.1 to 4.5 (updated with the parcel system)
    ** That's where the Hive Server was added and we had to replace Derby by
    Mysql

    @Philip: Nice way to get the config :).
    I attached the config.

    Best Regards,
    Christian.


    2013/3/7 Philip Zeyliger <philip@cloudera.com>
    Christian,

    Since this looks like a bug in how we're telling you about a missing or
    invalid config, could you also send us the output of
    http://your_cm_server:7180/api/v3/cm/deployment?view=EXPORT_REDACTED .
    That'll give us all of your configs, and we'll be able to reproduce
    locally.

    -- Philip

    On Thu, Mar 7, 2013 at 7:33 AM, Darren Lo wrote:

    In addition to the old CDH version, can you also let us know your
    Cloudera Manager version and whether you've upgraded Cloudera Manager as
    well? If you've recently upgraded Cloudera Manager, from what version?

    Thanks,
    Darren

    On Thu, Mar 7, 2013 at 7:23 AM, Adam Smieszny wrote:

    You are upgrading to 4.2 from what previous release?

    Thanks,
    Adam


    On Thu, Mar 7, 2013 at 4:52 AM, Christian Schneider <
    cschneiderpublic@gmail.com> wrote:
    Ups, i forgot the attachments. Here they are :).

    Best Regards,
    Christian.


    2013/3/7 Christian Schneider <cschneiderpublic@gmail.com>
    Hi, i already ask this question on CDH-Users list, but now I think
    it is related to CM. The problem is, that after an upgrade to CDH4.2
    Beeswax is not able to start. During the update we changed the
    metastore from Derby to Mysql.

    If we start Beeswax over CM, it *immediately* fails with:

    Command failed to start: null


    The CM config validation ends without any violation.

    On the log i found this NullPointerException:

    2013-03-07 09:33:08,780 INFO [2044353087
    @scm-web-60:service.ServiceHandlerRegistry@656] Executing role
    command Start BasicCmdArgs{args=[], alertConfig=null}. Service:
    DbService{id=41, name=hue1, serviceT
    ype=HUE, optimisticLockVersion=1, cluster=DbCluster{id=10, name=Pony
    Circus, version=4, maintenanceCount=0}, maintenanceCount=0} Role:
    DbRole{id=182, name=hue1-BEESWAX_SERVER-b4d2ad3dbec4360c224c91d0bd0ece
    43, hostId=michaela.ixcloud.net, roleType=BEESWAX_SERVER,
    configuredStatus=STOPPED, configGeneration=5, service=hue1,
    maintenanceCount=0, decommissionCount=0}
    2013-03-07 09:33:08,816 WARN [2044353087
    @scm-web-60:service.AbstractBringUpBringDownCommands@587]
    Unexpected exception in command execution
    java.lang.NullPointerException
    at
    com.google.common.base.Preconditions.checkNotNull(Preconditions.java:191)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.initDirectoryResource(ResourcesUtil.java:22)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.newDirectoryResource(ResourcesUtil.java:12)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:373)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:352)
    at
    com.cloudera.cmf.service.hue.BeeswaxServerRoleHandler.makeResources(BeeswaxServerRoleHandler.java:157)
    at
    com.cloudera.cmf.service.hue.BaseHueRoleHandler.makeProcess(BaseHueRoleHandler.java:82)
    at
    com.cloudera.cmf.service.AbstractBringUpBringDownCommands$GenericBringUpRoleCommand.executeImpl(AbstractBringUpBringDownCommands.java:573)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:28)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:11)
    ...

    As attachment you find the full Stacktrace (from
    cloudera-scm-server.log), the hive-site.xml and the hui.ini.

    Currently we are running on Debian 6.

    Thanks for you help,
    Christian.

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://www.linkedin.com/in/adamsmieszny
    917.830.4156


    --
    Thanks,
    Darren
  • Darren Lo at Mar 8, 2013 at 6:20 pm
    Hi Christian,

    Glad you got past your issue. I've filed a bug internally to make sure this
    gets fixed.

    Thanks,
    Darren

    On Fri, Mar 8, 2013 at 1:19 AM, Christian Schneider wrote:

    <3 Philip :).

    Thank you for the suggestion. That's it!
    I set it to the default and it runs fine :).

    Maybe CM should validate whether this option is set or not. Because it
    leads into a NullPointerException.

    Best Regards,
    Christian.


    2013/3/7 Philip Zeyliger <philip@cloudera.com>
    Hi Christian,

    It's quite odd that hive_metastore_derby_path is set, but empty in your
    configs. Could you edit that setting in the config page (to something like
    /tmp/foo) and try restarting Beeswax again? I haven't yet been able to
    reproduce getting into that state.

    Cheers,

    -- Philip

    }, {
    "name" : "hive1",
    "type" : "HIVE",
    "config" : {
    "items" : [ {
    "name" : "hive_metastore_database_host",
    "value" : "michaela"
    }, {
    "name" : "hive_metastore_database_password",
    "value" : "XXX"
    }, {
    * "name" : "hive_metastore_derby_path",*
    * "value" : ""*
    }, {
    "name" : "mapreduce_yarn_service",
    "value" : "mapreduce1"
    } ]
    },


    On Thu, Mar 7, 2013 at 9:18 AM, Christian Schneider <
    cschneiderpublic@gmail.com> wrote:
    We upgraded
    * CDH 4.1.3 to 4.2
    * CM 4.1 to 4.5 (updated with the parcel system)
    ** That's where the Hive Server was added and we had to replace Derby by
    Mysql

    @Philip: Nice way to get the config :).
    I attached the config.

    Best Regards,
    Christian.


    2013/3/7 Philip Zeyliger <philip@cloudera.com>
    Christian,

    Since this looks like a bug in how we're telling you about a missing or
    invalid config, could you also send us the output of
    http://your_cm_server:7180/api/v3/cm/deployment?view=EXPORT_REDACTED .
    That'll give us all of your configs, and we'll be able to reproduce
    locally.

    -- Philip

    On Thu, Mar 7, 2013 at 7:33 AM, Darren Lo wrote:

    In addition to the old CDH version, can you also let us know your
    Cloudera Manager version and whether you've upgraded Cloudera Manager as
    well? If you've recently upgraded Cloudera Manager, from what version?

    Thanks,
    Darren

    On Thu, Mar 7, 2013 at 7:23 AM, Adam Smieszny wrote:

    You are upgrading to 4.2 from what previous release?

    Thanks,
    Adam


    On Thu, Mar 7, 2013 at 4:52 AM, Christian Schneider <
    cschneiderpublic@gmail.com> wrote:
    Ups, i forgot the attachments. Here they are :).

    Best Regards,
    Christian.


    2013/3/7 Christian Schneider <cschneiderpublic@gmail.com>
    Hi, i already ask this question on CDH-Users list, but now I think
    it is related to CM. The problem is, that after an upgrade to CDH4.2
    Beeswax is not able to start. During the update we changed the
    metastore from Derby to Mysql.

    If we start Beeswax over CM, it *immediately* fails with:

    Command failed to start: null


    The CM config validation ends without any violation.

    On the log i found this NullPointerException:

    2013-03-07 09:33:08,780 INFO [2044353087
    @scm-web-60:service.ServiceHandlerRegistry@656] Executing role
    command Start BasicCmdArgs{args=[], alertConfig=null}. Service:
    DbService{id=41, name=hue1, serviceT
    ype=HUE, optimisticLockVersion=1, cluster=DbCluster{id=10,
    name=Pony Circus, version=4, maintenanceCount=0}, maintenanceCount=0} Role:
    DbRole{id=182, name=hue1-BEESWAX_SERVER-b4d2ad3dbec4360c224c91d0bd0ece
    43, hostId=michaela.ixcloud.net, roleType=BEESWAX_SERVER,
    configuredStatus=STOPPED, configGeneration=5, service=hue1,
    maintenanceCount=0, decommissionCount=0}
    2013-03-07 09:33:08,816 WARN [2044353087
    @scm-web-60:service.AbstractBringUpBringDownCommands@587]
    Unexpected exception in command execution
    java.lang.NullPointerException
    at
    com.google.common.base.Preconditions.checkNotNull(Preconditions.java:191)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.initDirectoryResource(ResourcesUtil.java:22)
    at
    com.cloudera.cmf.protocol.ResourcesUtil.newDirectoryResource(ResourcesUtil.java:12)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:373)
    at
    com.cloudera.cmf.service.HandlerUtil.newDirectoryResource(HandlerUtil.java:352)
    at
    com.cloudera.cmf.service.hue.BeeswaxServerRoleHandler.makeResources(BeeswaxServerRoleHandler.java:157)
    at
    com.cloudera.cmf.service.hue.BaseHueRoleHandler.makeProcess(BaseHueRoleHandler.java:82)
    at
    com.cloudera.cmf.service.AbstractBringUpBringDownCommands$GenericBringUpRoleCommand.executeImpl(AbstractBringUpBringDownCommands.java:573)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:28)
    at
    com.cloudera.cmf.service.AbstractRoleCommand.execute(AbstractRoleCommand.java:11)
    ...

    As attachment you find the full Stacktrace (from
    cloudera-scm-server.log), the hive-site.xml and the hui.ini.

    Currently we are running on Debian 6.

    Thanks for you help,
    Christian.

    --
    Adam Smieszny
    Cloudera | Systems Engineer | http://www.linkedin.com/in/adamsmieszny
    917.830.4156


    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedMar 7, '13 at 9:16a
activeMar 8, '13 at 6:20p
posts10
users4
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase