FAQ
Hi, suddenly we've met a problem.
It's impossible to see the sample for the hive table.
HUE UI exception is:

OK
FAILED: SemanticException org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out


I can see the list of tables and columns for these tables.
Here is a part from HUE server log:

18:03:52.000ERRORthrift_util

Thrift saw exception (this may be expected).
Traceback (most recent call last):
   File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/desktop/core/src/desktop/lib/thrift_util.py", line 338, in wrapper
     ret = res(*args, **kwargs)
   File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/../../gen-py/beeswaxd/BeeswaxService.py", line 142, in query
     return self.recv_query()
   File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/../../gen-py/beeswaxd/BeeswaxService.py", line 165, in recv_query
     raise result.error
BeeswaxException: BeeswaxException(errorCode=0, log_context='5c379266-100c-43f6-bedb-2a7ae69f24d4', message='OK\nFAILED: SemanticException org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out\n', SQLState=' ', handle=QueryHandle(log_context='5c379266-100c-43f6-bedb-2a7ae69f24d4', id='5c379266-100c-43f6-bedb-2a7ae69f24d4'))

18:03:52.000INFOthrift_util

Thrift saw exception: BeeswaxException(errorCode=0, log_context='5c379266-100c-43f6-bedb-2a7ae69f24d4', message='OK\nFAILED: SemanticException org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out\n', SQLState=' ', handle=QueryHandle(log_context='5c379266-100c-43f6-bedb-2a7ae69f24d4', id='5c379266-100c-43f6-bedb-2a7ae69f24d4'))


18:05:22.000WARNINGviews

Autocomplete data fetching error default.None: Bad status for request TGetTablesReq(schemaName=u'default', sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret='\xca\x1f\xa1\x04\xd0\xa1DA\x83~\xbb\xc9\x12\x9d\x82:', guid='\xa9WK&&FC\x87\xa4ua\x0bk/\x19\\')), tableName='.*', tableTypes=None, catalogName=None):
TGetTablesResp(status=TStatus(errorCode=None, errorMessage='UncheckedExecutionException: java.lang.IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\nCAUSED BY: IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\nCAUSED BY: MetaException: Got exception: org.apache.thrift.transport.TTransportException null', sqlState='HY000', infoMessages=None, statusCode=3), operationHandle=TOperationHandle(hasResultSet=False, modifiedRowCount=None, operationType=4, operationId=THandleIdentifier(secret='', guid='')))

18:05:22.000INFOmiddleware

Processing exception: Exception("Bad status for request TGetTablesReq(schemaName=u'default', sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret='\\xca\\x1f\\xa1\\x04\\xd0\\xa1DA\\x83~\\xbb\\xc9\\x12\\x9d\\x82:', guid='\\xa9WK&&FC\\x87\\xa4ua\\x0bk/\\x19\\\\')), tableName='.*', tableTypes=None, catalogName=None):\nTGetTablesResp(status=TStatus(errorCode=None, errorMessage='UncheckedExecutionException: java.lang.IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\\nCAUSED BY: IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\\nCAUSED BY: MetaException: Got exception: org.apache.thrift.transport.TTransportException null', sqlState='HY000', infoMessages=None, statusCode=3), operationHandle=TOperationHandle(hasResultSet=False, modifiedRowCount=None, operationType=4, operationId=THandleIdentifier(secret='', guid='')))",) is not JSON serializable: Traceback (most recent call last):
   File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/core/handlers/base.py", line 100, in get_response
     response = callback(request, *callback_args, **callback_kwargs)
   File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/views.py", line 967, in autocomplete
     return HttpResponse(json.dumps(response), mimetype="application/json")
   File "/usr/lib64/python2.6/json/__init__.py", line 230, in dumps
     return _default_encoder.encode(obj)
   File "/usr/lib64/python2.6/json/encoder.py", line 367, in encode
     chunks = list(self.iterencode(o))
   File "/usr/lib64/python2.6/json/encoder.py", line 309, in _iterencode
     for chunk in self._iterencode_dict(o, markers):
   File "/usr/lib64/python2.6/json/encoder.py", line 275, in _iterencode_dict
     for chunk in self._iterencode(value, markers):
   File "/usr/lib64/python2.6/json/encoder.py", line 317, in _iterencode
     for chunk in self._iterencode_default(o, markers):
   File "/usr/lib64/python2.6/json/encoder.py", line 323, in _iterencode_default
     newobj = self.default(o)
   File "/usr/lib64/python2.6/json/encoder.py", line 344, in default
     raise TypeError(repr(o) + " is not JSON serializable")
TypeError: Exception("Bad status for request TGetTablesReq(schemaName=u'default', sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret='\\xca\\x1f\\xa1\\x04\\xd0\\xa1DA\\x83~\\xbb\\xc9\\x12\\x9d\\x82:', guid='\\xa9WK&&FC\\x87\\xa4ua\\x0bk/\\x19\\\\')), tableName='.*', tableTypes=None, catalogName=None):\nTGetTablesResp(status=TStatus(errorCode=None, errorMessage='UncheckedExecutionException: java.lang.IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\\nCAUSED BY: IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\\nCAUSED BY: MetaException: Got exception: org.apache.thrift.transport.TTransportException null', sqlState='HY000', infoMessages=None, statusCode=3), operationHandle=TOperationHandle(hasResultSet=False, modifiedRowCount=None, operationType=4, operationId=THandleIdentifier(secret='', guid='')))",) is not JSON serializable



[01/Aug/2013 16:12:59 +0000] models INFO Retrieving
http://prod-node030.kyc.megafon.ru:50060/tasklog?attemptid=attempt_201307311025_0839_m_000000_0
[01/Aug/2013 16:12:59 +0000] access INFO 10.66.49.145 hdfs - "GET
/pig/watch/0000147-130731180329038-oozie-oozi-W HTTP/1.1"
[01/Aug/2013 16:13:00 +0000] models INFO Retrieving
http://prod-node030.kyc.megafon.ru:50060/tasklog?attemptid=attempt_201307311025_0839_m_000000_0
[01/Aug/2013 16:13:01 +0000] access INFO 10.66.49.145 hdfs - "GET
/pig/dashboard/ HTTP/1.1"
[01/Aug/2013 16:13:01 +0000] access INFO 10.66.48.120 devops -
"GET /beeswax/watch/json/1407 HTTP/1.1"
[01/Aug/2013 16:13:01 +0000] access INFO 10.66.49.145 hdfs - "GET
/pig/watch/0000147-130731180329038-oozie-oozi-W HTTP/1.1"
[01/Aug/2013 16:13:02 +0000] access INFO 10.66.48.120 devops -
"GET /beeswax/watch/json/1406 HTTP/1.1"
[01/Aug/2013 16:13:03 +0000] models INFO Retrieving
http://prod-node030.kyc.megafon.ru:50060/tasklog?attemptid=attempt_201307311025_0839_m_000000_0
[01/Aug/2013 16:13:03 +0000] access INFO 10.66.48.120 devops -
"GET /beeswax/watch/json/1407 HTTP/1.1"
[01/Aug/2013 16:13:03 +0000] access INFO 10.66.48.120 devops -
"GET /impala/watch/1408 HTTP/1.1"
[01/Aug/2013 16:13:03 +0000] access INFO 10.66.49.145 hdfs - "GET
/pig/watch/0000147-130731180329038-oozie-oozi-W HTTP/1.1"
[01/Aug/2013 16:13:04 +0000] access INFO 10.66.48.120 devops -
"GET /impala/results/1408/0 HTTP/1.1"
[01/Aug/2013 16:13:04 +0000] access INFO 10.66.48.120 devops -
"GET /beeswax/watch/json/1406 HTTP/1.1"
[01/Aug/2013 16:13:04 +0000] thrift_util ERROR Thrift saw exception
(this may be expected).
Traceback (most recent call last):
   File
"/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/desktop/core/src/desktop/lib/thrift_util.py",
line 338, in wrapper
     ret = res(*args, **kwargs)
   File
"/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/../../gen-py/TCLIService/TCLIService.py",
line 634, in GetLog
     return self.recv_GetLog()
   File
"/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/../../gen-py/TCLIService/TCLIService.py",
line 650, in recv_GetLog
     raise x
TApplicationException: Invalid method name: 'GetLog'
[01/Aug/2013 16:13:04 +0000] thrift_util INFO Thrift saw an
application exception: Invalid method name: 'GetLog'
[01/Aug/2013 16:13:04 +0000] access INFO 10.66.48.120 devops -
"GET /debug/check_config_ajax HTTP/1.1"


How can we find the problem?

Search Discussions

  • Romain Rigaux at Aug 1, 2013 at 4:51 pm
    To be sure we understand:

        1. You are opening the Metastore App
        2. selecting sample_07 table
        3. click on browse data
        4. and get the timeout error?

    Beeswaxd is probably in a bad state: could you look at its log and maybe
    restart it?
    Are any query type in the SQL editor failing too?

    Romain

    On Thu, Aug 1, 2013 at 5:16 AM, Serega Sheypak wrote:

    Hi, suddenly we've met a problem.
    It's impossible to see the sample for the hive table.
    HUE UI exception is:


    OK
    FAILED: SemanticException org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out


    I can see the list of tables and columns for these tables.
    Here is a part from HUE server log:

    18:03:52.000 ERROR thrift_util


    Thrift saw exception (this may be expected).
    Traceback (most recent call last):
    File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/desktop/core/src/desktop/lib/thrift_util.py", line 338, in wrapper

    ret = res(*args, **kwargs)
    File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/../../gen-py/beeswaxd/BeeswaxService.py", line 142, in query
    return self.recv_query()

    File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/../../gen-py/beeswaxd/BeeswaxService.py", line 165, in recv_query
    raise result.error
    BeeswaxException: BeeswaxException(errorCode=0, log_context='5c379266-100c-43f6-bedb-2a7ae69f24d4', message='OK\nFAILED: SemanticException org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out\n', SQLState=' ', handle=QueryHandle(log_context='5c379266-100c-43f6-bedb-2a7ae69f24d4', id='5c379266-100c-43f6-bedb-2a7ae69f24d4'))

    18:03:52.000INFO thrift_util


    Thrift saw exception: BeeswaxException(errorCode=0, log_context='5c379266-100c-43f6-bedb-2a7ae69f24d4', message='OK\nFAILED: SemanticException org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out\n', SQLState=' ', handle=QueryHandle(log_context='5c379266-100c-43f6-bedb-2a7ae69f24d4', id='5c379266-100c-43f6-bedb-2a7ae69f24d4'))


    18:05:22.000 WARNING views


    Autocomplete data fetching error default.None: Bad status for request TGetTablesReq(schemaName=u'default', sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret='\xca\x1f\xa1\x04\xd0\xa1DA\x83~\xbb\xc9\x12\x9d\x82:', guid='\xa9WK&&FC\x87\xa4ua\x0bk/\x19\\')), tableName='.*', tableTypes=None, catalogName=None):

    TGetTablesResp(status=TStatus(errorCode=None, errorMessage='UncheckedExecutionException: java.lang.IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\nCAUSED BY: IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\nCAUSED BY: MetaException: Got exception: org.apache.thrift.transport.TTransportException null', sqlState='HY000', infoMessages=None, statusCode=3), operationHandle=TOperationHandle(hasResultSet=False, modifiedRowCount=None, operationType=4, operationId=THandleIdentifier(secret='', guid='')))

    18:05:22.000INFO middleware


    Processing exception: Exception("Bad status for request TGetTablesReq(schemaName=u'default', sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret='\\xca\\x1f\\xa1\\x04\\xd0\\xa1DA\\x83~\\xbb\\xc9\\x12\\x9d\\x82:', guid='\\xa9WK&&FC\\x87\\xa4ua\\x0bk/\\x19\\\\')), tableName='.*', tableTypes=None, catalogName=None):\nTGetTablesResp(status=TStatus(errorCode=None, errorMessage='UncheckedExecutionException: java.lang.IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\\nCAUSED BY: IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\\nCAUSED BY: MetaException: Got exception: org.apache.thrift.transport.TTransportException null', sqlState='HY000', infoMessages=None, statusCode=3), operationHandle=TOperationHandle(hasResultSet=False, modifiedRowCount=None, operationType=4, operationId=THandleIdentifier(secret='', guid='')))",) is not JSON serializable: Traceback (most recent call last):

    File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/core/handlers/base.py", line 100, in get_response
    response = callback(request, *callback_args, **callback_kwargs)

    File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/views.py", line 967, in autocomplete
    return HttpResponse(json.dumps(response), mimetype="application/json")

    File "/usr/lib64/python2.6/json/__init__.py", line 230, in dumps
    return _default_encoder.encode(obj)
    File "/usr/lib64/python2.6/json/encoder.py", line 367, in encode
    chunks = list(self.iterencode(o))

    File "/usr/lib64/python2.6/json/encoder.py", line 309, in _iterencode
    for chunk in self._iterencode_dict(o, markers):
    File "/usr/lib64/python2.6/json/encoder.py", line 275, in _iterencode_dict

    for chunk in self._iterencode(value, markers):
    File "/usr/lib64/python2.6/json/encoder.py", line 317, in _iterencode
    for chunk in self._iterencode_default(o, markers):
    File "/usr/lib64/python2.6/json/encoder.py", line 323, in _iterencode_default

    newobj = self.default(o)
    File "/usr/lib64/python2.6/json/encoder.py", line 344, in default
    raise TypeError(repr(o) + " is not JSON serializable")
    TypeError: Exception("Bad status for request TGetTablesReq(schemaName=u'default', sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret='\\xca\\x1f\\xa1\\x04\\xd0\\xa1DA\\x83~\\xbb\\xc9\\x12\\x9d\\x82:', guid='\\xa9WK&&FC\\x87\\xa4ua\\x0bk/\\x19\\\\')), tableName='.*', tableTypes=None, catalogName=None):\nTGetTablesResp(status=TStatus(errorCode=None, errorMessage='UncheckedExecutionException: java.lang.IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\\nCAUSED BY: IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\\nCAUSED BY: MetaException: Got exception: org.apache.thrift.transport.TTransportException null', sqlState='HY000', infoMessages=None, statusCode=3), operationHandle=TOperationHandle(hasResultSet=False, modifiedRowCount=None, operationType=4, operationId=THandleIdentifier(secret='', guid='')))",) is not JSON serializable



    [01/Aug/2013 16:12:59 +0000] models INFO Retrieving
    http://prod-node030.kyc.megafon.ru:50060/tasklog?attemptid=attempt_201307311025_0839_m_000000_0
    [01/Aug/2013 16:12:59 +0000] access INFO 10.66.49.145 hdfs -
    "GET /pig/watch/0000147-130731180329038-oozie-oozi-W HTTP/1.1"
    [01/Aug/2013 16:13:00 +0000] models INFO Retrieving
    http://prod-node030.kyc.megafon.ru:50060/tasklog?attemptid=attempt_201307311025_0839_m_000000_0
    [01/Aug/2013 16:13:01 +0000] access INFO 10.66.49.145 hdfs -
    "GET /pig/dashboard/ HTTP/1.1"
    [01/Aug/2013 16:13:01 +0000] access INFO 10.66.48.120 devops -
    "GET /beeswax/watch/json/1407 HTTP/1.1"
    [01/Aug/2013 16:13:01 +0000] access INFO 10.66.49.145 hdfs -
    "GET /pig/watch/0000147-130731180329038-oozie-oozi-W HTTP/1.1"
    [01/Aug/2013 16:13:02 +0000] access INFO 10.66.48.120 devops -
    "GET /beeswax/watch/json/1406 HTTP/1.1"
    [01/Aug/2013 16:13:03 +0000] models INFO Retrieving
    http://prod-node030.kyc.megafon.ru:50060/tasklog?attemptid=attempt_201307311025_0839_m_000000_0
    [01/Aug/2013 16:13:03 +0000] access INFO 10.66.48.120 devops -
    "GET /beeswax/watch/json/1407 HTTP/1.1"
    [01/Aug/2013 16:13:03 +0000] access INFO 10.66.48.120 devops -
    "GET /impala/watch/1408 HTTP/1.1"
    [01/Aug/2013 16:13:03 +0000] access INFO 10.66.49.145 hdfs -
    "GET /pig/watch/0000147-130731180329038-oozie-oozi-W HTTP/1.1"
    [01/Aug/2013 16:13:04 +0000] access INFO 10.66.48.120 devops -
    "GET /impala/results/1408/0 HTTP/1.1"
    [01/Aug/2013 16:13:04 +0000] access INFO 10.66.48.120 devops -
    "GET /beeswax/watch/json/1406 HTTP/1.1"
    [01/Aug/2013 16:13:04 +0000] thrift_util ERROR Thrift saw exception
    (this may be expected).
    Traceback (most recent call last):
    File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/desktop/core/src/desktop/lib/thrift_util.py",
    line 338, in wrapper
    ret = res(*args, **kwargs)
    File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/../../gen-py/TCLIService/TCLIService.py",
    line 634, in GetLog
    return self.recv_GetLog()
    File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/../../gen-py/TCLIService/TCLIService.py",
    line 650, in recv_GetLog
    raise x
    TApplicationException: Invalid method name: 'GetLog'
    [01/Aug/2013 16:13:04 +0000] thrift_util INFO Thrift saw an
    application exception: Invalid method name: 'GetLog'
    [01/Aug/2013 16:13:04 +0000] access INFO 10.66.48.120 devops -
    "GET /debug/check_config_ajax HTTP/1.1"


    How can we find the problem?
  • Serega Sheypak at Aug 1, 2013 at 7:27 pm
    1. Yes
    2. Yes
    3. I'm waiting for more than a minute and see the list of columns.
    [image: Встроенное изображение 1]


    Then I click Sample
    [image: Встроенное изображение 2]
    "Browse" (no the left side) is not working too.

    *Cannot read table*

    BeeswaxException(errorCode=0,
    log_context='8f667953-4245-452c-b03f-42526e251da2', message='OK\nFAILED:
    SemanticException org.apache.thrift.transport.TTransportException:
    java.net.SocketTimeoutException: Read timed out\n', SQLState=' ',
    handle=QueryHandle(log_context='8f667953-4245-452c-b03f-42526e251da2',
    id='8f667953-4245-452c-b03f-42526e251da2'))
      *I can query this table using HUE (beeswax), Hive2, Impala. Sometimes it
    works, sometimes not*
    *Hue log says:*
    [01/Aug/2013 23:21:29 +0000] middleware INFO Processing exception:
    database is locked: Traceback (most recent call last):
       File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/core/handlers/base.py",
    line 100, in get_response
         response = callback(request, *callback_args, **callback_kwargs)
       File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/views.py",
    line 60, in index
         return execute_query(request)
       File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/views.py",
    line 403, in execute_query
         design = save_design(request, form, query_type, design, explicit_save)
       File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/views.py",
    line 114, in save_design
         design.save()
       File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/db/models/base.py",
    line 434, in save
         self.save_base(using=using, force_insert=force_insert,
    force_update=force_update)
       File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/db/models/base.py",
    line 527, in save_base
         result = manager._insert(values, return_id=update_pk, using=using)
       File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/db/models/manager.py",
    line 195, in _insert
         return insert_query(self.model, values, **kwargs)
       File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/db/models/query.py",
    line 1479, in insert_query
         return query.get_compiler(using=using).execute_sql(return_id)
       File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/db/models/sql/compiler.py",
    line 783, in execute_sql
         cursor = super(SQLInsertCompiler, self).execute_sql(None)
       File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/db/models/sql/compiler.py",
    line 727, in execute_sql
         cursor.execute(sql, params)
       File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/db/backends/sqlite3/base.py",
    line 200, in execute
         return Database.Cursor.execute(self, query, params)
    DatabaseError: database is locked

    *It's not clear, what DB is locked - metastore DB or HUE dB?*
    *
    *
    Hive2, Beeswax servers keep silince. Looks like HUE talks about it's own DB.

    Our analysts say that it've been working 2 days ago without any problem. I
    didn't change something. It's production env.



    2013/8/1 Romain Rigaux <romain@cloudera.com>
    To be sure we understand:

    1. You are opening the Metastore App
    2. selecting sample_07 table
    3. click on browse data
    4. and get the timeout error?

    Beeswaxd is probably in a bad state: could you look at its log and maybe
    restart it?
    Are any query type in the SQL editor failing too?

    Romain

    On Thu, Aug 1, 2013 at 5:16 AM, Serega Sheypak wrote:

    Hi, suddenly we've met a problem.
    It's impossible to see the sample for the hive table.
    HUE UI exception is:


    OK
    FAILED: SemanticException org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out


    I can see the list of tables and columns for these tables.
    Here is a part from HUE server log:

    18:03:52.000 ERROR thrift_util


    Thrift saw exception (this may be expected).
    Traceback (most recent call last):
    File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/desktop/core/src/desktop/lib/thrift_util.py", line 338, in wrapper


    ret = res(*args, **kwargs)
    File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/../../gen-py/beeswaxd/BeeswaxService.py", line 142, in query
    return self.recv_query()


    File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/../../gen-py/beeswaxd/BeeswaxService.py", line 165, in recv_query
    raise result.error
    BeeswaxException: BeeswaxException(errorCode=0, log_context='5c379266-100c-43f6-bedb-2a7ae69f24d4', message='OK\nFAILED: SemanticException org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out\n', SQLState=' ', handle=QueryHandle(log_context='5c379266-100c-43f6-bedb-2a7ae69f24d4', id='5c379266-100c-43f6-bedb-2a7ae69f24d4'))

    18:03:52.000INFO thrift_util


    Thrift saw exception: BeeswaxException(errorCode=0, log_context='5c379266-100c-43f6-bedb-2a7ae69f24d4', message='OK\nFAILED: SemanticException org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out\n', SQLState=' ', handle=QueryHandle(log_context='5c379266-100c-43f6-bedb-2a7ae69f24d4', id='5c379266-100c-43f6-bedb-2a7ae69f24d4'))


    18:05:22.000 WARNING views


    Autocomplete data fetching error default.None: Bad status for request TGetTablesReq(schemaName=u'default', sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret='\xca\x1f\xa1\x04\xd0\xa1DA\x83~\xbb\xc9\x12\x9d\x82:', guid='\xa9WK&&FC\x87\xa4ua\x0bk/\x19\\')), tableName='.*', tableTypes=None, catalogName=None):


    TGetTablesResp(status=TStatus(errorCode=None, errorMessage='UncheckedExecutionException: java.lang.IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\nCAUSED BY: IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\nCAUSED BY: MetaException: Got exception: org.apache.thrift.transport.TTransportException null', sqlState='HY000', infoMessages=None, statusCode=3), operationHandle=TOperationHandle(hasResultSet=False, modifiedRowCount=None, operationType=4, operationId=THandleIdentifier(secret='', guid='')))

    18:05:22.000INFO middleware


    Processing exception: Exception("Bad status for request TGetTablesReq(schemaName=u'default', sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret='\\xca\\x1f\\xa1\\x04\\xd0\\xa1DA\\x83~\\xbb\\xc9\\x12\\x9d\\x82:', guid='\\xa9WK&&FC\\x87\\xa4ua\\x0bk/\\x19\\\\')), tableName='.*', tableTypes=None, catalogName=None):\nTGetTablesResp(status=TStatus(errorCode=None, errorMessage='UncheckedExecutionException: java.lang.IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\\nCAUSED BY: IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\\nCAUSED BY: MetaException: Got exception: org.apache.thrift.transport.TTransportException null', sqlState='HY000', infoMessages=None, statusCode=3), operationHandle=TOperationHandle(hasResultSet=False, modifiedRowCount=None, operationType=4, operationId=THandleIdentifier(secret='', guid='')))",) is not JSON serializable: Traceback (most recent call last):


    File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/core/handlers/base.py", line 100, in get_response
    response = callback(request, *callback_args, **callback_kwargs)


    File "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/views.py", line 967, in autocomplete
    return HttpResponse(json.dumps(response), mimetype="application/json")


    File "/usr/lib64/python2.6/json/__init__.py", line 230, in dumps
    return _default_encoder.encode(obj)
    File "/usr/lib64/python2.6/json/encoder.py", line 367, in encode
    chunks = list(self.iterencode(o))


    File "/usr/lib64/python2.6/json/encoder.py", line 309, in _iterencode
    for chunk in self._iterencode_dict(o, markers):
    File "/usr/lib64/python2.6/json/encoder.py", line 275, in _iterencode_dict


    for chunk in self._iterencode(value, markers):
    File "/usr/lib64/python2.6/json/encoder.py", line 317, in _iterencode
    for chunk in self._iterencode_default(o, markers):
    File "/usr/lib64/python2.6/json/encoder.py", line 323, in _iterencode_default


    newobj = self.default(o)
    File "/usr/lib64/python2.6/json/encoder.py", line 344, in default
    raise TypeError(repr(o) + " is not JSON serializable")
    TypeError: Exception("Bad status for request TGetTablesReq(schemaName=u'default', sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret='\\xca\\x1f\\xa1\\x04\\xd0\\xa1DA\\x83~\\xbb\\xc9\\x12\\x9d\\x82:', guid='\\xa9WK&&FC\\x87\\xa4ua\\x0bk/\\x19\\\\')), tableName='.*', tableTypes=None, catalogName=None):\nTGetTablesResp(status=TStatus(errorCode=None, errorMessage='UncheckedExecutionException: java.lang.IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\\nCAUSED BY: IllegalStateException: MetaException(message:Got exception: org.apache.thrift.transport.TTransportException null)\\nCAUSED BY: MetaException: Got exception: org.apache.thrift.transport.TTransportException null', sqlState='HY000', infoMessages=None, statusCode=3), operationHandle=TOperationHandle(hasResultSet=False, modifiedRowCount=None, operationType=4, operationId=THandleIdentifier(secret='', guid='')))",) is not JSON serializable




    [01/Aug/2013 16:12:59 +0000] models INFO Retrieving
    http://prod-node030.kyc.megafon.ru:50060/tasklog?attemptid=attempt_201307311025_0839_m_000000_0
    [01/Aug/2013 16:12:59 +0000] access INFO 10.66.49.145 hdfs -
    "GET /pig/watch/0000147-130731180329038-oozie-oozi-W HTTP/1.1"
    [01/Aug/2013 16:13:00 +0000] models INFO Retrieving
    http://prod-node030.kyc.megafon.ru:50060/tasklog?attemptid=attempt_201307311025_0839_m_000000_0
    [01/Aug/2013 16:13:01 +0000] access INFO 10.66.49.145 hdfs -
    "GET /pig/dashboard/ HTTP/1.1"
    [01/Aug/2013 16:13:01 +0000] access INFO 10.66.48.120 devops -
    "GET /beeswax/watch/json/1407 HTTP/1.1"
    [01/Aug/2013 16:13:01 +0000] access INFO 10.66.49.145 hdfs -
    "GET /pig/watch/0000147-130731180329038-oozie-oozi-W HTTP/1.1"
    [01/Aug/2013 16:13:02 +0000] access INFO 10.66.48.120 devops -
    "GET /beeswax/watch/json/1406 HTTP/1.1"
    [01/Aug/2013 16:13:03 +0000] models INFO Retrieving
    http://prod-node030.kyc.megafon.ru:50060/tasklog?attemptid=attempt_201307311025_0839_m_000000_0
    [01/Aug/2013 16:13:03 +0000] access INFO 10.66.48.120 devops -
    "GET /beeswax/watch/json/1407 HTTP/1.1"
    [01/Aug/2013 16:13:03 +0000] access INFO 10.66.48.120 devops -
    "GET /impala/watch/1408 HTTP/1.1"
    [01/Aug/2013 16:13:03 +0000] access INFO 10.66.49.145 hdfs -
    "GET /pig/watch/0000147-130731180329038-oozie-oozi-W HTTP/1.1"
    [01/Aug/2013 16:13:04 +0000] access INFO 10.66.48.120 devops -
    "GET /impala/results/1408/0 HTTP/1.1"
    [01/Aug/2013 16:13:04 +0000] access INFO 10.66.48.120 devops -
    "GET /beeswax/watch/json/1406 HTTP/1.1"
    [01/Aug/2013 16:13:04 +0000] thrift_util ERROR Thrift saw exception
    (this may be expected).
    Traceback (most recent call last):
    File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/desktop/core/src/desktop/lib/thrift_util.py",
    line 338, in wrapper
    ret = res(*args, **kwargs)
    File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/../../gen-py/TCLIService/TCLIService.py",
    line 634, in GetLog
    return self.recv_GetLog()
    File
    "/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/share/hue/apps/beeswax/src/beeswax/../../gen-py/TCLIService/TCLIService.py",
    line 650, in recv_GetLog
    raise x
    TApplicationException: Invalid method name: 'GetLog'
    [01/Aug/2013 16:13:04 +0000] thrift_util INFO Thrift saw an
    application exception: Invalid method name: 'GetLog'
    [01/Aug/2013 16:13:04 +0000] access INFO 10.66.48.120 devops -
    "GET /debug/check_config_ajax HTTP/1.1"


    How can we find the problem?

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedAug 1, '13 at 12:16p
activeAug 1, '13 at 7:27p
posts3
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Serega Sheypak: 2 posts Romain Rigaux: 1 post

People

Translate

site design / logo © 2022 Grokbase