FAQ
Hi,

Could you be a bit more specific? What apps in Hue do you normally use?

-Abe

On Fri, Jun 28, 2013 at 1:39 AM, Serega Sheypak wrote:

We use CM 4.6, CDH 4.3.0., we see serious perfomance degradation.
What can we try to fix it?
Hue is running on VM with 16GB mem and 2 cores.

понедельник, 19 марта 2012 г., 6:21:16 UTC+4 пользователь AIR написал:
thank you , I will try it !

在 2012年3月17日 上午12:40,bc Wong <bcwa...@cloudera.com>写道:
On Mar 15, 4:07 am, air wrote:
we deploy hue for our analysts, but there seems a performance issue:

first of all, hue service running as a python2.4 process in the system:

*28208 hue 22 0 279m 112m 5412 S 59.7 0.5 2015:06
/usr/share/hue/build/env/bin/**python2.4 -c import sys; from spawning import
spawnin*

and when some(about 8) people use it at the same time, it seems that hue
service becomes slow. (when look at the process using top, the CPU usage of
the process proceeds 100% )

what I want to know is : is there any way that I can start several hue
service processes in the system to get a better performance ?
Thanks for the report. It could be due to https://issues.cloudera.org/**
browse/HUE-627 <https://issues.cloudera.org/browse/HUE-627>.
Could you change the config and see whether it still happens?

Cheers,
bc
thank you in advance.
--
不学习,不知道


--
不学习,不知道

--
---
You received this message because you are subscribed to the Google Groups
"CDH Users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to cdh-user+unsubscribe@cloudera.org.
For more options, visit
https://groups.google.com/a/cloudera.org/groups/opt_out.

Search Discussions

  • Serega Sheypak at Jul 1, 2013 at 6:27 am
    Hi.
    We have not more than 3-5 concurrent users. 5 concurrent users is
    very-very-very rare situation.
    1. Filebrowser works very slow. Looks like AJAX query (the list of ifiles,
    folders) takes much time (more than 15 seconds)
    2. "Metadata store" pages with table metadata renders for more than 15-30
    seconds.
    3. Hive, Impala "Qeury edtior" can also be very-slow.
    4. Pig is fast :) Pig is flying
    5. Hue "first page" can be rendered for more than 15 seconds.

    Here is the conf file:
    [desktop]
    secret_key=jexqkR1oBzxKkup2iimUfn7H3ocKfZ
    http_host=prod-beeswax.lol.ru
    http_port=8888
    time_zone=Europe/Moscow
    django_debug_mode=0
    http_500_debug_mode=0
    cherrypy_server_threads=30
    default_site_encoding=utf
    whitelist=(localhost|127\.0\.0\.1):(50030|50070|50060|50075)
    blacklist=()
    [[auth]]
    user_augmentor=desktop.auth.backend.DefaultUserAugmentor
    backend=desktop.auth.backend.AllowFirstUserDjangoBackend
    [[ldap]]
    [[[users]]]
    [[[groups]]]
    [[database]]
    engine=sqlite3
    host=localhost
    port=3306
    user=hue
    password=
    name=/var/lib/hue/desktop.db
    [[smtp]]
    host=localhost
    port=25
    user=
    password=
    tls=no
    [[kerberos]]
    [hadoop]
    [[hdfs_clusters]]
    [[[default]]]
    fs_defaultfs=hdfs://nameservice1
    webhdfs_url=http://prod-node022.lol.ru:14000/webhdfs/v1
    hadoop_hdfs_home={{HADOOP_HDFS_HOME}}
    hadoop_bin={{HADOOP_BIN}}
    hadoop_conf_dir={{HADOOP_CONF_DIR}}
    security_enabled=false
    temp_dir=/tmp
    [[mapred_clusters]]
    [[[default]]]
    jobtracker_host=prod-node016.lol.ru
    thrift_port=9290
    jobtracker_port=8021
    submit_to=true
    hadoop_mapred_home={{HADOOP_MR1_HOME}}
    hadoop_bin={{HADOOP_BIN}}
    hadoop_conf_dir={{HADOOP_CONF_DIR}}
    security_enabled=false
    [beeswax]
    beeswax_server_host=prod-beeswax.lol.ru
    beeswax_meta_server_port=8003
    beeswax_server_port=8002
    beeswax_server_conn_timeout=120
    metastore_conn_timeout=10
    beeswax_server_heapsize=1024
    [jobsub]
    remote_data_dir=/user/hue/jobsub
    oozie_url=http://prod-oozie.lol.ru:11000/oozie
    security_enabled=false
    [useradmin]
    [impala]
    server_host=prod-node012.lol.ru
    server_port=21000
    [shell]
    [[ shelltypes ]]
    [[[ pig ]]]
    nice_name="Pig Shell (Grunt)"
    command="{{PIG_SCRIPT_HOME}}/bin/pig -l /dev/null"
    help="The command-line interpreter for Pig"
    [[[[ environment ]]]]
    [[[[[ JAVA_HOME ]]]]]
    value="{{JAVA_HOME}}"
    [[[[[ HADOOP_CONF_DIR ]]]]]
    value="{{HADOOP_CONF_DIR}}"


    2013/6/28 Abraham Elmahrek <abe@cloudera.com>
    Hi,

    Could you be a bit more specific? What apps in Hue do you normally use?

    -Abe

    On Fri, Jun 28, 2013 at 1:39 AM, Serega Sheypak wrote:

    We use CM 4.6, CDH 4.3.0., we see serious perfomance degradation.
    What can we try to fix it?
    Hue is running on VM with 16GB mem and 2 cores.

    понедельник, 19 марта 2012 г., 6:21:16 UTC+4 пользователь AIR написал:
    thank you , I will try it !

    在 2012年3月17日 上午12:40,bc Wong <bcwa...@cloudera.com>写道:
    On Mar 15, 4:07 am, air wrote:
    we deploy hue for our analysts, but there seems a performance issue:

    first of all, hue service running as a python2.4 process in the system:
    *28208 hue 22 0 279m 112m 5412 S 59.7 0.5 2015:06
    /usr/share/hue/build/env/bin/**python2.4 -c import sys; from
    spawning import
    spawnin*

    and when some(about 8) people use it at the same time, it seems that hue
    service becomes slow. (when look at the process using top, the CPU usage of
    the process proceeds 100% )

    what I want to know is : is there any way that I can start several hue
    service processes in the system to get a better performance ?
    Thanks for the report. It could be due to https://issues.cloudera.org/*
    *browse/HUE-627 <https://issues.cloudera.org/browse/HUE-627>.
    Could you change the config and see whether it still happens?

    Cheers,
    bc
    thank you in advance.
    --
    不学习,不知道


    --
    不学习,不知道

    --
    ---
    You received this message because you are subscribed to the Google Groups
    "CDH Users" group.
    To unsubscribe from this group and stop receiving emails from it, send an
    email to cdh-user+unsubscribe@cloudera.org.
    For more options, visit
    https://groups.google.com/a/cloudera.org/groups/opt_out.

    --

    ---
    You received this message because you are subscribed to a topic in the
    Google Groups "CDH Users" group.
    To unsubscribe from this topic, visit
    https://groups.google.com/a/cloudera.org/d/topic/cdh-user/Xzd8kCQ6hQU/unsubscribe
    .
    To unsubscribe from this group and all its topics, send an email to
    cdh-user+unsubscribe@cloudera.org.
    For more options, visit
    https://groups.google.com/a/cloudera.org/groups/opt_out.

  • Romain Rigaux at Jul 1, 2013 at 10:34 pm
    Concurrency should not be the problem. We have setups with 100 users.

    However, maybe the number of elements to display is large. e.g. thousands
    of files...

    Let's start with #1. I sent an email about this in the other thread.

    #2 How many tables does it display? I guess that the Hive metastore is
    backed with MySql? Same with Hue, are you using MySql?

    #3 is probably related to #2

    #4 does all the checks for all the components. This can be slow. I created
    https://issues.cloudera.org/browse/HUE-1367 for improving the UX.

    Romain


    On Sun, Jun 30, 2013 at 11:27 PM, Serega Sheypak
    wrote:
    Hi.
    We have not more than 3-5 concurrent users. 5 concurrent users is
    very-very-very rare situation.
    1. Filebrowser works very slow. Looks like AJAX query (the list of ifiles,
    folders) takes much time (more than 15 seconds)
    2. "Metadata store" pages with table metadata renders for more than 15-30
    seconds.
    3. Hive, Impala "Qeury edtior" can also be very-slow.
    4. Pig is fast :) Pig is flying
    5. Hue "first page" can be rendered for more than 15 seconds.

    Here is the conf file:
    [desktop]
    secret_key=jexqkR1oBzxKkup2iimUfn7H3ocKfZ
    http_host=prod-beeswax.lol.ru
    http_port=8888
    time_zone=Europe/Moscow
    django_debug_mode=0
    http_500_debug_mode=0
    cherrypy_server_threads=30
    default_site_encoding=utf
    whitelist=(localhost|127\.0\.0\.1):(50030|50070|50060|50075)
    blacklist=()
    [[auth]]
    user_augmentor=desktop.auth.backend.DefaultUserAugmentor
    backend=desktop.auth.backend.AllowFirstUserDjangoBackend
    [[ldap]]
    [[[users]]]
    [[[groups]]]
    [[database]]
    engine=sqlite3
    host=localhost
    port=3306
    user=hue
    password=
    name=/var/lib/hue/desktop.db
    [[smtp]]
    host=localhost
    port=25
    user=
    password=
    tls=no
    [[kerberos]]
    [hadoop]
    [[hdfs_clusters]]
    [[[default]]]
    fs_defaultfs=hdfs://nameservice1
    webhdfs_url=http://prod-node022.lol.ru:14000/webhdfs/v1
    hadoop_hdfs_home={{HADOOP_HDFS_HOME}}
    hadoop_bin={{HADOOP_BIN}}
    hadoop_conf_dir={{HADOOP_CONF_DIR}}
    security_enabled=false
    temp_dir=/tmp
    [[mapred_clusters]]
    [[[default]]]
    jobtracker_host=prod-node016.lol.ru
    thrift_port=9290
    jobtracker_port=8021
    submit_to=true
    hadoop_mapred_home={{HADOOP_MR1_HOME}}
    hadoop_bin={{HADOOP_BIN}}
    hadoop_conf_dir={{HADOOP_CONF_DIR}}
    security_enabled=false
    [beeswax]
    beeswax_server_host=prod-beeswax.lol.ru
    beeswax_meta_server_port=8003
    beeswax_server_port=8002
    beeswax_server_conn_timeout=120
    metastore_conn_timeout=10
    beeswax_server_heapsize=1024
    [jobsub]
    remote_data_dir=/user/hue/jobsub
    oozie_url=http://prod-oozie.lol.ru:11000/oozie
    security_enabled=false
    [useradmin]
    [impala]
    server_host=prod-node012.lol.ru
    server_port=21000
    [shell]
    [[ shelltypes ]]
    [[[ pig ]]]
    nice_name="Pig Shell (Grunt)"
    command="{{PIG_SCRIPT_HOME}}/bin/pig -l /dev/null"
    help="The command-line interpreter for Pig"
    [[[[ environment ]]]]
    [[[[[ JAVA_HOME ]]]]]
    value="{{JAVA_HOME}}"
    [[[[[ HADOOP_CONF_DIR ]]]]]
    value="{{HADOOP_CONF_DIR}}"


    2013/6/28 Abraham Elmahrek <abe@cloudera.com>
    Hi,

    Could you be a bit more specific? What apps in Hue do you normally use?

    -Abe


    On Fri, Jun 28, 2013 at 1:39 AM, Serega Sheypak <serega.sheypak@gmail.com
    wrote:
    We use CM 4.6, CDH 4.3.0., we see serious perfomance degradation.
    What can we try to fix it?
    Hue is running on VM with 16GB mem and 2 cores.

    понедельник, 19 марта 2012 г., 6:21:16 UTC+4 пользователь AIR написал:
    thank you , I will try it !

    在 2012年3月17日 上午12:40,bc Wong <bcwa...@cloudera.com>写道:
    On Mar 15, 4:07 am, air wrote:
    we deploy hue for our analysts, but there seems a performance issue:

    first of all, hue service running as a python2.4 process in the system:
    *28208 hue 22 0 279m 112m 5412 S 59.7 0.5 2015:06
    /usr/share/hue/build/env/bin/**python2.4 -c import sys; from
    spawning import
    spawnin*

    and when some(about 8) people use it at the same time, it seems that hue
    service becomes slow. (when look at the process using top, the CPU usage of
    the process proceeds 100% )

    what I want to know is : is there any way that I can start several hue
    service processes in the system to get a better performance ?
    Thanks for the report. It could be due to https://issues.cloudera.org/
    **browse/HUE-627 <https://issues.cloudera.org/browse/HUE-627>.
    Could you change the config and see whether it still happens?

    Cheers,
    bc
    thank you in advance.
    --
    不学习,不知道


    --
    不学习,不知道

    --
    ---
    You received this message because you are subscribed to the Google
    Groups "CDH Users" group.
    To unsubscribe from this group and stop receiving emails from it, send
    an email to cdh-user+unsubscribe@cloudera.org.
    For more options, visit
    https://groups.google.com/a/cloudera.org/groups/opt_out.

    --

    ---
    You received this message because you are subscribed to a topic in the
    Google Groups "CDH Users" group.
    To unsubscribe from this topic, visit
    https://groups.google.com/a/cloudera.org/d/topic/cdh-user/Xzd8kCQ6hQU/unsubscribe
    .
    To unsubscribe from this group and all its topics, send an email to
    cdh-user+unsubscribe@cloudera.org.

    For more options, visit
    https://groups.google.com/a/cloudera.org/groups/opt_out.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphue-user @
categorieshadoop
postedJun 28, '13 at 3:50p
activeJul 1, '13 at 10:34p
posts3
users3
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase