Hi all,

We are using Rabbitmq 2.5 version and yesterday we found (a number of time) in the log file this entry:

=INFO REPORT==== 6-Oct-2011::14:58:13 ===
alarm_handler: {set,{file_descriptor_limit,[]}}

Finally it hit an error:

=ERROR REPORT==== 6-Oct-2011::14:58:13 ===
** Generic server msg_store_persistent terminating
** Last message in was {'$gen_cast',
{client_dying,
<<199,5,182,196,129,67,147,182,61,201,143,0,
51,197,190,234>>}}
** When Server state == {msstate,
"/var/lib/rabbitmq/mnesia/nodename/msg_store_persistent",
rabbit_msg_store_ets_index,
{state,520256,
"/var/lib/rabbitmq/mnesia/nodename/msg_store_persistent"},
22,#Ref<0.0.0.1817>,
{dict,0,16,16,8,80,48,
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],
[]},
{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],
[],[]}}},
[],undefined,589,5530342,[],<0.296.0>,524353,
516159,528450,
{set,19,16,16,8,80,48,
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],
....
** Reason for termination ==
** {{badmatch,false},
[{rabbit_msg_store_ets_index,insert,2},
{rabbit_msg_store,write_message,3},
{rabbit_msg_store,handle_cast,2},
{gen_server2,handle_msg,2},
{proc_lib,wake_up,3}]}

=INFO REPORT==== 6-Oct-2011::14:58:14 ===
stopped TCP Listener on [::]:5672

Right after this, rabbitmq closed the listener socket and did not recover. The service kept running without accepting any connections, to fix the problem we needed to restart the service.
What can be happened?

I have got another question: when I run the rabbitmqctl list_queues consumers the number of the consumers how is it calculate?
There is a "live" calculation or the information are stored somewhere and refreshed after "n" seconds?
I've got a queue with a single consumer and sometimes (I don't know why!) the consumer disappears, to detect that there is a script running which uses rabbitmqctl list_queues command but It can detect this situation with a delay of about 10-15 minutes even if the script runs every minute.

Best Regards
--
Andrea Rosa



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20111007/cc49608b/attachment.htm>

Search Discussions

  • Eugene Kirpichov at Oct 7, 2011 at 8:41 am
    Hi Andrea,

    I had exactly the same problem once. Search the mailing list.
    I believe it has since been fixed in later versions of RabbitMQ.
    On Fri, Oct 7, 2011 at 12:08 PM, Rosa, Andrea wrote:
    Hi all,



    We are using Rabbitmq 2.5 version and yesterday we found (a number of time)
    in the log file this entry:

    =INFO REPORT==== 6-Oct-2011::14:58:13 ===
    ????alarm_handler: {set,{file_descriptor_limit,[]}}

    Finally it hit an error:

    =ERROR REPORT==== 6-Oct-2011::14:58:13 ===
    ** Generic server msg_store_persistent terminating
    ** Last message in was {'$gen_cast',
    ???????????????????????????{client_dying,
    ???????????????????????????????<<199,5,182,196,129,67,147,182,61,201,143,0,
    ?????????????????????????????????51,197,190,234>>}}
    ** When Server state == {msstate,
    ????????????????????????????"/var/lib/rabbitmq/mnesia/nodename/msg_store_persistent",
    ????????????????????????????rabbit_msg_store_ets_index,
    ????????????????????????????{state,520256,
    ????????????????????????????????"/var/lib/rabbitmq/mnesia/nodename/msg_store_persistent"},
    ????????????????????????????22,#Ref<0.0.0.1817>,
    ????????????????????????????{dict,0,16,16,8,80,48,
    ????????????????????????????????{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],
    ?????????????????????????????????[]},
    ????????????????????????????????{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],
    ??????????????????????????????????[],[]}}},
    ????????????????????????????[],undefined,589,5530342,[],<0.296.0>,524353,
    ????????????????????????????516159,528450,
    ????????????????????????????{set,19,16,16,8,80,48,
    ????????????????????????????????{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],
    ????????????????????????....
    ** Reason for termination ==
    ** {{badmatch,false},
    ????[{rabbit_msg_store_ets_index,insert,2},
    ?????{rabbit_msg_store,write_message,3},
    ?????{rabbit_msg_store,handle_cast,2},
    ?????{gen_server2,handle_msg,2},
    ?????{proc_lib,wake_up,3}]}

    =INFO REPORT==== 6-Oct-2011::14:58:14 ===
    stopped TCP Listener on [::]:5672



    Right after this, rabbitmq closed the listener socket and did not recover.
    The service kept running without accepting any connections, to fix the
    problem we needed to restart the service.

    What can be happened?



    I have got another question: when I run the rabbitmqctl list_queues
    consumers the number of the consumers how is it calculate?

    There is a ?live? calculation or the information are stored somewhere and
    refreshed after ?n? seconds?

    I?ve got a queue with a single consumer and sometimes (I don?t know why!)
    the consumer disappears, to detect that there is a script running which uses
    rabbitmqctl list_queues command but It can detect this situation with a
    delay of about 10-15 minutes even if the script ?runs every minute.



    Best Regards

    --

    Andrea Rosa







    _______________________________________________
    rabbitmq-discuss mailing list
    rabbitmq-discuss at lists.rabbitmq.com
    https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss


    --
    Eugene Kirpichov
    Principal Engineer, Mirantis Inc. http://www.mirantis.com/
    Editor, http://fprog.ru/
  • Eugene Kirpichov at Oct 7, 2011 at 8:41 am
    You can search for ets_index insert, I believe.
    On Fri, Oct 7, 2011 at 12:41 PM, Eugene Kirpichov wrote:
    Hi Andrea,

    I had exactly the same problem once. Search the mailing list.
    I believe it has since been fixed in later versions of RabbitMQ.
    On Fri, Oct 7, 2011 at 12:08 PM, Rosa, Andrea wrote:
    Hi all,



    We are using Rabbitmq 2.5 version and yesterday we found (a number of time)
    in the log file this entry:

    =INFO REPORT==== 6-Oct-2011::14:58:13 ===
    ????alarm_handler: {set,{file_descriptor_limit,[]}}

    Finally it hit an error:

    =ERROR REPORT==== 6-Oct-2011::14:58:13 ===
    ** Generic server msg_store_persistent terminating
    ** Last message in was {'$gen_cast',
    ???????????????????????????{client_dying,
    ???????????????????????????????<<199,5,182,196,129,67,147,182,61,201,143,0,
    ?????????????????????????????????51,197,190,234>>}}
    ** When Server state == {msstate,
    ????????????????????????????"/var/lib/rabbitmq/mnesia/nodename/msg_store_persistent",
    ????????????????????????????rabbit_msg_store_ets_index,
    ????????????????????????????{state,520256,
    ????????????????????????????????"/var/lib/rabbitmq/mnesia/nodename/msg_store_persistent"},
    ????????????????????????????22,#Ref<0.0.0.1817>,
    ????????????????????????????{dict,0,16,16,8,80,48,
    ????????????????????????????????{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],
    ?????????????????????????????????[]},
    ????????????????????????????????{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],
    ??????????????????????????????????[],[]}}},
    ????????????????????????????[],undefined,589,5530342,[],<0.296.0>,524353,
    ????????????????????????????516159,528450,
    ????????????????????????????{set,19,16,16,8,80,48,
    ????????????????????????????????{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],
    ????????????????????????....
    ** Reason for termination ==
    ** {{badmatch,false},
    ????[{rabbit_msg_store_ets_index,insert,2},
    ?????{rabbit_msg_store,write_message,3},
    ?????{rabbit_msg_store,handle_cast,2},
    ?????{gen_server2,handle_msg,2},
    ?????{proc_lib,wake_up,3}]}

    =INFO REPORT==== 6-Oct-2011::14:58:14 ===
    stopped TCP Listener on [::]:5672



    Right after this, rabbitmq closed the listener socket and did not recover.
    The service kept running without accepting any connections, to fix the
    problem we needed to restart the service.

    What can be happened?



    I have got another question: when I run the rabbitmqctl list_queues
    consumers the number of the consumers how is it calculate?

    There is a ?live? calculation or the information are stored somewhere and
    refreshed after ?n? seconds?

    I?ve got a queue with a single consumer and sometimes (I don?t know why!)
    the consumer disappears, to detect that there is a script running which uses
    rabbitmqctl list_queues command but It can detect this situation with a
    delay of about 10-15 minutes even if the script ?runs every minute.



    Best Regards

    --

    Andrea Rosa







    _______________________________________________
    rabbitmq-discuss mailing list
    rabbitmq-discuss at lists.rabbitmq.com
    https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss


    --
    Eugene Kirpichov
    Principal Engineer, Mirantis Inc. http://www.mirantis.com/
    Editor, http://fprog.ru/


    --
    Eugene Kirpichov
    Principal Engineer, Mirantis Inc. http://www.mirantis.com/
    Editor, http://fprog.ru/
  • Matthias Radestock at Oct 7, 2011 at 8:47 am

    On 07/10/11 09:41, Eugene Kirpichov wrote:
    You can search for ets_index insert, I believe.
    Indeed.

    http://old.nabble.com/RabbitMQ-crashed-in-ets%3Ainsert_new---looks-like-a-genuine-bug...-td32246609.html#a32247878

    Fixed in 2.6.x


    Matthias.
  • Rosa, Andrea at Oct 7, 2011 at 10:00 am
    Thank you for your kind reply!
    Someone can give me more information about consumers issue:
    I have got another question: when I run the rabbitmqctl list_queues consumers the number of the consumers how is it calculate?
    There is a "live" calculation or the information are stored somewhere and refreshed after "n" seconds?
    I've got a queue with a single consumer and sometimes (I don't know why!) the consumer disappears, to detect that there is a script running which uses rabbitmqctl list_queues command but It can detect this situation with a delay of about 10-15 minutes even if the script runs every minute.

    Cheers
    --
    Andrea
    -----Original Message-----
    From: Matthias Radestock [mailto:matthias at rabbitmq.com]
    Sent: 07 October 2011 09:48
    To: Eugene Kirpichov
    Cc: Rosa, Andrea; rabbitmq-discuss at lists.rabbitmq.com
    Subject: Re: [rabbitmq-discuss] Rabbitmq Crash and number of consumers
    On 07/10/11 09:41, Eugene Kirpichov wrote:
    You can search for ets_index insert, I believe.
    Indeed.

    http://old.nabble.com/RabbitMQ-crashed-in-ets%3Ainsert_new---looks-
    like-a-genuine-bug...-td32246609.html#a32247878

    Fixed in 2.6.x


    Matthias.
  • Matthias Radestock at Oct 7, 2011 at 10:05 am

    On 07/10/11 11:00, Rosa, Andrea wrote:
    when I run the rabbitmqctl list_queues consumers the number of the
    consumers how is it calculate? There is a "live" calculation or the
    information are stored somewhere and refreshed after "n" seconds?
    It's "live".

    Matthias.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouprabbitmq-discuss @
categoriesrabbitmq
postedOct 7, '11 at 8:08a
activeOct 7, '11 at 10:05a
posts6
users3
websiterabbitmq.com
irc#rabbitmq

People

Translate

site design / logo © 2022 Grokbase