FAQ
Hi All,

We are currently using map/reduce for doing aggregation for our
project.But suddenly customer wants to group by dynamic parameters
which is so slow while implemented using Map/Reduce. We read about the
new aggregation framework gonna be release part of 2.1.0.

Could this aggregation framework be used for real time querying? What
would be the performance comparing to sql for a given set of records.?

we are thinking of going to sql again (though we have to do lot of
database schema management) because of this new requirement (also
expecting more requirements asking for real time aggregation with
dynamic parameters).

Could someone please throw some light on this?

Regards,
Nedu

--
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To post to this group, send email to mongodb-user@googlegroups.com.
To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.

Search Discussions

  • Eliot Horowitz at Mar 27, 2012 at 5:12 am
    It is likely fast enough for real time querying.
    It is available in 2.1.0 currently (a dev release) so the best thing
    to do is benchmark it for your use case.
    On Tue, Mar 27, 2012 at 1:10 AM, Nedu wrote:
    Hi All,

    We are currently using map/reduce for doing aggregation for our
    project.But suddenly customer wants to group by dynamic parameters
    which is so slow while implemented using Map/Reduce. We read about the
    new aggregation framework gonna be release part of 2.1.0.

    Could this aggregation framework be used for real time querying? What
    would be the performance comparing to sql for a given set of records.?

    we are thinking of going to sql again (though we have to do lot of
    database schema management) because of this new requirement (also
    expecting more requirements asking for real time aggregation with
    dynamic parameters).

    Could someone please throw some light on this?

    Regards,
    Nedu

    --
    You received this message because you are subscribed to the Google Groups "mongodb-user" group.
    To post to this group, send email to mongodb-user@googlegroups.com.
    To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com.
    For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
    --
    You received this message because you are subscribed to the Google Groups "mongodb-user" group.
    To post to this group, send email to mongodb-user@googlegroups.com.
    To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com.
    For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
  • Richard Thomas at Mar 27, 2012 at 10:11 am
    Please let us know how you get on with your benchmarking!
    On Tuesday, March 27, 2012 7:10:47 AM UTC+2, Nedu wrote:

    Hi All,

    We are currently using map/reduce for doing aggregation for our
    project.But suddenly customer wants to group by dynamic parameters
    which is so slow while implemented using Map/Reduce. We read about the
    new aggregation framework gonna be release part of 2.1.0.

    Could this aggregation framework be used for real time querying? What
    would be the performance comparing to sql for a given set of records.?

    we are thinking of going to sql again (though we have to do lot of
    database schema management) because of this new requirement (also
    expecting more requirements asking for real time aggregation with
    dynamic parameters).

    Could someone please throw some light on this?

    Regards,
    Nedu
    --
    You received this message because you are subscribed to the Google Groups "mongodb-user" group.
    To view this discussion on the web visit https://groups.google.com/d/msg/mongodb-user/-/KMV7w7XvsGcJ.
    To post to this group, send email to mongodb-user@googlegroups.com.
    To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com.
    For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
  • Angelo Immediata at Mar 27, 2012 at 4:27 pm
    Hi

    I don't know if this can be useful.

    We did a little banchmark between the new aggregation framework and the old
    one using 3 millions of records
    Well with the new aggregation framework grouping on 3 millions of records
    takes around 60 seconds while with the old way it takes around 90 seconds.

    Angelo
    Il giorno 27 marzo 2012 10:22, Richard Thomas <richiethom@gmail.com> ha
    scritto:
    Please let us know how you get on with your benchmarking!

    On Tuesday, March 27, 2012 7:10:47 AM UTC+2, Nedu wrote:

    Hi All,

    We are currently using map/reduce for doing aggregation for our
    project.But suddenly customer wants to group by dynamic parameters
    which is so slow while implemented using Map/Reduce. We read about the
    new aggregation framework gonna be release part of 2.1.0.

    Could this aggregation framework be used for real time querying? What
    would be the performance comparing to sql for a given set of records.?

    we are thinking of going to sql again (though we have to do lot of
    database schema management) because of this new requirement (also
    expecting more requirements asking for real time aggregation with
    dynamic parameters).

    Could someone please throw some light on this?

    Regards,
    Nedu
    --
    You received this message because you are subscribed to the Google Groups
    "mongodb-user" group.
    To view this discussion on the web visit
    https://groups.google.com/d/msg/mongodb-user/-/KMV7w7XvsGcJ.

    To post to this group, send email to mongodb-user@googlegroups.com.
    To unsubscribe from this group, send email to
    mongodb-user+unsubscribe@googlegroups.com.
    For more options, visit this group at
    http://groups.google.com/group/mongodb-user?hl=en.


    --
    ------------------------------

    *Angelo Immediata, PMP*
    Solution Architect
    angeloimm@gmail.com

    Via Cap. Francesco Carillo - 26, 84013 Cava dei Tirreni
    Mob. +39-3284332259

    Le informazioni trasmesse sono destinate esclusivamente alla persona o alla
    società in indirizzo e sono da intendersi confidenziali e riservate. Ogni
    trasmissione, inoltro, diffusione o altro uso di queste informazioni a
    persone o società differenti dal destinatario è proibita. Se ricevete
    questa comunicazione per errore, contattate il mittente e cancellate le
    informazioni da ogni computer.
    The information transmitted is intended only for the person or entity to
    which it is addressed and may contain confidential and/or privileged
    material. Any review, retransmission, dissemination or other use of, or
    taking of any action in reliance upon, this information by persons or
    entities other than the intended recipient is prohibited. If you received
    this in error, please contact the sender and delete the material from any
    computer.

    --
    You received this message because you are subscribed to the Google Groups "mongodb-user" group.
    To post to this group, send email to mongodb-user@googlegroups.com.
    To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com.
    For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
  • Adam C at Mar 30, 2012 at 2:17 pm
    Can you post the queries you were running and a sample document structure
    so we can see what the tests were doing?

    Adam
    On Tuesday, March 27, 2012 5:27:41 PM UTC+1, Angelo Immediata wrote:

    Hi

    I don't know if this can be useful.

    We did a little banchmark between the new aggregation framework and the
    old one using 3 millions of records
    Well with the new aggregation framework grouping on 3 millions of records
    takes around 60 seconds while with the old way it takes around 90 seconds.

    Angelo
    Il giorno 27 marzo 2012 10:22, Richard Thomas <richiethom@gmail.com> ha
    scritto:
    Please let us know how you get on with your benchmarking!

    On Tuesday, March 27, 2012 7:10:47 AM UTC+2, Nedu wrote:

    Hi All,

    We are currently using map/reduce for doing aggregation for our
    project.But suddenly customer wants to group by dynamic parameters
    which is so slow while implemented using Map/Reduce. We read about the
    new aggregation framework gonna be release part of 2.1.0.

    Could this aggregation framework be used for real time querying? What
    would be the performance comparing to sql for a given set of records.?

    we are thinking of going to sql again (though we have to do lot of
    database schema management) because of this new requirement (also
    expecting more requirements asking for real time aggregation with
    dynamic parameters).

    Could someone please throw some light on this?

    Regards,
    Nedu
    --
    You received this message because you are subscribed to the Google Groups
    "mongodb-user" group.
    To view this discussion on the web visit
    https://groups.google.com/d/msg/mongodb-user/-/KMV7w7XvsGcJ.

    To post to this group, send email to mongodb-user@googlegroups.com.
    To unsubscribe from this group, send email to
    mongodb-user+unsubscribe@googlegroups.com.
    For more options, visit this group at
    http://groups.google.com/group/mongodb-user?hl=en.


    --
    ------------------------------

    *Angelo Immediata, PMP*
    Solution Architect
    angeloimm@gmail.com

    Via Cap. Francesco Carillo - 26, 84013 Cava dei Tirreni
    Mob. +39-3284332259

    Le informazioni trasmesse sono destinate esclusivamente alla persona o
    alla società in indirizzo e sono da intendersi confidenziali e riservate.
    Ogni trasmissione, inoltro, diffusione o altro uso di queste informazioni a
    persone o società differenti dal destinatario è proibita. Se ricevete
    questa comunicazione per errore, contattate il mittente e cancellate le
    informazioni da ogni computer.
    The information transmitted is intended only for the person or entity to
    which it is addressed and may contain confidential and/or privileged
    material. Any review, retransmission, dissemination or other use of, or
    taking of any action in reliance upon, this information by persons or
    entities other than the intended recipient is prohibited. If you received
    this in error, please contact the sender and delete the material from any
    computer.
    --
    You received this message because you are subscribed to the Google Groups "mongodb-user" group.
    To view this discussion on the web visit https://groups.google.com/d/msg/mongodb-user/-/CpTKr7KILRsJ.
    To post to this group, send email to mongodb-user@googlegroups.com.
    To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com.
    For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
  • Nedu at Mar 30, 2012 at 6:25 pm
    Hi All,
    Thanks for all your response. It gives us confidence to move with
    mongo itself. However we will do the testing once.
    We are currently into an urgent issue which made us to push to back
    seat. Will post the queries shortly
    On Mar 30, 10:17 am, Adam C wrote:
    Can you post the queries you were running and a sample document structure
    so we can see what the tests were doing?

    Adam






    On Tuesday, March 27, 2012 5:27:41 PM UTC+1, Angelo Immediata wrote:

    Hi
    I don't know if this can be useful.
    We did a little banchmark between the new aggregation framework and the
    old one using 3 millions of records
    Well with the new aggregation framework grouping on 3 millions of records
    takes around 60 seconds while with the old way it takes around 90 seconds.
    Angelo
    Il giorno 27 marzo 2012 10:22, Richard Thomas <richiet...@gmail.com> ha
    scritto:
    Please let us know how you get on with your benchmarking!
    On Tuesday, March 27, 2012 7:10:47 AM UTC+2, Nedu wrote:

    Hi All,
    We are currently using map/reduce for doing aggregation for our
    project.But suddenly customer wants to group by dynamic parameters
    which is so slow while implemented using Map/Reduce. We read about the
    new aggregation framework gonna be release part of 2.1.0.
    Could this aggregation framework be used for real time querying? What
    would be the performance comparing to sql for a given set of records.?
    we are thinking of going to sql again (though we have to do lot of
    database schema management) because of this new requirement (also
    expecting more requirements asking for real time aggregation with
    dynamic parameters).
    Could someone please throw some light on this?
    Regards,
    Nedu
    --
    You received this message because you are subscribed to the Google Groups
    "mongodb-user" group.
    To view this discussion on the web visit
    https://groups.google.com/d/msg/mongodb-user/-/KMV7w7XvsGcJ.
    To post to this group, send email to mongodb-user@googlegroups.com.
    To unsubscribe from this group, send email to
    mongodb-user+unsubscribe@googlegroups.com.
    For more options, visit this group at
    http://groups.google.com/group/mongodb-user?hl=en.
    --
    ------------------------------
    *Angelo Immediata, PMP*
    Solution Architect
    angelo...@gmail.com
    Via Cap. Francesco Carillo - 26, 84013 Cava dei Tirreni
    Mob. +39-3284332259
    Le informazioni trasmesse sono destinate esclusivamente alla persona o
    alla società in indirizzo e sono da intendersi confidenziali e riservate.
    Ogni trasmissione, inoltro, diffusione o altro uso di queste informazioni a
    persone o società differenti dal destinatario è proibita. Se ricevete
    questa comunicazione per errore, contattate il mittente e cancellate le
    informazioni da ogni computer.
    The information transmitted is intended only for the person or entity to
    which it is addressed and may contain confidential and/or privileged
    material. Any review, retransmission, dissemination or other use of, or
    taking of any action in reliance upon, this information by persons or
    entities other than the intended recipient is prohibited. If you received
    this in error, please contact the sender and delete the material from any
    computer.
    --
    You received this message because you are subscribed to the Google Groups "mongodb-user" group.
    To post to this group, send email to mongodb-user@googlegroups.com.
    To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com.
    For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupmongodb-user @
categoriesmongodb
postedMar 27, '12 at 5:10a
activeMar 30, '12 at 6:25p
posts6
users5
websitemongodb.org
irc#mongodb

People

Translate

site design / logo © 2022 Grokbase