FAQ
Hi guys,

Having the need to synchronize some data with external sources, I have
written some tasks on Grunt to do so. I wonder if Grunt is actually the
tool to write batch jobs in, or there actually is some other alternative.

I have come across Node.io, but I rather stick to Grunt in this case. Do
you guys know about some alternatives, please?

Thanks!
Guilherme

--
Job Board: http://jobs.nodejs.org/
Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
You received this message because you are subscribed to the Google
Groups "nodejs" group.
To post to this group, send email to nodejs@googlegroups.com
To unsubscribe from this group, send email to
nodejs+unsubscribe@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/nodejs?hl=en?hl=en

Search Discussions

  • Nuno Job at Oct 5, 2012 at 10:37 am
    Can you share some more details on what you are trying to accomplish?

    You have talked about tools (both of which I am unaware of) and said
    "batch", but apart from that there wasn't much more that could help anyone
    make an informed suggestion.

    Let me know, I'll try to help :)
    Nuno
    On Fri, Oct 5, 2012 at 11:08 AM, Guilherme Pim wrote:

    Hi guys,

    Having the need to synchronize some data with external sources, I have
    written some tasks on Grunt to do so. I wonder if Grunt is actually the
    tool to write batch jobs in, or there actually is some other alternative.

    I have come across Node.io, but I rather stick to Grunt in this case. Do
    you guys know about some alternatives, please?

    Thanks!
    Guilherme

    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines:
    https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en
    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en
  • Guilherme Pim at Oct 5, 2012 at 11:22 am
    Okay, my bad!

    I am crawling some web pages to populate a database, and currently doing
    that with Grunt (http://gruntjs.com/), which is a task-based 'build tool'
    (that gets me confused, is it supposed to solely build?).

    So, I have created some scripts in the following manner:

    ========== Task file ==========

    module.exports = function (grunt) {

    grunt.registerTask('courses/update-info', 'Updates all courses info on
    the database', ... )

    }

    ============================

    So then I may have a somewhat controlled access to these jobs from the
    terminal, with ability to list all existing jobs and their descriptions.
    Also, I may pass some parameters to each task, although it's not very
    readable because they can't be associated with a name:

    grunt courses/update-info:4:5:2 (these will be passed as the tasks's
    function arguments)

    I guess I could go about creating node scripts and using a parameters
    library along with console colors and stuff, but I would rather find a
    framework, if such exists.

    Did I make myself clearer at all? haha

    Thanks for you time,
    Guilherme

    2012/10/5 Nuno Job <nunojobpinto@gmail.com>
    Can you share some more details on what you are trying to accomplish?

    You have talked about tools (both of which I am unaware of) and said
    "batch", but apart from that there wasn't much more that could help anyone
    make an informed suggestion.

    Let me know, I'll try to help :)
    Nuno
    On Fri, Oct 5, 2012 at 11:08 AM, Guilherme Pim wrote:

    Hi guys,

    Having the need to synchronize some data with external sources, I have
    written some tasks on Grunt to do so. I wonder if Grunt is actually the
    tool to write batch jobs in, or there actually is some other alternative.

    I have come across Node.io, but I rather stick to Grunt in this case. Do
    you guys know about some alternatives, please?

    Thanks!
    Guilherme

    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines:
    https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en
    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines:
    https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en
    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en
  • Greelgorke at Oct 5, 2012 at 12:46 pm
    use registerMultiTask.

    define your websites in the main gruntfile.

    may be a better way is to use plain node script for it.

    Am Freitag, 5. Oktober 2012 13:22:21 UTC+2 schrieb Guilherme Pim:
    Okay, my bad!

    I am crawling some web pages to populate a database, and currently doing
    that with Grunt (http://gruntjs.com/), which is a task-based 'build tool'
    (that gets me confused, is it supposed to solely build?).

    So, I have created some scripts in the following manner:

    ========== Task file ==========

    module.exports = function (grunt) {

    grunt.registerTask('courses/update-info', 'Updates all courses info on
    the database', ... )

    }

    ============================

    So then I may have a somewhat controlled access to these jobs from the
    terminal, with ability to list all existing jobs and their descriptions.
    Also, I may pass some parameters to each task, although it's not very
    readable because they can't be associated with a name:

    grunt courses/update-info:4:5:2 (these will be passed as the tasks's
    function arguments)

    I guess I could go about creating node scripts and using a parameters
    library along with console colors and stuff, but I would rather find a
    framework, if such exists.

    Did I make myself clearer at all? haha

    Thanks for you time,
    Guilherme

    2012/10/5 Nuno Job <nunojo...@gmail.com <javascript:>>
    Can you share some more details on what you are trying to accomplish?

    You have talked about tools (both of which I am unaware of) and said
    "batch", but apart from that there wasn't much more that could help anyone
    make an informed suggestion.

    Let me know, I'll try to help :)
    Nuno

    On Fri, Oct 5, 2012 at 11:08 AM, Guilherme Pim <pimgui...@gmail.com<javascript:>
    wrote:
    Hi guys,

    Having the need to synchronize some data with external sources, I have
    written some tasks on Grunt to do so. I wonder if Grunt is actually the
    tool to write batch jobs in, or there actually is some other alternative.

    I have come across Node.io, but I rather stick to Grunt in this case. Do
    you guys know about some alternatives, please?

    Thanks!
    Guilherme

    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines:
    https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nod...@googlegroups.com<javascript:>
    To unsubscribe from this group, send email to
    nodejs+un...@googlegroups.com <javascript:>
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en
    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines:
    https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nod...@googlegroups.com<javascript:>
    To unsubscribe from this group, send email to
    nodejs+un...@googlegroups.com <javascript:>
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en
    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en
  • Ted Young at Oct 11, 2012 at 10:28 pm
    Sounds like you just want a node service that does the scraping, and provides an http api for adding tasks and querying what tasks are currently running. Then have a separate command-line app that can talk to the web service. And maybe also an express app that can talk to it via a browser. I use that pattern a lot, but haven't yet written an abstraction for it. An abstraction for easily banging out command-line apps with tab-complete, etc that just talk to web services would be a useful thingie though.

    I'm not sure if there's a generic node-based job-processor out there, but you might like https://github.com/defunkt/resque. It's ruby, but each job could just be a system call to start a node process.

    Ted
    On Oct 5, 2012, at 4:22 AM, Guilherme Pim wrote:

    Okay, my bad!

    I am crawling some web pages to populate a database, and currently doing that with Grunt (http://gruntjs.com/), which is a task-based 'build tool' (that gets me confused, is it supposed to solely build?).

    So, I have created some scripts in the following manner:

    ========== Task file ==========

    module.exports = function (grunt) {

    grunt.registerTask('courses/update-info', 'Updates all courses info on the database', ... )

    }

    ============================

    So then I may have a somewhat controlled access to these jobs from the terminal, with ability to list all existing jobs and their descriptions. Also, I may pass some parameters to each task, although it's not very readable because they can't be associated with a name:

    grunt courses/update-info:4:5:2 (these will be passed as the tasks's function arguments)

    I guess I could go about creating node scripts and using a parameters library along with console colors and stuff, but I would rather find a framework, if such exists.

    Did I make myself clearer at all? haha

    Thanks for you time,
    Guilherme

    2012/10/5 Nuno Job <nunojobpinto@gmail.com>
    Can you share some more details on what you are trying to accomplish?

    You have talked about tools (both of which I am unaware of) and said "batch", but apart from that there wasn't much more that could help anyone make an informed suggestion.

    Let me know, I'll try to help :)
    Nuno

    On Fri, Oct 5, 2012 at 11:08 AM, Guilherme Pim wrote:
    Hi guys,

    Having the need to synchronize some data with external sources, I have written some tasks on Grunt to do so. I wonder if Grunt is actually the tool to write batch jobs in, or there actually is some other alternative.

    I have come across Node.io, but I rather stick to Grunt in this case. Do you guys know about some alternatives, please?

    Thanks!
    Guilherme

    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en


    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en


    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en
    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en
  • Ted Young at Oct 11, 2012 at 11:31 pm
    Actually, kue looks like a resque-like thing: http://learnboost.github.com/kue/

    Ted
    On Oct 11, 2012, at 1:52 PM, Ted Young wrote:

    Sounds like you just want a node service that does the scraping, and provides an http api for adding tasks and querying what tasks are currently running. Then have a separate command-line app that can talk to the web service. And maybe also an express app that can talk to it via a browser. I use that pattern a lot, but haven't yet written an abstraction for it. An abstraction for easily banging out command-line apps with tab-complete, etc that just talk to web services would be a useful thingie though.

    I'm not sure if there's a generic node-based job-processor out there, but you might like https://github.com/defunkt/resque. It's ruby, but each job could just be a system call to start a node process.

    Ted
    On Oct 5, 2012, at 4:22 AM, Guilherme Pim wrote:

    Okay, my bad!

    I am crawling some web pages to populate a database, and currently doing that with Grunt (http://gruntjs.com/), which is a task-based 'build tool' (that gets me confused, is it supposed to solely build?).

    So, I have created some scripts in the following manner:

    ========== Task file ==========

    module.exports = function (grunt) {

    grunt.registerTask('courses/update-info', 'Updates all courses info on the database', ... )

    }

    ============================

    So then I may have a somewhat controlled access to these jobs from the terminal, with ability to list all existing jobs and their descriptions. Also, I may pass some parameters to each task, although it's not very readable because they can't be associated with a name:

    grunt courses/update-info:4:5:2 (these will be passed as the tasks's function arguments)

    I guess I could go about creating node scripts and using a parameters library along with console colors and stuff, but I would rather find a framework, if such exists.

    Did I make myself clearer at all? haha

    Thanks for you time,
    Guilherme

    2012/10/5 Nuno Job <nunojobpinto@gmail.com>
    Can you share some more details on what you are trying to accomplish?

    You have talked about tools (both of which I am unaware of) and said "batch", but apart from that there wasn't much more that could help anyone make an informed suggestion.

    Let me know, I'll try to help :)
    Nuno

    On Fri, Oct 5, 2012 at 11:08 AM, Guilherme Pim wrote:
    Hi guys,

    Having the need to synchronize some data with external sources, I have written some tasks on Grunt to do so. I wonder if Grunt is actually the tool to write batch jobs in, or there actually is some other alternative.

    I have come across Node.io, but I rather stick to Grunt in this case. Do you guys know about some alternatives, please?

    Thanks!
    Guilherme

    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en


    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en


    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en

    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en
    --
    Job Board: http://jobs.nodejs.org/
    Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
    You received this message because you are subscribed to the Google
    Groups "nodejs" group.
    To post to this group, send email to nodejs@googlegroups.com
    To unsubscribe from this group, send email to
    nodejs+unsubscribe@googlegroups.com
    For more options, visit this group at
    http://groups.google.com/group/nodejs?hl=en?hl=en

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupnodejs @
categoriesnodejs
postedOct 5, '12 at 10:08a
activeOct 11, '12 at 11:31p
posts6
users4
websitenodejs.org
irc#node.js

People

Translate

site design / logo © 2022 Grokbase