FAQ
I'm running Storm 0.8.1. Every so often, Nimbus is crashing with the
following log entry.
It seems to be caused by file deletion error. Has anyone else faced this
issue?

(defn clean-inbox [dir-location seconds]
   "Deletes jar files in dir older than seconds."
   (let [now (current-time-secs)
     pred #(and (.isFile %) (file-older-than? now seconds %))
         files (filter pred (file-seq (File. dir-location)))]
     (doseq [f files]
       (if (.delete f)
         (log-message "Cleaning inbox ... deleted: " (.getName f))
         ;; This should never happen
         (log-error "Cleaning inbox ... error deleting: " (.getName f))
         ))))


2012-12-05 00:03:32 nimbus [ERROR] Error when processing event
java.lang.ClassCastException: java.lang.String cannot be cast to
java.lang.Throwable
         at clojure.tools.logging$eval1$fn__7.invoke(NO_SOURCE_FILE:0)
         at clojure.tools.logging.impl$fn__56$G__49__67.invoke(impl.clj:16)
         at clojure.tools.logging$log_STAR_.invoke(logging.clj:59)
         at backtype.storm.daemon.nimbus$clean_inbox.invoke(nimbus.clj:851)
         at
backtype.storm.daemon.nimbus$fn__3589$exec_fn__1207__auto____3590$fn__3600.invoke(nimbus.clj:899)
         at
backtype.storm.timer$schedule_recurring$this__1753.invoke(timer.clj:69)
         at
backtype.storm.timer$mk_timer$fn__1736$fn__1737.invoke(timer.clj:33)
         at backtype.storm.timer$mk_timer$fn__1736.invoke(timer.clj:26)
         at clojure.lang.AFn.run(AFn.java:24)
         at java.lang.Thread.run(Thread.java:662)
2012-12-05 00:03:32 util [INFO] Halting process: ("Error when processing an
event")

Search Discussions

  • Andy at Dec 7, 2012 at 6:18 am
    Another nimbus log entry on file deletion:

    2012-12-05 00:00:48 nimbus [ERROR] Error when processing event
    java.io.IOException: Unable to delete file:
    /home/y/var/storm/nimbus/stormdist/andy-hbase-1-1354661330/stormcode.ser
             at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:1390)
             at
    org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1044)
             at
    org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:977)
             at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:1381)
             at backtype.storm.util$rmr.invoke(util.clj:413)
             at backtype.storm.daemon.nimbus$do_cleanup.invoke(nimbus.clj:835)
             at
    backtype.storm.daemon.nimbus$fn__3589$exec_fn__1207__auto____3590$fn__3595.invoke(nimbus.clj:892)
             at
    backtype.storm.timer$schedule_recurring$this__1753.invoke(timer.clj:69)
             at
    backtype.storm.timer$mk_timer$fn__1736$fn__1737.invoke(timer.clj:33)
             at backtype.storm.timer$mk_timer$fn__1736.invoke(timer.clj:26)
             at clojure.lang.AFn.run(AFn.java:24)
             at java.lang.Thread.run(Thread.java:662)
    2012-12-05 00:00:48 util [INFO] Halting process: ("Error when processing an
    event")

    On Thursday, December 6, 2012 10:11:03 PM UTC-8, andy wrote:

    I'm running Storm 0.8.1. Every so often, Nimbus is crashing with the
    following log entry.
    It seems to be caused by file deletion error. Has anyone else faced this
    issue?

    (defn clean-inbox [dir-location seconds]
    "Deletes jar files in dir older than seconds."
    (let [now (current-time-secs)
    pred #(and (.isFile %) (file-older-than? now seconds %))
    files (filter pred (file-seq (File. dir-location)))]
    (doseq [f files]
    (if (.delete f)
    (log-message "Cleaning inbox ... deleted: " (.getName f))
    ;; This should never happen
    (log-error "Cleaning inbox ... error deleting: " (.getName f))
    ))))


    2012-12-05 00:03:32 nimbus [ERROR] Error when processing event
    java.lang.ClassCastException: java.lang.String cannot be cast to
    java.lang.Throwable
    at clojure.tools.logging$eval1$fn__7.invoke(NO_SOURCE_FILE:0)
    at clojure.tools.logging.impl$fn__56$G__49__67.invoke(impl.clj:16)
    at clojure.tools.logging$log_STAR_.invoke(logging.clj:59)
    at backtype.storm.daemon.nimbus$clean_inbox.invoke(nimbus.clj:851)
    at
    backtype.storm.daemon.nimbus$fn__3589$exec_fn__1207__auto____3590$fn__3600.invoke(nimbus.clj:899)
    at
    backtype.storm.timer$schedule_recurring$this__1753.invoke(timer.clj:69)
    at
    backtype.storm.timer$mk_timer$fn__1736$fn__1737.invoke(timer.clj:33)
    at backtype.storm.timer$mk_timer$fn__1736.invoke(timer.clj:26)
    at clojure.lang.AFn.run(AFn.java:24)
    at java.lang.Thread.run(Thread.java:662)
    2012-12-05 00:03:32 util [INFO] Halting process: ("Error when processing
    an event")
  • Nathan Marz at Dec 11, 2012 at 10:14 pm
    Does it then restart and work fine after that?

    On Thu, Dec 6, 2012 at 10:18 PM, andy wrote:

    Another nimbus log entry on file deletion:

    2012-12-05 00:00:48 nimbus [ERROR] Error when processing event
    java.io.IOException: Unable to delete file:
    /home/y/var/storm/nimbus/stormdist/andy-hbase-1-1354661330/stormcode.ser
    at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:1390)
    at
    org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1044)
    at
    org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:977)
    at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:1381)
    at backtype.storm.util$rmr.invoke(util.clj:413)
    at backtype.storm.daemon.nimbus$do_cleanup.invoke(nimbus.clj:835)
    at
    backtype.storm.daemon.nimbus$fn__3589$exec_fn__1207__auto____3590$fn__3595.invoke(nimbus.clj:892)

    at
    backtype.storm.timer$schedule_recurring$this__1753.invoke(timer.clj:69)
    at
    backtype.storm.timer$mk_timer$fn__1736$fn__1737.invoke(timer.clj:33)
    at backtype.storm.timer$mk_timer$fn__1736.invoke(timer.clj:26)
    at clojure.lang.AFn.run(AFn.java:24)
    at java.lang.Thread.run(Thread.java:662)
    2012-12-05 00:00:48 util [INFO] Halting process: ("Error when processing
    an event")


    On Thursday, December 6, 2012 10:11:03 PM UTC-8, andy wrote:

    I'm running Storm 0.8.1. Every so often, Nimbus is crashing with the
    following log entry.
    It seems to be caused by file deletion error. Has anyone else faced this
    issue?

    (defn clean-inbox [dir-location seconds]
    "Deletes jar files in dir older than seconds."
    (let [now (current-time-secs)
    pred #(and (.isFile %) (file-older-than? now seconds %))
    files (filter pred (file-seq (File. dir-location)))]
    (doseq [f files]
    (if (.delete f)
    (log-message "Cleaning inbox ... deleted: " (.getName f))
    ;; This should never happen
    (log-error "Cleaning inbox ... error deleting: " (.getName f))
    ))))


    2012-12-05 00:03:32 nimbus [ERROR] Error when processing event
    java.lang.ClassCastException: java.lang.String cannot be cast to
    java.lang.Throwable
    at clojure.tools.logging$eval1$**fn__7.invoke(NO_SOURCE_FILE:0)
    at clojure.tools.logging.impl$fn_**_56$G__49__67.invoke(impl.clj:
    **16)
    at clojure.tools.logging$log_**STAR_.invoke(logging.clj:59)
    at backtype.storm.daemon.nimbus$**clean_inbox.invoke(nimbus.clj:*
    *851)
    at backtype.storm.daemon.nimbus$**fn__3589$exec_fn__1207__auto__*
    *__3590$fn__3600.invoke(nimbus.**clj:899)
    at backtype.storm.timer$schedule_**recurring$this__1753.invoke(**
    timer.clj:69)
    at backtype.storm.timer$mk_timer$**fn__1736$fn__1737.invoke(**
    timer.clj:33)
    at backtype.storm.timer$mk_timer$**fn__1736.invoke(timer.clj:26)
    at clojure.lang.AFn.run(AFn.java:**24)
    at java.lang.Thread.run(Thread.**java:662)
    2012-12-05 00:03:32 util [INFO] Halting process: ("Error when processing
    an event")

    --
    Twitter: @nathanmarz
    http://nathanmarz.com
  • Cosmin Lehene at Jun 26, 2013 at 8:12 pm
    The first exception refers to nimbus clean-inbox and
    exposes https://github.com/nathanmarz/storm/issues/610
    File permissions issues on storm local storage could cause these exceptions
    as well (e.g. starting storm with a different user).
    On Wednesday, December 12, 2012 12:13:58 AM UTC+2, nathanmarz wrote:

    Does it then restart and work fine after that?


    On Thu, Dec 6, 2012 at 10:18 PM, andy <andy...@gmail.com <javascript:>>wrote:
    Another nimbus log entry on file deletion:

    2012-12-05 00:00:48 nimbus [ERROR] Error when processing event
    java.io.IOException: Unable to delete file:
    /home/y/var/storm/nimbus/stormdist/andy-hbase-1-1354661330/stormcode.ser
    at
    org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:1390)
    at
    org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1044)
    at
    org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:977)
    at
    org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:1381)
    at backtype.storm.util$rmr.invoke(util.clj:413)
    at backtype.storm.daemon.nimbus$do_cleanup.invoke(nimbus.clj:835)
    at
    backtype.storm.daemon.nimbus$fn__3589$exec_fn__1207__auto____3590$fn__3595.invoke(nimbus.clj:892)

    at
    backtype.storm.timer$schedule_recurring$this__1753.invoke(timer.clj:69)
    at
    backtype.storm.timer$mk_timer$fn__1736$fn__1737.invoke(timer.clj:33)
    at backtype.storm.timer$mk_timer$fn__1736.invoke(timer.clj:26)
    at clojure.lang.AFn.run(AFn.java:24)
    at java.lang.Thread.run(Thread.java:662)
    2012-12-05 00:00:48 util [INFO] Halting process: ("Error when processing
    an event")


    On Thursday, December 6, 2012 10:11:03 PM UTC-8, andy wrote:

    I'm running Storm 0.8.1. Every so often, Nimbus is crashing with the
    following log entry.
    It seems to be caused by file deletion error. Has anyone else faced this
    issue?

    (defn clean-inbox [dir-location seconds]
    "Deletes jar files in dir older than seconds."
    (let [now (current-time-secs)
    pred #(and (.isFile %) (file-older-than? now seconds %))
    files (filter pred (file-seq (File. dir-location)))]
    (doseq [f files]
    (if (.delete f)
    (log-message "Cleaning inbox ... deleted: " (.getName f))
    ;; This should never happen
    (log-error "Cleaning inbox ... error deleting: " (.getName f))
    ))))


    2012-12-05 00:03:32 nimbus [ERROR] Error when processing event
    java.lang.ClassCastException: java.lang.String cannot be cast to
    java.lang.Throwable
    at clojure.tools.logging$eval1$**fn__7.invoke(NO_SOURCE_FILE:0)
    at clojure.tools.logging.impl$fn_**
    _56$G__49__67.invoke(impl.clj:**16)
    at clojure.tools.logging$log_**STAR_.invoke(logging.clj:59)
    at backtype.storm.daemon.nimbus$**clean_inbox.invoke(nimbus.clj:
    **851)
    at backtype.storm.daemon.nimbus$**fn__3589$exec_fn__1207__auto__
    **__3590$fn__3600.invoke(nimbus.**clj:899)
    at backtype.storm.timer$schedule_**recurring$this__1753.invoke(*
    *timer.clj:69)
    at backtype.storm.timer$mk_timer$**fn__1736$fn__1737.invoke(**
    timer.clj:33)
    at backtype.storm.timer$mk_timer$**fn__1736.invoke(timer.clj:26)
    at clojure.lang.AFn.run(AFn.java:**24)
    at java.lang.Thread.run(Thread.**java:662)
    2012-12-05 00:03:32 util [INFO] Halting process: ("Error when processing
    an event")

    --
    Twitter: @nathanmarz
    http://nathanmarz.com
    --
    You received this message because you are subscribed to the Google Groups "storm-user" group.
    To unsubscribe from this group and stop receiving emails from it, send an email to storm-user+unsubscribe@googlegroups.com.
    For more options, visit https://groups.google.com/groups/opt_out.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupstorm-user @
postedDec 7, '12 at 6:11a
activeJun 26, '13 at 8:12p
posts4
users3
websitestorm-project.net
irc#storm-user

People

Translate

site design / logo © 2022 Grokbase