Search Discussions
-
Hello friends: Can someone help clarify the following for me. I'm sure it's been asked or articulated elsewhere, but I cannot seem to find the answer I'm looking for on searches. In my Spout (but it ...
Noel Milton Vega
Jun 17, 2013 at 11:13 pm
Jun 20, 2013 at 11:02 pm -
hi, my topology drops tuples, the spout reads tuples from a file and sends them to a bolt, when i counted the number of tuples at the spout and the number of tuples at the bolt, it turned out that a ...
Aboubakr
Jun 24, 2013 at 1:53 pm
Jun 26, 2013 at 9:44 am -
We are working on transitioning some of our components from MapReduce to Storm, but the one thing that seems inconvenient is log handling. Hadoop will break logs into sections by Job, and then by ...
Jon
Jun 12, 2013 at 12:03 am
Jun 17, 2013 at 11:31 pm -
Hi everybody, I have a very simple topology, almost no processing involved, 1 spout 1 bolt, no anchoring. 2 supervisors. Spout grabs message from broker q and sends it to the Bolt. Bolt writes data ...
Sergey
Jun 27, 2013 at 5:29 pm
Jun 28, 2013 at 3:00 pm -
Folks: We are deploying a topology with 470 workers with a simple DAG: spout --- bolt1--- bolt3 \|/ | +------ bolt2 ----- This topology works fine if we declare # of tasks as below: - spout ... 150 - ...
Andy
Jun 28, 2013 at 11:08 pm
Jul 9, 2013 at 10:19 pm -
My topology set up is as follows TopologyBuilder builder = new TopologyBuilder(); builder.setSpout("pgw", new pgwparser(),2); //this generates two threads builder.setSpout("email", new ...
Ayush choubey
Jun 14, 2013 at 7:30 am
Jun 15, 2013 at 4:02 am -
Hi, I'm using storm to write output to hdfs, and I was wondering how I could prompt storm to close the connections when the topology is killed. I'm expecting this topology to be running at all times, ...
Bsiu
Jun 19, 2013 at 12:24 am
Aug 4, 2013 at 5:55 pm -
We would like to use the storm to monitor and analyze the log files on our live boxes. We plan to run the storm topology in the sandbox environment to monitor the live boxes. I can think of 2 ways to ...
Gopi1977
Jun 25, 2013 at 5:33 am
Jun 26, 2013 at 5:00 am -
Hi All, I have a Trident Topology that takes input from KafkaSpout. How can I simulate my spout for testing my topology? I am looking for solution for both Unit and Integration Test. Thank you Best ...
Vinoth Kumar Kannan
Jun 14, 2013 at 2:42 pm
Jun 18, 2013 at 1:25 am -
i tried running my code ./storm jar /home/ayush/workspace/sample/csvstorm.jar storm and then this happened. Btw storm is the name of my class which has main method Running: java -client ...
Ayush choubey
Jun 13, 2013 at 9:28 am
Jun 14, 2013 at 4:50 am -
So, I was trying to run this command: java -cp To run the ExclamationTopology class in ./storm/starter/ but it didn't work. Then someone on StackOverflow suggested me to change the command to this ...
Shawn Stark
Jun 5, 2013 at 12:02 am
Jun 6, 2013 at 10:49 am -
Hi all, I am facing the below scenario - There are 4 sliding time window rule bolt - I. Rule 1 II.Rule 2 III.Rule 3 IV. Rule 4 There is a master rule bolt below that provides the required output - ...
Abhijit Chanda
Jun 5, 2013 at 5:32 am
Jun 5, 2013 at 9:57 pm -
hi,. I have written a topology that processes huge amounts of events, about 5 GB of events, when i run my topology on local cluster mode, i get the following error: 822146 [Thread-48] INFO ...
Aboubakr
Jun 20, 2013 at 8:01 pm
Jun 21, 2013 at 12:56 pm -
I've the problem that my topology start no __acker task. Thus the topology.max.spout.pending setting is ignored. I set up the following values: topology.acker.executors 1 topology.acker.tasks 1 ...
Christian Würtz
Jun 18, 2013 at 9:56 am
Jun 20, 2013 at 7:32 am -
Hi, I have a following topology deployed in local cluster: topologyBuilder.setSpout("status-emitter", new AmqpStatusEmitterSpout()); topologyBuilder.setBolt("status-splitter", new ...
Nedo Sab
Jun 6, 2013 at 7:20 am
Jun 17, 2013 at 2:57 pm -
Hi! I set up zookeeper and storm on a cluster of 4 machines. Hence, I got 1 Master and 3 Nodes. Every node is up and running and provides 4 slots. However, only 1 slot is used! So I currently have 11 ...
Yannick Baron
Jun 6, 2013 at 1:52 pm
Jun 7, 2013 at 12:18 am -
Currently we want to use an analytic library within a Storm Bolt. However this library is not Thread safe, so we want to specify that any instances of this Bolt is only run within a single process ...
Edward Goslin
Jun 25, 2013 at 11:35 am
Jun 29, 2013 at 3:27 pm -
hi, i wrote a topology in which lots of lines from a file are read, when i run the topology in local mode, with one thread for the spout and the bolt, i get a certain size of results, however when i ...
Aboubakr
Jun 28, 2013 at 4:04 pm
Jun 28, 2013 at 6:47 pm -
Hello, I am reading sentences from Redis Server and trying to Count the occurrence of each word, Now I want to find the top 10 words based on count.What should be my approach? Now I have one spout ...
Bhagwant Bhobe
Jun 18, 2013 at 4:31 am
Jun 20, 2013 at 6:59 pm -
Hello all! I've recently started using Storm and Kafka (separately). I heard that the two could be used together, and I am interested in doing so. However, from the research that I did over the past ...
Alex Wu
Jun 12, 2013 at 4:13 am
Jun 17, 2013 at 7:21 pm -
I see a lot of new code related "*Metrics*" in 0.9.0? Is there a document introduce this feature? Can someone give a brief introduction or detail? Is a new system-level metrics in UI, am i right? ...
Tong Jin
Jun 1, 2013 at 2:03 am
Oct 19, 2013 at 12:55 am -
In 0.8.*, Storm use log4j through slf4j, why use logback in 0.9.0? What is this change for? Thanks -Tong -- You received this message because you are subscribed to the Google Groups "storm-user" ...
Tong Jin
Jun 1, 2013 at 1:25 am
Sep 17, 2013 at 3:21 pm -
hi, I've topology1 which is running in 8 workers [2 supervisors with four slots each]. And then I'm trying to run topology2 with numworkers as 8. In UI the topology2 is active, but no bolts and ...
Bala krishnan
Jun 27, 2013 at 3:07 pm
Jun 29, 2013 at 3:09 pm -
This is my .yaml file ########### These MUST be filled in for a storm configuration storm.zookeeper.servers: - "147.128.140.125" # # nimbus.host: "147.128.140.125" # # # ##### These may optionally be ...
Ayush choubey
Jun 13, 2013 at 7:02 am
Jun 28, 2013 at 5:15 am -
If i introduce a compilation issue in my project and run "lein compile" or something then it just terminates and does nto tell me what the error was or a stack trace.. very hard to debug this way ...
Ryan medlin
Jun 26, 2013 at 12:37 am
Jun 26, 2013 at 2:06 pm -
Hi everybody, I was doing a sample topology 1 spout 1 bolt. Spout grabs messages from Rabbit cluster, and pass it to the bolt. Almost no proccessing in the bolt, just store the result in MySQL. It ...
Sergey
Jun 18, 2013 at 2:26 pm
Jun 21, 2013 at 12:46 pm -
Hi there! I am done crafting my topology and want to get it running on my remote cluster. In Local Mode things are running fine, so it's finally time to test the real things. However, it seems that ...
Yannick Baron
Jun 5, 2013 at 2:20 pm
Jun 19, 2013 at 10:15 am -
Hey, I'm pretty new to Storm and am building a topology which uses python for the spouts and bolts. Assume I know nothing... What tips would you give to someone scaling a multilang topology? Cheers, ...
James Griffin
Jun 12, 2013 at 2:26 am
Jun 17, 2013 at 3:40 pm -
Hi, I'm trying to build a system to processes mobile phone requests to a Storm cluster and then answer with some values to that requests. (I may start doing some testing using Siege to generate some ...
Hyakunin
Jun 7, 2013 at 4:31 pm
Jun 14, 2013 at 9:45 am -
Hi, I am not able to run topology in storm cluster. It is happening because supervisor kills worker as it is timing out. But I am not able to understand reasons for this issue - I see these logs in ...
Ashish Nigam
Jun 5, 2013 at 10:15 pm
Jun 6, 2013 at 5:59 pm -
Hi all, my intention is setting up a cluster with 2 hosts. One is master running Zookeeper, nimbus and UI and the other one is slave running only supervisor. *The storm.yaml at master is :* ...
Waldstein Wang
Jun 5, 2013 at 6:40 am
Jun 5, 2013 at 2:24 pm -
Hi everyone, I'd like a topology with 1 spout and 2 bolts. In the spout I read from 2 files. From the first file I got a string and from the second file I create an object that I pass to the first ...
Amedeo Merlo
Jun 3, 2013 at 5:37 pm
Jun 4, 2013 at 8:18 pm -
Can anyone provide a RPM package for ZeroMQ 2.1.7 and JZMQ fork (https://github.com/nathanmarz/jzmq) on RHEL 5 and 6? ZeroMQ 2.1.9 RPM is available here ...
Kendeng300
Jun 1, 2013 at 1:53 am
Jun 3, 2013 at 5:02 am -
After some digging, we appear to have identified a problem in Trident batch processing that results in batches being failed randomly after the topology has been running for a while. We have a Trident ...
Andy
Jun 5, 2013 at 2:04 pm
Nov 16, 2013 at 3:17 am -
Hi all, I'm trying to run TridentWordCount example on a cluster. Submitting the job has no problem like the following: $ storm jar ~/Desktop/testexport.jar storm.trident.TridentWordCount wordcount ...
Tatsuya Sasaki
Jun 12, 2013 at 6:20 am
Oct 30, 2013 at 7:27 am -
Hi, I run zookeeper, nimbus and supervisor in the same single node. when i running storm-start WordCountToplogy. I have the same message like what Manish has said, while there is no error log in ...
Jerry Lin
Jun 21, 2013 at 4:20 am
Jul 16, 2013 at 12:20 pm -
This has happened to my supervisors twice in the last 2 weeks, after leaving them idle for a few days while I was working on other things. -- You received this message because you are subscribed to ...
Keith Freeman
Jun 29, 2013 at 5:50 pm
Jul 9, 2013 at 11:36 am -
I am new to Storm, I want to know how Storm decides where to run the spout/bolt. The reason of asking is there are some bolts which are memory intensive and some spouts which are network intensive. I ...
Jody Ho
Jun 28, 2013 at 12:14 am
Jun 30, 2013 at 1:54 am -
I was running a topology with ./storm jar /home/.../storm-rabbitmq-test-1.0-SNAPSHOT.r com.geekcap.storm.PrimeNumberTopology test1 when I got this error in the worker log ... ...... 2013-06-25 ...
Hyakunin
Jun 25, 2013 at 10:01 am
Jun 26, 2013 at 8:37 am -
Hi, We're using a TransactionalTridentKafkaSpout for out Trident topology. The topology runs fine, but the dashboard shows that its processing tuples even though the queue is empty. The metrics that ...
Philippe Laflamme
Jun 21, 2013 at 3:26 pm
Jun 26, 2013 at 6:42 am -
Hi all, I have looked at TestingApiDemo java code on how to test storm topologies but there is something unclear to me. I see that there are methods to check the output of each bolt using mock data ...
Albyblueska
Jun 20, 2013 at 9:49 am
Jun 22, 2013 at 1:54 pm -
Hi, I was hoping to get some feedback on a Kafka Spout setup I've been testing. What I think is all the relevant information follows below, if there is anything else that would help answer the ...
Adam Rosenberger
Jun 21, 2013 at 4:20 am
Jun 21, 2013 at 3:50 pm -
Next newbie set of storm question. One of my use cases is around a streaming mathematics processor on inbound channel data. I previously asked about 'R' Integration. it is related. Environment ...
Mark Farnan
Jun 10, 2013 at 6:54 pm
Jun 18, 2013 at 2:09 pm -
Hi, Can u pl provide a link to a simple Trident example using Transactional or Opaque spout in Java. Thanks SKG -- You received this message because you are subscribed to the Google Groups ...
SKG
Jun 11, 2013 at 9:58 am
Jun 18, 2013 at 9:49 am -
Hi, I am using storm-kafka. From a topic, I want to consume same messages from two different consumer groups, namely 'groupA', 'groupB': msg1, msg2, ... <a topic ------------------------- groupA ...
Mykidong
Jun 14, 2013 at 12:12 pm
Jun 17, 2013 at 5:52 pm -
hi, I would like to know how can i stop those two methods after only one execution and terminate the topology -- You received this message because you are subscribed to the Google Groups "storm-user" ...
Aboubakr
Jun 12, 2013 at 7:30 pm
Jun 14, 2013 at 1:39 am -
I have a simple topology consisting on 3 nodes: 1 node is zookeeper,ui and nimbus and another two are supervisors. I have one spout and one bolt. I want multiple threads of the bolt, which doing API ...
Eugene Dvorkin
Jun 9, 2013 at 12:33 pm
Jun 12, 2013 at 6:22 am -
I was just wondering what is the reason behind this? public void nextTuple() { *Utils.sleep(100);* try { ....... -- You received this message because you are subscribed to the Google Groups ...
Shawn Stark
Jun 10, 2013 at 4:43 pm
Jun 10, 2013 at 11:08 pm -
I'm running storm in local mode, and my application has a single topology. I need to assign only a specific set of tasks to the executors of every worker node that I add to the cluster. Is there any ...
Siddharth Santurkar
Jun 6, 2013 at 7:20 am
Jun 10, 2013 at 2:41 pm -
Just wondering if there's anyway to turn off the Zookeeper output and only output application related info. Right now it's impossible to debug the output of a running local topology because of the ...
Daniel Fagnan
Jun 8, 2013 at 1:17 am
Jun 8, 2013 at 8:23 pm
Group Overview
| group | storm-user |
| discussions | 204 |
| posts | 601 |
| users | 179 |
| website | storm-project.net |
| irc | #storm-user |
