FAQ
Hi all

I am new to storm.

As far as i know, when submitting to a remote storm cluster, the Reach
Topology in storm.starter only starts a DRPC server, and does not has any
client request. So I build a separate client, called "ReachRun", to test
the DRPC server. But the client gets a "Read timed out" exception when
trying to connect.
Any suggestion is appreciated.

Here is my client:
------------------
public class ReachRun{

public static void main(String[] args) throws Exception {
System.out.println("STATUS: Initiating DRPC Client...");
DRPCClient client = new DRPCClient("pcie-1", 3772, 1024*8);
String[] urlsToTry = new String[] { "foo.com/blog/1", "
engineering.twitter.com/blog/5", "notaurl.com"};
for(String url: urlsToTry) {
System.out.println("STATUS: Get reach of " + url);
System.out.println("Reach of " + url + ": " +
client.execute("reach", url));
}
}
}


and the running log:
--------------------
[storm@pcie-1 ~]$ ./storm-0.9.0-wip3//bin/storm jar ~/storm-starter.jar
storm.starter.ReachRun
Running: java -client -Dstorm.options=
-Dstorm.home=/home/storm/storm-0.9.0-wip3
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp
/home/storm/storm-0.9.0-wip3/storm-0.9.0-wip3.jar:/home/storm/storm-0.9.0-wip3/lib/logback-classic-1.0.6.jar:/home/storm/storm-0.9.0-wip3/lib/httpclient-4.1.1.jar:/home/storm/storm-0.9.0-wip3/lib/slf4j-api-1.6.5.jar:/home/storm/storm-0.9.0-wip3/lib/ring-servlet-0.3.11.jar:/home/storm/storm-0.9.0-wip3/lib/joda-time-2.0.jar:/home/storm/storm-0.9.0-wip3/lib/zookeeper-3.3.3.jar:/home/storm/storm-0.9.0-wip3/lib/json-simple-1.1.jar:/home/storm/storm-0.9.0-wip3/lib/tools.logging-0.2.3.jar:/home/storm/storm-0.9.0-wip3/lib/clj-time-0.4.1.jar:/home/storm/storm-0.9.0-wip3/lib/logback-core-1.0.6.jar:/home/storm/storm-0.9.0-wip3/lib/jline-0.9.94.jar:/home/storm/storm-0.9.0-wip3/lib/curator-client-1.0.1.jar:/home/storm/storm-0.9.0-wip3/lib/math.numeric-tower-0.0.1.jar:/home/storm/storm-0.9.0-wip3/lib/servlet-api-2.5-20081211.jar:/home/storm/storm-0.9.0-wip3/lib/libthrift7-0.7.0.jar:/home/storm/storm-0.9.0-wip3/lib/log4j-over-slf4j-1.6.6.jar:/home/storm/storm-0.9.0-wip3/lib/tools.cli-0.2.2.jar:/home/storm/storm-0.9.0-wip3/lib/jetty-util-6.1.26.jar:/home/storm/storm-0.9.0-wip3/lib/commons-exec-1.1.jar:/home/storm/storm-0.9.0-wip3/lib/carbonite-1.5.0.jar:/home/storm/storm-0.9.0-wip3/lib/httpcore-4.1.jar:/home/storm/storm-0.9.0-wip3/lib/compojure-0.6.4.jar:/home/storm/storm-0.9.0-wip3/lib/clout-0.4.1.jar:/home/storm/storm-0.9.0-wip3/lib/jgrapht-0.8.3.jar:/home/storm/storm-0.9.0-wip3/lib/jzmq-2.1.0.jar:/home/storm/storm-0.9.0-wip3/lib/tools.macro-0.1.0.jar:/home/storm/storm-0.9.0-wip3/lib/commons-fileupload-1.2.1.jar:/home/storm/storm-0.9.0-wip3/lib/minlog-1.2.jar:/home/storm/storm-0.9.0-wip3/lib/commons-io-1.4.jar:/home/storm/storm-0.9.0-wip3/lib/objenesis-1.2.jar:/home/storm/storm-0.9.0-wip3/lib/kryo-2.17.jar:/home/storm/storm-0.9.0-wip3/lib/guava-13.0.jar:/home/storm/storm-0.9.0-wip3/lib/commons-lang-2.5.jar:/home/storm/storm-0.9.0-wip3/lib/servlet-api-2.5.jar:/home/storm/storm-0.9.0-wip3/lib/ring-jetty-adapter-0.3.11.jar:/home/storm/storm-0.9.0-wip3/lib/junit-3.8.1.jar:/home/storm/storm-0.9.0-wip3/lib/ring-core-0.3.10.jar:/home/storm/storm-0.9.0-wip3/lib/asm-4.0.jar:/home/storm/storm-0.9.0-wip3/lib/core.incubator-0.1.0.jar:/home/storm/storm-0.9.0-wip3/lib/commons-codec-1.4.jar:/home/storm/storm-0.9.0-wip3/lib/jetty-6.1.26.jar:/home/storm/storm-0.9.0-wip3/lib/snakeyaml-1.9.jar:/home/storm/storm-0.9.0-wip3/lib/clojure-1.4.0.jar:/home/storm/storm-0.9.0-wip3/lib/reflectasm-1.07-shaded.jar:/home/storm/storm-0.9.0-wip3/lib/hiccup-0.3.6.jar:/home/storm/storm-0.9.0-wip3/lib/curator-framework-1.0.1.jar:/home/storm/storm-0.9.0-wip3/lib/commons-logging-1.1.1.jar:/home/storm/storm-0.9.0-wip3/lib/disruptor-2.10.1.jar:/home/storm/storm-starter.jar:/home/storm/.storm:/home/storm/storm-0.9.0-wip3/bin
-Dstorm.jar=/home/storm/storm-starter.jar storm.starter.ReachRun
STATUS: Initiating DRPC Client...
STATUS: Get reach of foo.com/blog/1
Exception in thread "main"
org.apache.thrift7.transport.TTransportException:
java.net.SocketTimeoutException: Read timed out
at
org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
at
org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:129)
at
org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)
at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
at
org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
at
org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
at
org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
at org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)
at
backtype.storm.generated.DistributedRPC$Client.recv_execute(DistributedRPC.java:75)
at
backtype.storm.generated.DistributedRPC$Client.execute(DistributedRPC.java:61)
at backtype.storm.utils.DRPCClient.execute(DRPCClient.java:54)
at storm.starter.ReachRun.main(ReachRun.java:54)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at
org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 12 more



Here is the status of ReachTopology in "Storm UI":
--------------------------------------------------
Topology summary
Name Id Status Uptime Num workers Num executors Num tasks
reach reach-1-1354674326 ACTIVE 16m 13s 4 30 30

Search Discussions

  • Nathan Marz at Dec 6, 2012 at 9:50 pm
    The things to check are that your topology is configured to read requests
    from the same DRPC server and that it's checking for "reach". You can put
    TOPOLOGY_DEBUG on to see if it's receiving requests.
    On Wed, Dec 5, 2012 at 7:02 AM, Ian Jiang wrote:

    Hi all

    I am new to storm.

    As far as i know, when submitting to a remote storm cluster, the Reach
    Topology in storm.starter only starts a DRPC server, and does not has any
    client request. So I build a separate client, called "ReachRun", to test
    the DRPC server. But the client gets a "Read timed out" exception when
    trying to connect.
    Any suggestion is appreciated.

    Here is my client:
    ------------------
    public class ReachRun{

    public static void main(String[] args) throws Exception {
    System.out.println("STATUS: Initiating DRPC Client...");
    DRPCClient client = new DRPCClient("pcie-1", 3772, 1024*8);
    String[] urlsToTry = new String[] { "foo.com/blog/1", "
    engineering.twitter.com/blog/**5 <http://engineering.twitter.com/blog/5>",
    "notaurl.com"};
    for(String url: urlsToTry) {
    System.out.println("STATUS: Get reach of " + url);
    System.out.println("Reach of " + url + ": " +
    client.execute("reach", url));
    }
    }
    }


    and the running log:
    --------------------
    [storm@pcie-1 ~]$ ./storm-0.9.0-wip3//bin/storm jar ~/storm-starter.jar
    storm.starter.ReachRun
    Running: java -client -Dstorm.options= -Dstorm.home=/home/storm/**storm-0.9.0-wip3
    -Djava.library.path=/usr/**local/lib:/opt/local/lib:/usr/**lib
    -Dstorm.conf.file= -cp /home/storm/storm-0.9.0-wip3/**
    storm-0.9.0-wip3.jar:/home/**storm/storm-0.9.0-wip3/lib/**
    logback-classic-1.0.6.jar:/**home/storm/storm-0.9.0-wip3/**
    lib/httpclient-4.1.1.jar:/**home/storm/storm-0.9.0-wip3/**
    lib/slf4j-api-1.6.5.jar:/home/**storm/storm-0.9.0-wip3/lib/**
    ring-servlet-0.3.11.jar:/home/**storm/storm-0.9.0-wip3/lib/**
    joda-time-2.0.jar:/home/storm/**storm-0.9.0-wip3/lib/**
    zookeeper-3.3.3.jar:/home/**storm/storm-0.9.0-wip3/lib/**
    json-simple-1.1.jar:/home/**storm/storm-0.9.0-wip3/lib/**
    tools.logging-0.2.3.jar:/home/**storm/storm-0.9.0-wip3/lib/**
    clj-time-0.4.1.jar:/home/**storm/storm-0.9.0-wip3/lib/**
    logback-core-1.0.6.jar:/home/**storm/storm-0.9.0-wip3/lib/**
    jline-0.9.94.jar:/home/storm/**storm-0.9.0-wip3/lib/curator-**
    client-1.0.1.jar:/home/storm/**storm-0.9.0-wip3/lib/math.**
    numeric-tower-0.0.1.jar:/home/**storm/storm-0.9.0-wip3/lib/**
    servlet-api-2.5-20081211.jar:/**home/storm/storm-0.9.0-wip3/**
    lib/libthrift7-0.7.0.jar:/**home/storm/storm-0.9.0-wip3/**
    lib/log4j-over-slf4j-1.6.6.**jar:/home/storm/storm-0.9.0-**
    wip3/lib/tools.cli-0.2.2.jar:/**home/storm/storm-0.9.0-wip3/**
    lib/jetty-util-6.1.26.jar:/**home/storm/storm-0.9.0-wip3/**
    lib/commons-exec-1.1.jar:/**home/storm/storm-0.9.0-wip3/**
    lib/carbonite-1.5.0.jar:/home/**storm/storm-0.9.0-wip3/lib/**
    httpcore-4.1.jar:/home/storm/**storm-0.9.0-wip3/lib/**
    compojure-0.6.4.jar:/home/**storm/storm-0.9.0-wip3/lib/**
    clout-0.4.1.jar:/home/storm/**storm-0.9.0-wip3/lib/jgrapht-**
    0.8.3.jar:/home/storm/storm-0.**9.0-wip3/lib/jzmq-2.1.0.jar:/**
    home/storm/storm-0.9.0-wip3/**lib/tools.macro-0.1.0.jar:/**
    home/storm/storm-0.9.0-wip3/**lib/commons-fileupload-1.2.1.**
    jar:/home/storm/storm-0.9.0-**wip3/lib/minlog-1.2.jar:/home/**
    storm/storm-0.9.0-wip3/lib/**commons-io-1.4.jar:/home/**
    storm/storm-0.9.0-wip3/lib/**objenesis-1.2.jar:/home/storm/**
    storm-0.9.0-wip3/lib/kryo-2.**17.jar:/home/storm/storm-0.9.**
    0-wip3/lib/guava-13.0.jar:/**home/storm/storm-0.9.0-wip3/**
    lib/commons-lang-2.5.jar:/**home/storm/storm-0.9.0-wip3/**
    lib/servlet-api-2.5.jar:/home/**storm/storm-0.9.0-wip3/lib/**
    ring-jetty-adapter-0.3.11.jar:**/home/storm/storm-0.9.0-wip3/**
    lib/junit-3.8.1.jar:/home/**storm/storm-0.9.0-wip3/lib/**
    ring-core-0.3.10.jar:/home/**storm/storm-0.9.0-wip3/lib/**
    asm-4.0.jar:/home/storm/storm-**0.9.0-wip3/lib/core.incubator-**
    0.1.0.jar:/home/storm/storm-0.**9.0-wip3/lib/commons-codec-1.**
    4.jar:/home/storm/storm-0.9.0-**wip3/lib/jetty-6.1.26.jar:/**
    home/storm/storm-0.9.0-wip3/**lib/snakeyaml-1.9.jar:/home/**
    storm/storm-0.9.0-wip3/lib/**clojure-1.4.0.jar:/home/storm/**
    storm-0.9.0-wip3/lib/**reflectasm-1.07-shaded.jar:/**
    home/storm/storm-0.9.0-wip3/**lib/hiccup-0.3.6.jar:/home/**
    storm/storm-0.9.0-wip3/lib/**curator-framework-1.0.1.jar:/**
    home/storm/storm-0.9.0-wip3/**lib/commons-logging-1.1.1.jar:**
    /home/storm/storm-0.9.0-wip3/**lib/disruptor-2.10.1.jar:/**
    home/storm/storm-starter.jar:/**home/storm/.storm:/home/storm/**storm-0.9.0-wip3/bin
    -Dstorm.jar=/home/storm/storm-**starter.jar storm.starter.ReachRun
    STATUS: Initiating DRPC Client...
    STATUS: Get reach of foo.com/blog/1
    Exception in thread "main" org.apache.thrift7.transport.**TTransportException:
    java.net.**SocketTimeoutException: Read timed out
    at org.apache.thrift7.transport.**TIOStreamTransport.read(**
    TIOStreamTransport.java:129)
    at org.apache.thrift7.transport.**TTransport.readAll(TTransport.**java:84)
    at org.apache.thrift7.transport.**TFramedTransport.readFrame(**
    TFramedTransport.java:129)
    at org.apache.thrift7.transport.**TFramedTransport.read(**
    TFramedTransport.java:101)
    at org.apache.thrift7.transport.**TTransport.readAll(TTransport.**java:84)
    at org.apache.thrift7.protocol.**TBinaryProtocol.readAll(**
    TBinaryProtocol.java:378)
    at org.apache.thrift7.protocol.**TBinaryProtocol.readI32(**
    TBinaryProtocol.java:297)
    at org.apache.thrift7.protocol.**TBinaryProtocol.**readMessageBegin(**
    TBinaryProtocol.java:204)
    at org.apache.thrift7.**TServiceClient.receiveBase(**
    TServiceClient.java:69)
    at backtype.storm.generated.**DistributedRPC$Client.recv_**
    execute(DistributedRPC.java:**75)
    at backtype.storm.generated.**DistributedRPC$Client.execute(**
    DistributedRPC.java:61)
    at backtype.storm.utils.**DRPCClient.execute(DRPCClient.**java:54)
    at storm.starter.ReachRun.main(**ReachRun.java:54)
    Caused by: java.net.**SocketTimeoutException: Read timed out
    at java.net.SocketInputStream.**socketRead0(Native Method)
    at java.net.SocketInputStream.**read(SocketInputStream.java:**129)
    at org.apache.thrift7.transport.**TIOStreamTransport.read(**
    TIOStreamTransport.java:127)
    ... 12 more



    Here is the status of ReachTopology in "Storm UI":
    ------------------------------**--------------------
    Topology summary
    Name Id Status Uptime Num workers Num executors Num tasks
    reach reach-1-1354674326 ACTIVE 16m 13s 4 30 30


    --
    Twitter: @nathanmarz
    http://nathanmarz.com

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupstorm-user @
postedDec 6, '12 at 9:47p
activeDec 6, '12 at 9:50p
posts2
users2
websitestorm-project.net
irc#storm-user

2 users in discussion

Nathan Marz: 1 post Ian Jiang: 1 post

People

Translate

site design / logo © 2022 Grokbase