FAQ
Hi PK,

I noticed that you're using 1.10.0. Can you try it with 1.10.1 please?


Paul
On Thursday, 28 March 2013 22:19:51 UTC, PK wrote:

Its a strange error that I am seeing. The SubQuery creates two mappers. If
I run a SubQuery with the sink tap being StdOut(), then the results are
combined perfectly. But if I change the sink tap to be HFS by using
Api.HFSTextline, then results from only one mapper are saved to the output
file.

*LOG from StdOut tap*
13/03/28 15:03:57 INFO planner.HadoopPlanner: using application jar:
/home/parminder/xxxxxxxxxx/core-1.0-executable.jar
13/03/28 15:03:57 INFO property.AppProps: using app.id:
8737A4424E7D35D3EF44BE981C786017
13/03/28 15:03:57 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
13/03/28 15:03:58 INFO hadoop.Hfs: forcing job to local mode, via sink:
StdoutTap["SequenceFile[[UNKNOWN]->['!sum_rfm_us', '!rowKey_rfm_us',
'!lstEvtTs_rfm_us']]"]["/tmp/temp141354289041716917719046016468732"]"]
13/03/28 15:03:58 INFO util.Version: Concurrent, Inc - Cascading 2.0.0
13/03/28 15:03:58 INFO flow.Flow: [] starting
13/03/28 15:03:58 INFO flow.Flow: [] source: hbase://rfm_us
13/03/28 15:03:58 INFO flow.Flow: [] sink:
StdoutTap["SequenceFile[[UNKNOWN]->['!sum_rfm_us', '!rowKey_rfm_us',
'!lstEvtTs_rfm_us']]"]["/tmp/temp141354289041716917719046016468732"]"]
13/03/28 15:03:58 INFO flow.Flow: [] parallel execution is enabled: true
13/03/28 15:03:58 INFO flow.Flow: [] starting jobs: 1
13/03/28 15:03:58 INFO flow.Flow: [] allocating threads: 1
13/03/28 15:03:58 INFO flow.FlowStep: [] starting step: (1/1)
...9041716917719046016468732
13/03/28 15:03:58 WARN conf.Configuration: session.id is deprecated.
Instead, use dfs.metrics.session-id
13/03/28 15:03:58 INFO jvm.JvmMetrics: Initializing JVM Metrics with
processName=JobTracker, sessionId=
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.4.5-cdh4.2.0--1, built on 02/15/2013 18:33
GMT
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client environment:host.name
=localhost
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client
environment:java.version=1.6.0_31
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client
environment:java.vendor=Sun Microsystems Inc.
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client
environment:java.home=/usr/lib/jvm/jdk1.6.0_31/jre
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client
environment:java.class.path=/home/parminder/git/bigDataAnalytics/core/target/test-classes:/home/parminder/git/bigDataAnalytics/core/target/classes:/home/parminder/.m2/repository/com/dexone/bigdata/common/1.0-SNAPSHOT/common-1.0-SNAPSHOT.jar:/home/parminder/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/parminder/.m2/repository/org/apache/hadoop/hadoop-client/2.0.0-mr1-cdh4.2.0/hadoop-client-2.0.0-mr1-cdh4.2.0.jar:/home/parminder/.m2/repository/org/apache/hadoop/hadoop-common/2.0.0-cdh4.2.0/hadoop-common-2.0.0-cdh4.2.0.jar:/home/parminder/.m2/repository/org/apache/hadoop/hadoop-annotations/2.0.0-cdh4.2.0/hadoop-annotations-2.0.0-cdh4.2.0.jar:/home/parminder/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar:/home/parminder/.m2/repository/org/mockito/mockito-all/1.8.5/mockito-all-1.8.5.jar:/home/parminder/.m2/repository/org/apache/avro/avro/1.7.3/avro-1.7.3.jar:/home/parminder/.m2/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/home/parminder/.m2/repository/org/xerial/snappy/snappy-java/
1.0.4.1/snappy-java-1.0.4.1.jar:/home/parminder/.m2/repository/org/apache/hadoop/hadoop-auth/2.0.0-cdh4.2.0/hadoop-auth-2.0.0-cdh4.2.0.jar:/home/parminder/.m2/repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/usr/lib/jvm/jdk1.6.0_31/jre/../lib/tools.jar:/home/parminder/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.0.0-cdh4.2.0/hadoop-hdfs-2.0.0-cdh4.2.0.jar:/home/parminder/.m2/repository/org/apache/hbase/hbase/0.94.2-cdh4.2.0/hbase-0.94.2-cdh4.2.0.jar:/home/parminder/.m2/repository/com/yammer/metrics/metrics-core/2.1.2/metrics-core-2.1.2.jar:/home/parminder/.m2/repository/com/google/guava/guava/11.0.2/guava-11.0.2.jar:/home/parminder/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/home/parminder/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/parminder/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/parminder/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/home/parminder/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/parminder/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/home/parminder/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/home/parminder/.m2/repository/com/github/stephenc/high-scale-lib/high-scale-lib/1.1.1/high-scale-lib-1.1.1.jar:/home/parminder/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar:/home/parminder/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/home/parminder/.m2/repository/commons-io/commons-io/2.1/commons-io-2.1.jar:/home/parminder/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar:/home/parminder/.m2/repository/org/apache/zookeeper/zookeeper/3.4.5-cdh4.2.0/zookeeper-3.4.5-cdh4.2.0.jar:/home/parminder/.m2/repository/org/apache/thrift/libthrift/0.9.0/libthrift-0.9.0.jar:/home/parminder/.m2/repository/org/apache/httpcomponents/httpclient/4.1.3/httpclient-4.1.3.jar:/home/parminder/.m2/repository/org/apache/httpcomponents/httpcore/4.1.3/httpcore-4.1.3.jar:/home/parminder/.m2/repository/org/jruby/jruby-complete/1.6.5/jruby-complete-1.6.5.jar:/home/parminder/.m2/repository/org/mortbay/jetty/jetty/6.1.26.cloudera.2/jetty-6.1.26.cloudera.2.jar:/home/parminder/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26.cloudera.2/jetty-util-6.1.26.cloudera.2.jar:/home/parminder/.m2/repository/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar:/home/parminder/.m2/repository/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar:/home/parminder/.m2/repository/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar:/home/parminder/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.8.8/jackson-mapper-asl-1.8.8.jar:/home/parminder/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.8.8/jackson-jaxrs-1.8.8.jar:/home/parminder/.m2/repository/org/codehaus/jackson/jackson-xc/1.8.8/jackson-xc-1.8.8.jar:/home/parminder/.m2/repository/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.5.23.jar:/home/parminder/.m2/repository/tomcat/jasper-runtime/5.5.23/jasper-runtime-5.5.23.jar:/home/parminder/.m2/repository/org/jamon/jamon-runtime/2.3.1/jamon-runtime-2.3.1.jar:/home/parminder/.m2/repository/com/google/protobuf/protobuf-java/2.4.0a/protobuf-java-2.4.0a.jar:/home/parminder/.m2/repository/com/sun/jersey/jersey-core/1.8/jersey-core-1.8.jar:/home/parminder/.m2/repository/com/sun/jersey/jersey-json/1.8/jersey-json-1.8.jar:/home/parminder/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar:/home/parminder/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/home/parminder/.m2/repository/com/sun/jersey/jersey-server/1.8/jersey-server-1.8.jar:/home/parminder/.m2/repository/asm/asm/3.1/asm-3.1.jar:/home/parminder/.m2/repository/javax/xml/bind/jaxb-api/2.1/jaxb-api-2.1.jar:/home/parminder/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/home/parminder/.m2/repository/stax/stax-api/1.0.1/stax-api-1.0.1.jar:/home/parminder/.m2/repository/org/apache/hadoop/hadoop-core/2.0.0-mr1-cdh4.2.0/hadoop-core-2.0.0-mr1-cdh4.2.0.jar:/home/parminder/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/parminder/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/parminder/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/parminder/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar:/home/parminder/.m2/repository/net/java/dev/jets3t/jets3t/0.6.1/jets3t-0.6.1.jar:/home/parminder/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/home/parminder/.m2/repository/hsqldb/hsqldb/1.8.0.10/hsqldb-1.8.0.10.jar:/home/parminder/.m2/repository/org/eclipse/jdt/core/3.1.1/core-3.1.1.jar:/home/parminder/.m2/repository/cascalog/cascalog/1.10.0/cascalog-1.10.0.jar:/home/parminder/.m2/repository/org/clojure/tools.macro/0.1.1/tools.macro-0.1.1.jar:/home/parminder/.m2/repository/cascading/cascading-hadoop/2.0.0/cascading-hadoop-2.0.0.jar:/home/parminder/.m2/repository/cascading/cascading-core/2.0.0/cascading-core-2.0.0.jar:/home/parminder/.m2/repository/riffle/riffle/0.1-dev/riffle-0.1-dev.jar:/home/parminder/.m2/repository/thirdparty/jgrapht-jdk1.6/0.8.1/jgrapht-jdk1.6-0.8.1.jar:/home/parminder/.m2/repository/cascading/kryo/cascading.kryo/0.4.0/cascading.kryo-0.4.0.jar:/home/parminder/.m2/repository/com/esotericsoftware/kryo/kryo/2.16/kryo-2.16.jar:/home/parminder/.m2/repository/com/esotericsoftware/reflectasm/reflectasm/1.06/reflectasm-1.06-shaded.jar:/home/parminder/.m2/repository/org/ow2/asm/asm/4.0/asm-4.0.jar:/home/parminder/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/home/parminder/.m2/repository/cascalog/carbonite/1.3.0/carbonite-1.3.0.jar:/home/parminder/.m2/repository/com/twitter/meat-locker/0.3.0/meat-locker-0.3.0.jar:/home/parminder/.m2/repository/hadoop-util/hadoop-util/0.2.8/hadoop-util-0.2.8.jar:/home/parminder/.m2/repository/com/twitter/maple/0.2.0/maple-0.2.0.jar:/home/parminder/.m2/repository/jackknife/jackknife/0.1.2/jackknife-0.1.2.jar:/home/parminder/.m2/repository/org/clojure/tools.logging/0.2.3/tools.logging-0.2.3.jar:/home/parminder/.m2/repository/org/clojure/clojure/1.4.0/clojure-1.4.0.jar:/home/parminder/.m2/repository/org/clojars/sorenmacbeth/cascading.hbase/1.2.9-SNAPSHOT/cascading.hbase-1.2.9-SNAPSHOT.jar:/home/parminder/.m2/repository/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar:/home/parminder/.m2/repository/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar:/home/parminder/.m2/repository/org/hibernate/javax/persistence/hibernate-jpa-2.0-api/1.0.0.Final/hibernate-jpa-2.0-api-1.0.0.Final.jar:/home/parminder/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.9/jackson-core-asl-1.9.9.jar:/home/parminder/.m2/repository/joda-time/joda-time/2.1/joda-time-2.1.jar:/home/parminder/.m2/repository/org/springframework/spring-context/3.2.0.RELEASE/spring-context-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/org/springframework/spring-aop/3.2.0.RELEASE/spring-aop-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar:/home/parminder/.m2/repository/org/springframework/spring-expression/3.2.0.RELEASE/spring-expression-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/org/springframework/spring-beans/3.2.0.RELEASE/spring-beans-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/org/springframework/spring-core/3.2.0.RELEASE/spring-core-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/org/springframework/spring-test/3.2.0.RELEASE/spring-test-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/org/springframework/spring-webmvc/3.2.0.RELEASE/spring-webmvc-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/org/springframework/spring-web/3.2.0.RELEASE/spring-web-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/org/apache/commons/commons-lang3/3.1/commons-lang3-3.1.jar:/home/parminder/.m2/repository/org/slf4j/slf4j-api/1.6.1/slf4j-api-1.6.1.jar:/home/parminder/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar:/home/parminder/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/parminder/.m2/repository/junit/junit/4.11/junit-4.11.jar:/home/parminder/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/parminder/.m2/repository/org/mockito/mockito-core/1.9.5/mockito-core-1.9.5.jar:/home/parminder/.m2/repository/org/objenesis/objenesis/1.0/objenesis-1.0.jar
:
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client
environment:java.library.path=/usr/lib/jvm/jdk1.6.0_31/jre/lib/amd64/server:/usr/lib/jvm/jdk1.6.0_31/jre/lib/amd64:/usr/lib/jvm/jdk1.6.0_31/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client environment:os.name
=Linux
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client
environment:os.arch=amd64
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client
environment:os.version=3.2.0-39-generic
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client environment:user.name
=parminder
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client
environment:user.home=/home/parminder
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Client
environment:user.dir=/home/parminder/git/bigDataAnalytics/core
13/03/28 15:03:59 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=localhost:2181 sessionTimeout=180000 watcher=hconnection
13/03/28 15:03:59 INFO zookeeper.RecoverableZooKeeper: The identifier of
this process is 7967@parminder-VirtualBox
13/03/28 15:03:59 INFO zookeeper.ClientCnxn: Opening socket connection to
server localhost/127.0.0.1:2181. Will not attempt to authenticate using
SASL (Unable to locate a login configuration)
13/03/28 15:03:59 INFO zookeeper.ClientCnxn: Socket connection
established to localhost/127.0.0.1:2181, initiating session
13/03/28 15:03:59 INFO zookeeper.ClientCnxn: Session establishment
complete on server localhost/127.0.0.1:2181, sessionid =
0x13db1e5a6c60097, negotiated timeout = 40000
13/03/28 15:03:59 WARN conf.Configuration: hadoop.native.lib is
deprecated. Instead, use io.native.lib.available
13/03/28 15:03:59 WARN conf.Configuration: fs.default.name is
deprecated. Instead, use fs.defaultFS
13/03/28 15:04:00 INFO flow.FlowStep: [] submitted hadoop job:
job_local1582874488_0001
13/03/28 15:04:00 INFO mapred.LocalJobRunner: OutputCommitter set in
config null
13/03/28 15:04:00 INFO mapred.LocalJobRunner: OutputCommitter is
org.apache.hadoop.mapred.FileOutputCommitter
13/03/28 15:04:00 INFO mapred.LocalJobRunner: Waiting for map tasks
13/03/28 15:04:00 INFO mapred.LocalJobRunner: Starting task:
attempt_local1582874488_0001_m_000000_0
13/03/28 15:04:00 WARN mapreduce.Counters: Group
org.apache.hadoop.mapred.Task$Counter is deprecated. Use
org.apache.hadoop.mapreduce.TaskCounter instead
13/03/28 15:04:00 INFO util.ProcessTree: setsid exited with exit code 0
13/03/28 15:04:00 INFO mapred.Task: Using ResourceCalculatorPlugin :
org.apache.hadoop.util.LinuxResourceCalculatorPlugin@20e1bfee
13/03/28 15:04:00 INFO hadoop.TupleSerialization: using default
comparator: cascalog.hadoop.DefaultComparator
13/03/28 15:04:00 INFO mapred.MapTask: Processing split:
cascading.tap.hadoop.io.MultiInputSplit@3dd510be
13/03/28 15:04:00 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES
is deprecated. Use FileInputFormatCounters as group name and BYTES_READ as
counter name instead
13/03/28 15:04:00 INFO mapred.MapTask: numReduceTasks: 0
13/03/28 15:04:00 INFO hadoop.TupleSerialization: using default
comparator: cascalog.hadoop.DefaultComparator
13/03/28 15:04:00 INFO hadoop.FlowMapper: sourcing from:
hbase://rfm_usersession
13/03/28 15:04:00 INFO hadoop.FlowMapper: sinking to:
StdoutTap["SequenceFile[[UNKNOWN]->['!sum_rfm_us', '!rowKey_rfm_us',
'!lstEvtTs_rfm_us']]"]["/tmp/temp141354289041716917719046016468732"]"]
13/03/28 15:04:06 INFO mapred.LocalJobRunner:
13/03/28 15:04:09 INFO mapred.LocalJobRunner:
13/03/28 15:04:12 INFO mapred.LocalJobRunner:
13/03/28 15:04:15 INFO mapred.LocalJobRunner:
13/03/28 15:04:18 INFO mapred.LocalJobRunner:
13/03/28 15:04:21 INFO mapred.LocalJobRunner:
13/03/28 15:04:24 INFO mapred.LocalJobRunner:
13/03/28 15:04:27 INFO mapred.LocalJobRunner:
13/03/28 15:04:30 INFO mapred.LocalJobRunner:
13/03/28 15:04:33 INFO mapred.LocalJobRunner:
13/03/28 15:04:36 INFO mapred.LocalJobRunner:
13/03/28 15:04:39 INFO mapred.LocalJobRunner:
13/03/28 15:04:42 INFO mapred.LocalJobRunner:
13/03/28 15:04:45 INFO mapred.LocalJobRunner:
13/03/28 15:04:48 INFO mapred.LocalJobRunner:
13/03/28 15:04:51 INFO mapred.LocalJobRunner:
13/03/28 15:04:54 INFO mapred.LocalJobRunner:
13/03/28 15:04:57 INFO mapred.LocalJobRunner:
13/03/28 15:05:00 INFO mapred.LocalJobRunner:
13/03/28 15:05:02 INFO mapred.Task:
Task:attempt_local1582874488_0001_m_000000_0 is done. And is in the process
of commiting
13/03/28 15:05:02 INFO mapred.LocalJobRunner:
13/03/28 15:05:02 INFO mapred.Task: Task
attempt_local1582874488_0001_m_000000_0 is allowed to commit now
13/03/28 15:05:02 INFO mapred.FileOutputCommitter: Saved output of task
'attempt_local1582874488_0001_m_000000_0' to
file:/tmp/temp141354289041716917719046016468732
13/03/28 15:05:02 INFO mapred.LocalJobRunner:
13/03/28 15:05:02 INFO mapred.Task: Task
'attempt_local1582874488_0001_m_000000_0' done.
13/03/28 15:05:02 INFO mapred.LocalJobRunner: Finishing task:
attempt_local1582874488_0001_m_000000_0
13/03/28 15:05:02 INFO mapred.LocalJobRunner: Starting task:
attempt_local1582874488_0001_m_000001_0
13/03/28 15:05:02 WARN mapreduce.Counters: Group
org.apache.hadoop.mapred.Task$Counter is deprecated. Use
org.apache.hadoop.mapreduce.TaskCounter instead
13/03/28 15:05:02 INFO mapred.Task: Using ResourceCalculatorPlugin :
org.apache.hadoop.util.LinuxResourceCalculatorPlugin@472b4a45
13/03/28 15:05:02 INFO hadoop.TupleSerialization: using default
comparator: cascalog.hadoop.DefaultComparator
13/03/28 15:05:02 INFO mapred.MapTask: Processing split:
cascading.tap.hadoop.io.MultiInputSplit@50440fd3
13/03/28 15:05:02 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES
is deprecated. Use FileInputFormatCounters as group name and BYTES_READ as
counter name instead
13/03/28 15:05:02 INFO mapred.MapTask: numReduceTasks: 0
13/03/28 15:05:02 INFO hadoop.TupleSerialization: using default
comparator: cascalog.hadoop.DefaultComparator
13/03/28 15:05:02 INFO hadoop.FlowMapper: sourcing from:
hbase://rfm_usersession
13/03/28 15:05:02 INFO hadoop.FlowMapper: sinking to:
StdoutTap["SequenceFile[[UNKNOWN]->['!sum_rfm_us', '!rowKey_rfm_us',
'!lstEvtTs_rfm_us']]"]["/tmp/temp141354289041716917719046016468732"]"]
13/03/28 15:05:08 INFO mapred.LocalJobRunner:
13/03/28 15:05:11 INFO mapred.LocalJobRunner:
13/03/28 15:05:14 INFO mapred.LocalJobRunner:
13/03/28 15:05:17 INFO mapred.LocalJobRunner:
13/03/28 15:05:20 INFO mapred.LocalJobRunner:
13/03/28 15:05:23 INFO mapred.LocalJobRunner:
13/03/28 15:05:26 INFO mapred.LocalJobRunner:
13/03/28 15:05:29 INFO mapred.LocalJobRunner:
13/03/28 15:05:32 INFO mapred.LocalJobRunner:
13/03/28 15:05:35 INFO mapred.LocalJobRunner:
13/03/28 15:05:38 INFO mapred.LocalJobRunner:
13/03/28 15:05:41 INFO mapred.LocalJobRunner:
13/03/28 15:05:44 INFO mapred.LocalJobRunner:
13/03/28 15:05:47 INFO mapred.LocalJobRunner:
13/03/28 15:05:50 INFO mapred.LocalJobRunner:
13/03/28 15:05:52 INFO mapred.Task:
Task:attempt_local1582874488_0001_m_000001_0 is done. And is in the process
of commiting
13/03/28 15:05:52 INFO mapred.LocalJobRunner:
13/03/28 15:05:52 INFO mapred.Task: Task
attempt_local1582874488_0001_m_000001_0 is allowed to commit now
13/03/28 15:05:52 INFO mapred.FileOutputCommitter: Saved output of task
'attempt_local1582874488_0001_m_000001_0' to
file:/tmp/temp141354289041716917719046016468732
13/03/28 15:05:52 INFO mapred.LocalJobRunner:
13/03/28 15:05:52 INFO mapred.Task: Task
'attempt_local1582874488_0001_m_000001_0' done.
13/03/28 15:05:52 INFO mapred.LocalJobRunner: Finishing task:
attempt_local1582874488_0001_m_000001_0
13/03/28 15:05:52 INFO mapred.LocalJobRunner: Map task executor complete.
13/03/28 15:05:53 WARN conf.Configuration: fs.default.name is
deprecated. Instead, use fs.defaultFS
13/03/28 15:05:53 INFO hadoop.Hfs: forcing job to local mode, via source:
StdoutTap["SequenceFile[[UNKNOWN]->['!sum_rfm_us', '!rowKey_rfm_us',
'!lstEvtTs_rfm_us']]"]["/tmp/temp141354289041716917719046016468732"]"]
13/03/28 15:05:53 INFO mapred.FileInputFormat: Total input paths to
process : 2
13/03/28 15:05:53 INFO hadoop.TupleSerialization: using default
comparator: cascalog.hadoop.DefaultComparator

*LOG from HFS tap*
13/03/28 15:00:28 INFO planner.HadoopPlanner: using application jar:
/home/parminder/xxxxxxxxxxxx/core-1.0-executable.jar
13/03/28 15:00:28 INFO property.AppProps: using app.id:
4AB0579FC9646E0A0B7750FA7E621603
13/03/28 15:00:28 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
13/03/28 15:00:29 INFO util.Version: Concurrent, Inc - Cascading 2.0.0
13/03/28 15:00:29 INFO flow.Flow: [] starting
13/03/28 15:00:29 INFO flow.Flow: [] source: hbase://rfm_us
13/03/28 15:00:29 INFO flow.Flow: [] sink:
Hfs["TextLine[['line']->['!sum_rfm_us', '!rowKey_rfm_us',
'!lstEvtTs_rfm_us']]"]["hdfs://localhost:8020/user/parminder/job-/output_1364508024996"]"]
13/03/28 15:00:29 INFO flow.Flow: [] parallel execution is enabled: true
13/03/28 15:00:29 INFO flow.Flow: [] starting jobs: 1
13/03/28 15:00:29 INFO flow.Flow: [] allocating threads: 1
13/03/28 15:00:29 INFO flow.FlowStep: [] starting step: (1/1)
...job-/output_1364508024996
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.4.5-cdh4.2.0--1, built on 02/15/2013 18:33
GMT
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client environment:host.name
=localhost
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client
environment:java.version=1.6.0_31
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client
environment:java.vendor=Sun Microsystems Inc.
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client
environment:java.home=/usr/lib/jvm/jdk1.6.0_31/jre
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client
environment:java.class.path=/home/parminder/git/bigDataAnalytics/core/target/test-classes:/home/parminder/git/bigDataAnalytics/core/target/classes:/home/parminder/.m2/repository/com/dexone/bigdata/common/1.0-SNAPSHOT/common-1.0-SNAPSHOT.jar:/home/parminder/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/parminder/.m2/repository/org/apache/hadoop/hadoop-client/2.0.0-mr1-cdh4.2.0/hadoop-client-2.0.0-mr1-cdh4.2.0.jar:/home/parminder/.m2/repository/org/apache/hadoop/hadoop-common/2.0.0-cdh4.2.0/hadoop-common-2.0.0-cdh4.2.0.jar:/home/parminder/.m2/repository/org/apache/hadoop/hadoop-annotations/2.0.0-cdh4.2.0/hadoop-annotations-2.0.0-cdh4.2.0.jar:/home/parminder/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar:/home/parminder/.m2/repository/org/mockito/mockito-all/1.8.5/mockito-all-1.8.5.jar:/home/parminder/.m2/repository/org/apache/avro/avro/1.7.3/avro-1.7.3.jar:/home/parminder/.m2/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/home/parminder/.m2/repository/org/xerial/snappy/snappy-java/
1.0.4.1/snappy-java-1.0.4.1.jar:/home/parminder/.m2/repository/org/apache/hadoop/hadoop-auth/2.0.0-cdh4.2.0/hadoop-auth-2.0.0-cdh4.2.0.jar:/home/parminder/.m2/repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/usr/lib/jvm/jdk1.6.0_31/jre/../lib/tools.jar:/home/parminder/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.0.0-cdh4.2.0/hadoop-hdfs-2.0.0-cdh4.2.0.jar:/home/parminder/.m2/repository/org/apache/hbase/hbase/0.94.2-cdh4.2.0/hbase-0.94.2-cdh4.2.0.jar:/home/parminder/.m2/repository/com/yammer/metrics/metrics-core/2.1.2/metrics-core-2.1.2.jar:/home/parminder/.m2/repository/com/google/guava/guava/11.0.2/guava-11.0.2.jar:/home/parminder/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/home/parminder/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/parminder/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/parminder/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/home/parminder/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/parminder/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/home/parminder/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/home/parminder/.m2/repository/com/github/stephenc/high-scale-lib/high-scale-lib/1.1.1/high-scale-lib-1.1.1.jar:/home/parminder/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar:/home/parminder/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/home/parminder/.m2/repository/commons-io/commons-io/2.1/commons-io-2.1.jar:/home/parminder/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar:/home/parminder/.m2/repository/org/apache/zookeeper/zookeeper/3.4.5-cdh4.2.0/zookeeper-3.4.5-cdh4.2.0.jar:/home/parminder/.m2/repository/org/apache/thrift/libthrift/0.9.0/libthrift-0.9.0.jar:/home/parminder/.m2/repository/org/apache/httpcomponents/httpclient/4.1.3/httpclient-4.1.3.jar:/home/parminder/.m2/repository/org/apache/httpcomponents/httpcore/4.1.3/httpcore-4.1.3.jar:/home/parminder/.m2/repository/org/jruby/jruby-complete/1.6.5/jruby-complete-1.6.5.jar:/home/parminder/.m2/repository/org/mortbay/jetty/jetty/6.1.26.cloudera.2/jetty-6.1.26.cloudera.2.jar:/home/parminder/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26.cloudera.2/jetty-util-6.1.26.cloudera.2.jar:/home/parminder/.m2/repository/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar:/home/parminder/.m2/repository/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar:/home/parminder/.m2/repository/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar:/home/parminder/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.8.8/jackson-mapper-asl-1.8.8.jar:/home/parminder/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.8.8/jackson-jaxrs-1.8.8.jar:/home/parminder/.m2/repository/org/codehaus/jackson/jackson-xc/1.8.8/jackson-xc-1.8.8.jar:/home/parminder/.m2/repository/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.5.23.jar:/home/parminder/.m2/repository/tomcat/jasper-runtime/5.5.23/jasper-runtime-5.5.23.jar:/home/parminder/.m2/repository/org/jamon/jamon-runtime/2.3.1/jamon-runtime-2.3.1.jar:/home/parminder/.m2/repository/com/google/protobuf/protobuf-java/2.4.0a/protobuf-java-2.4.0a.jar:/home/parminder/.m2/repository/com/sun/jersey/jersey-core/1.8/jersey-core-1.8.jar:/home/parminder/.m2/repository/com/sun/jersey/jersey-json/1.8/jersey-json-1.8.jar:/home/parminder/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar:/home/parminder/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/home/parminder/.m2/repository/com/sun/jersey/jersey-server/1.8/jersey-server-1.8.jar:/home/parminder/.m2/repository/asm/asm/3.1/asm-3.1.jar:/home/parminder/.m2/repository/javax/xml/bind/jaxb-api/2.1/jaxb-api-2.1.jar:/home/parminder/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/home/parminder/.m2/repository/stax/stax-api/1.0.1/stax-api-1.0.1.jar:/home/parminder/.m2/repository/org/apache/hadoop/hadoop-core/2.0.0-mr1-cdh4.2.0/hadoop-core-2.0.0-mr1-cdh4.2.0.jar:/home/parminder/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/parminder/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/parminder/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/parminder/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar:/home/parminder/.m2/repository/net/java/dev/jets3t/jets3t/0.6.1/jets3t-0.6.1.jar:/home/parminder/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/home/parminder/.m2/repository/hsqldb/hsqldb/1.8.0.10/hsqldb-1.8.0.10.jar:/home/parminder/.m2/repository/org/eclipse/jdt/core/3.1.1/core-3.1.1.jar:/home/parminder/.m2/repository/cascalog/cascalog/1.10.0/cascalog-1.10.0.jar:/home/parminder/.m2/repository/org/clojure/tools.macro/0.1.1/tools.macro-0.1.1.jar:/home/parminder/.m2/repository/cascading/cascading-hadoop/2.0.0/cascading-hadoop-2.0.0.jar:/home/parminder/.m2/repository/cascading/cascading-core/2.0.0/cascading-core-2.0.0.jar:/home/parminder/.m2/repository/riffle/riffle/0.1-dev/riffle-0.1-dev.jar:/home/parminder/.m2/repository/thirdparty/jgrapht-jdk1.6/0.8.1/jgrapht-jdk1.6-0.8.1.jar:/home/parminder/.m2/repository/cascading/kryo/cascading.kryo/0.4.0/cascading.kryo-0.4.0.jar:/home/parminder/.m2/repository/com/esotericsoftware/kryo/kryo/2.16/kryo-2.16.jar:/home/parminder/.m2/repository/com/esotericsoftware/reflectasm/reflectasm/1.06/reflectasm-1.06-shaded.jar:/home/parminder/.m2/repository/org/ow2/asm/asm/4.0/asm-4.0.jar:/home/parminder/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/home/parminder/.m2/repository/cascalog/carbonite/1.3.0/carbonite-1.3.0.jar:/home/parminder/.m2/repository/com/twitter/meat-locker/0.3.0/meat-locker-0.3.0.jar:/home/parminder/.m2/repository/hadoop-util/hadoop-util/0.2.8/hadoop-util-0.2.8.jar:/home/parminder/.m2/repository/com/twitter/maple/0.2.0/maple-0.2.0.jar:/home/parminder/.m2/repository/jackknife/jackknife/0.1.2/jackknife-0.1.2.jar:/home/parminder/.m2/repository/org/clojure/tools.logging/0.2.3/tools.logging-0.2.3.jar:/home/parminder/.m2/repository/org/clojure/clojure/1.4.0/clojure-1.4.0.jar:/home/parminder/.m2/repository/org/clojars/sorenmacbeth/cascading.hbase/1.2.9-SNAPSHOT/cascading.hbase-1.2.9-SNAPSHOT.jar:/home/parminder/.m2/repository/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar:/home/parminder/.m2/repository/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar:/home/parminder/.m2/repository/org/hibernate/javax/persistence/hibernate-jpa-2.0-api/1.0.0.Final/hibernate-jpa-2.0-api-1.0.0.Final.jar:/home/parminder/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.9/jackson-core-asl-1.9.9.jar:/home/parminder/.m2/repository/joda-time/joda-time/2.1/joda-time-2.1.jar:/home/parminder/.m2/repository/org/springframework/spring-context/3.2.0.RELEASE/spring-context-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/org/springframework/spring-aop/3.2.0.RELEASE/spring-aop-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar:/home/parminder/.m2/repository/org/springframework/spring-expression/3.2.0.RELEASE/spring-expression-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/org/springframework/spring-beans/3.2.0.RELEASE/spring-beans-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/org/springframework/spring-core/3.2.0.RELEASE/spring-core-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/org/springframework/spring-test/3.2.0.RELEASE/spring-test-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/org/springframework/spring-webmvc/3.2.0.RELEASE/spring-webmvc-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/org/springframework/spring-web/3.2.0.RELEASE/spring-web-3.2.0.RELEASE.jar:/home/parminder/.m2/repository/org/apache/commons/commons-lang3/3.1/commons-lang3-3.1.jar:/home/parminder/.m2/repository/org/slf4j/slf4j-api/1.6.1/slf4j-api-1.6.1.jar:/home/parminder/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar:/home/parminder/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/parminder/.m2/repository/junit/junit/4.11/junit-4.11.jar:/home/parminder/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/parminder/.m2/repository/org/mockito/mockito-core/1.9.5/mockito-core-1.9.5.jar:/home/parminder/.m2/repository/org/objenesis/objenesis/1.0/objenesis-1.0.jar
:
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client
environment:java.library.path=/usr/lib/jvm/jdk1.6.0_31/jre/lib/amd64/server:/usr/lib/jvm/jdk1.6.0_31/jre/lib/amd64:/usr/lib/jvm/jdk1.6.0_31/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client environment:os.name
=Linux
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client
environment:os.arch=amd64
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client
environment:os.version=3.2.0-39-generic
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client environment:user.name
=parminder
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client
environment:user.home=/home/parminder
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Client
environment:user.dir=/home/parminder/git/bigDataAnalytics/core
13/03/28 15:00:30 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=localhost:2181 sessionTimeout=180000 watcher=hconnection
13/03/28 15:00:30 INFO zookeeper.RecoverableZooKeeper: The identifier of
this process is 7431@parminder-VirtualBox
13/03/28 15:00:30 INFO zookeeper.ClientCnxn: Opening socket connection to
server localhost/127.0.0.1:2181. Will not attempt to authenticate using
SASL (Unable to locate a login configuration)
13/03/28 15:00:30 INFO zookeeper.ClientCnxn: Socket connection
established to localhost/127.0.0.1:2181, initiating session
13/03/28 15:00:30 INFO zookeeper.ClientCnxn: Session establishment
complete on server localhost/127.0.0.1:2181, sessionid =
0x13db1e5a6c60094, negotiated timeout = 40000
13/03/28 15:00:31 WARN conf.Configuration: hadoop.native.lib is
deprecated. Instead, use io.native.lib.available
13/03/28 15:00:31 WARN conf.Configuration: fs.default.name is
deprecated. Instead, use fs.defaultFS
13/03/28 15:00:31 INFO flow.FlowStep: [] submitted hadoop job:
job_201303280947_0044
13/03/28 15:02:15 INFO util.Hadoop18TapUtil: deleting temp path
hdfs://localhost:8020/user/parminder/job-/output_1364508024996/_temporary

*Hadoop Logs for HFS tap job*
2013-03-28 15:00:31,390 INFO org.apache.hadoop.mapred.JobInProgress:
job_201303280947_0044: nMaps=2 nReduces=0 max=-1
2013-03-28 15:00:31,411 INFO org.apache.hadoop.mapred.JobTracker: Job
job_201303280947_0044 added successfully for user 'parminder' to queue
'default'
2013-03-28 15:00:31,412 INFO org.apache.hadoop.mapred.JobTracker:
Initializing job_201303280947_0044
2013-03-28 15:00:31,412 INFO org.apache.hadoop.mapred.JobInProgress:
Initializing job_201303280947_0044
2013-03-28 15:00:31,480 INFO org.apache.hadoop.mapred.JobInProgress:
jobToken generated and stored with users keys in
/var/lib/hadoop-hdfs/cache/mapred/mapred/system/job_201303280947_0044/jobToken
2013-03-28 15:00:31,485 INFO org.apache.hadoop.mapred.JobInProgress:
Input size for job job_201303280947_0044 = 0. Number of splits = 2
2013-03-28 15:00:31,485 INFO org.apache.hadoop.mapred.JobInProgress:
tip:task_201303280947_0044_m_000000 has split on
node:/default-rack/localhost
2013-03-28 15:00:31,486 INFO org.apache.hadoop.mapred.JobInProgress:
tip:task_201303280947_0044_m_000001 has split on
node:/default-rack/localhost
2013-03-28 15:00:31,486 INFO org.apache.hadoop.mapred.JobInProgress:
job_201303280947_0044 LOCALITY_WAIT_FACTOR=1.0
2013-03-28 15:00:31,486 INFO org.apache.hadoop.mapred.JobInProgress: Job
job_201303280947_0044 initialized successfully with 2 map tasks and 0
reduce tasks.
2013-03-28 15:00:31,551 WARN mapreduce.Counters: Group
org.apache.hadoop.mapred.Task$Counter is deprecated. Use
org.apache.hadoop.mapreduce.TaskCounter instead
2013-03-28 15:00:31,551 INFO org.apache.hadoop.mapred.JobTracker: Adding
task (JOB_SETUP) 'attempt_201303280947_0044_m_000003_0' to tip
task_201303280947_0044_m_000003, for tracker 'tracker_localhost:localhost/
127.0.0.1:47290'
2013-03-28 15:00:34,935 WARN mapreduce.Counters: Group
org.apache.hadoop.mapred.JobInProgress$Counter is deprecated. Use
org.apache.hadoop.mapreduce.JobCounter instead
2013-03-28 15:00:34,935 INFO org.apache.hadoop.mapred.JobInProgress: Task
'attempt_201303280947_0044_m_000003_0' has completed
task_201303280947_0044_m_000003 successfully.
2013-03-28 15:00:34,938 WARN mapreduce.Counters: Group
org.apache.hadoop.mapred.Task$Counter is deprecated. Use
org.apache.hadoop.mapreduce.TaskCounter instead
2013-03-28 15:00:34,939 INFO org.apache.hadoop.mapred.JobTracker: Adding
task (MAP) 'attempt_201303280947_0044_m_000000_0' to tip
task_201303280947_0044_m_000000, for tracker 'tracker_localhost:localhost/
127.0.0.1:47290'
2013-03-28 15:00:34,939 INFO org.apache.hadoop.mapred.JobInProgress:
Choosing data-local task task_201303280947_0044_m_000000
2013-03-28 15:00:34,939 WARN mapreduce.Counters: Group
org.apache.hadoop.mapred.Task$Counter is deprecated. Use
org.apache.hadoop.mapreduce.TaskCounter instead
2013-03-28 15:00:34,939 INFO org.apache.hadoop.mapred.JobTracker: Adding
task (MAP) 'attempt_201303280947_0044_m_000001_0' to tip
task_201303280947_0044_m_000001, for tracker 'tracker_localhost:localhost/
127.0.0.1:47290'
2013-03-28 15:00:34,939 INFO org.apache.hadoop.mapred.JobInProgress:
Choosing data-local task task_201303280947_0044_m_000001
2013-03-28 15:02:03,317 INFO org.apache.hadoop.mapred.JobInProgress: Task
'attempt_201303280947_0044_m_000001_0' has completed
task_201303280947_0044_m_000001 successfully.
2013-03-28 15:02:11,822 INFO org.apache.hadoop.mapred.JobInProgress: Task
'attempt_201303280947_0044_m_000000_0' has completed
task_201303280947_0044_m_000000 successfully.
2013-03-28 15:02:11,828 WARN mapreduce.Counters: Group
org.apache.hadoop.mapred.Task$Counter is deprecated. Use
org.apache.hadoop.mapreduce.TaskCounter instead
2013-03-28 15:02:11,828 INFO org.apache.hadoop.mapred.JobTracker: Adding
task (JOB_CLEANUP) 'attempt_201303280947_0044_m_000002_0' to tip
task_201303280947_0044_m_000002, for tracker 'tracker_localhost:localhost/
127.0.0.1:47290'
2013-03-28 15:02:15,170 INFO org.apache.hadoop.mapred.JobInProgress: Task
'attempt_201303280947_0044_m_000002_0' has completed
task_201303280947_0044_m_000002 successfully.
2013-03-28 15:02:15,172 INFO org.apache.hadoop.mapred.JobInProgress: Job
job_201303280947_0044 has completed successfully.
2013-03-28 15:02:15,172 INFO
org.apache.hadoop.mapred.JobInProgress$JobSummary:
jobId=job_201303280947_0044,submitTime=1364508031359,launchTime=1364508031486,firstMapTaskLaunchTime=1364508034938,firstJobSetupTaskLaunchTime=1364508031551,firstJobCleanupTaskLaunchTime=1364508131828,finishTime=1364508135172,numMaps=2,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=parminder,queue=default,status=SUCCEEDED,mapSlotSeconds=191,reduceSlotsSeconds=0,clusterMapCapacity=50,clusterReduceCapacity=2
2013-03-28 15:02:15,199 INFO org.apache.hadoop.mapred.JobHistory: Moving
file:/var/log/hadoop-0.20-mapreduce/history/job_201303280947_0044_1364508031359_parminder_%5BBF854ED4DE34E1C11396958B1626AC22%2FD6FC0D51562C86B3
to
file:/var/log/hadoop-0.20-mapreduce/history/done/localhost_1364489234566_/2013/03/28/000000
2013-03-28 15:02:15,199 INFO org.apache.hadoop.mapred.JobTracker:
Removing task 'attempt_201303280947_0044_m_000000_0'
2013-03-28 15:02:15,199 INFO org.apache.hadoop.mapred.JobTracker:
Removing task 'attempt_201303280947_0044_m_000001_0'
2013-03-28 15:02:15,199 INFO org.apache.hadoop.mapred.JobTracker:
Removing task 'attempt_201303280947_0044_m_000002_0'
2013-03-28 15:02:15,199 INFO org.apache.hadoop.mapred.JobTracker:
Removing task 'attempt_201303280947_0044_m_000003_0'
2013-03-28 15:02:15,211 INFO org.apache.hadoop.mapred.JobHistory: Moving
file:/var/log/hadoop-0.20-mapreduce/history/localhost_1364489234566_job_201303280947_0044_conf.xml
to
file:/var/log/hadoop-0.20-mapreduce/history/done/localhost_1364489234566_/2013/03/28/000000
From the above, results from task *attempt_201303280947_0044_m_000000_0*were saved only. Anyone has any idea whats going on here?
*
*
--
You received this message because you are subscribed to the Google Groups "cascalog-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascalog-user+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Search Discussions

Discussion Posts

Previous

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 2 of 2 | next ›
Discussion Overview
groupcascalog-user @
categoriesclojure, hadoop
postedMar 28, '13 at 10:19p
activeMar 30, '13 at 8:39a
posts2
users2
websiteclojure.org
irc#clojure

2 users in discussion

Paul Lam: 1 post PK: 1 post

People

Translate

site design / logo © 2022 Grokbase