org.apache.hHadoop.hbase.client.ScannerTimeoutException: 68004ms passed since the last invocation, timeout is currently set to 60000

Hi Mike,

(Adding cdh-user)

Can you please include some information on your error message? I just see
your command.

Thanks,
Darren

Thanks for the quick response, Darren.

Here is the error messages.

13/03/18 20:13:06 INFO mapred.JobClient: map 0% reduce 0%
13/03/18 20:14:18 INFO mapred.JobClient: Task Id :
attempt_201303121738_0009_m_000000_0, Status : FAILED
org.apache.hadoop.hbase.client.ScannerTimeoutException: 61162ms passed
since the last invocation, timeout is currently set to 60000
at
org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1302)
at
org.apache.hadoop.hbase.mapreduce.TableRecordReaderImpl.nextKeyValue(TableRecordReaderImpl.java:151)
at
org.apache.hadoop.hbase.mapreduce.TableRecordReader.nextKeyValue(TableRecordReader.java:142)
at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:458)
at
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:76)
at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:85)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:139)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:645)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.S
attempt_201303121738_0009_m_000000_0: log4j:WARN No appenders could be
found for logger (org.apache.hadoop.hdfs.DFSClient).
attempt_201303121738_0009_m_000000_0: log4j:WARN Please initialize the
log4j system properly.
attempt_201303121738_0009_m_000000_0: log4j:WARN See
http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
13/03/18 20:15:33 INFO mapred.JobClient: Task Id :
attempt_201303121738_0009_m_000000_1, Status : FAILED
org.apache.hadoop.hbase.client.ScannerTimeoutException: 67691ms passed
since the last invocation, timeout is currently set to 60000
at
org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1302)
at
org.apache.hadoop.hbase.mapreduce.TableRecordReaderImpl.nextKeyValue(TableRecordReaderImpl.java:151)
at
org.apache.hadoop.hbase.mapreduce.TableRecordReader.nextKeyValue(TableRecordReader.java:142)
at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:458)
at
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:76)
at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:85)

Thanks

Mike,

What is your scanner caching set at?

Hi Kevin,

HBase Client Scanner Caching is set to 4000.


Thanks

Hi Mike,

That is really high. You are pulling 4000 rows into cache at a time.
You probably cannot parse that many. Try lowering that to 100 and
see what happens.