FAQ
Jaka Jancar created HADOOP-8870:
-----------------------------------

Summary: NullPointerException when glob doesn't return files
Key: HADOOP-8870
URL: https://issues.apache.org/jira/browse/HADOOP-8870
Project: Hadoop Common
Issue Type: Bug
Components: fs, fs/s3
Affects Versions: 1.0.3, 0.20.205.0
Reporter: Jaka Jancar


Reading

{code}s3n://bucket/{a/*,b/*,c/*}{code}

if one of the globs matches nothing, I get:

{code}
Exception in thread "main" java.lang.NullPointerException
at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:992)
at org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:177)
at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:208)
at spark.HadoopRDD.(SparkContext.scala:186)
at spark.SparkContext.textFile(SparkContext.scala:155)
at com.celtra.analyzer.LogAnalyzer.analyzeSufficientS3Logs(LogAnalyzer.scala:52)
at com.celtra.analyzer.App$.main(App.scala:164)
at com.celtra.analyzer.App.main(App.scala)
{code}

I'm not sure whether this is specific to S3 or all filesystems.

This was occuring in 0.20.205 and I confirmed it's still present in 1.0.3.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedOct 2, '12 at 9:51a
activeOct 2, '12 at 9:51a
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Jaka Jancar (JIRA): 1 post

People

Translate

site design / logo © 2021 Grokbase