Grokbase Groups Pig dev August 2012
FAQ
Cheolsoo Park created PIG-2860:
----------------------------------

Summary: TestAvroStorageUtils.testGetConcretePathFromGlob fails on some version of hadoop
Key: PIG-2860
URL: https://issues.apache.org/jira/browse/PIG-2860
Project: Pig
Issue Type: Bug
Components: piggybank
Affects Versions: 0.10.0
Reporter: Cheolsoo Park
Assignee: Cheolsoo Park
Fix For: 0.11


I found that TestAvroStorageUtils.testGetConcretePathFromGlob fails on some versions of hadoop (not ones that upstream Pig is currently using) with the following error:

{code}
Call From localhost.localdomain/127.0.0.1 to localhost.localdomain:55883 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
java.net.ConnectException: Call From localhost.localdomain/127.0.0.1 to localhost.localdomain:55883 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:722)
at org.apache.hadoop.ipc.Client.call(Client.java:1164)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:195)
at $Proxy12.getFileInfo(Unknown Source)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
at $Proxy12.getFileInfo(Unknown Source)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:613)
at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1399)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:740)
at org.apache.hadoop.fs.FileSystem.getFileStatus(FileSystem.java:2083)
at org.apache.hadoop.fs.FileSystem.globStatusInternal(FileSystem.java:1547)
at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1488)
at org.apache.pig.piggybank.storage.avro.AvroStorageUtils.getConcretePathFromGlob(AvroStorageUtils.java:146)
at org.apache.pig.piggybank.test.storage.avro.TestAvroStorageUtils.testGetConcretePathFromGlob(TestAvroStorageUtils.java:142)
{code}

The fix is to explicitly add the URI scheme "file://" to the path that is used in the test.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

Search Discussions

  • Cheolsoo Park (JIRA) at Aug 6, 2012 at 11:46 pm
    [ https://issues.apache.org/jira/browse/PIG-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Cheolsoo Park updated PIG-2860:
    -------------------------------

    Attachment: PIG-2860.patch
    TestAvroStorageUtils.testGetConcretePathFromGlob fails on some version of hadoop
    --------------------------------------------------------------------------------

    Key: PIG-2860
    URL: https://issues.apache.org/jira/browse/PIG-2860
    Project: Pig
    Issue Type: Bug
    Components: piggybank
    Affects Versions: 0.10.0
    Reporter: Cheolsoo Park
    Assignee: Cheolsoo Park
    Fix For: 0.11

    Attachments: PIG-2860.patch


    I found that TestAvroStorageUtils.testGetConcretePathFromGlob fails on some versions of hadoop (not ones that upstream Pig is currently using) with the following error:
    {code}
    Call From localhost.localdomain/127.0.0.1 to localhost.localdomain:55883 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
    java.net.ConnectException: Call From localhost.localdomain/127.0.0.1 to localhost.localdomain:55883 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
    at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:722)
    at org.apache.hadoop.ipc.Client.call(Client.java:1164)
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:195)
    at $Proxy12.getFileInfo(Unknown Source)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
    at $Proxy12.getFileInfo(Unknown Source)
    at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:613)
    at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1399)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:740)
    at org.apache.hadoop.fs.FileSystem.getFileStatus(FileSystem.java:2083)
    at org.apache.hadoop.fs.FileSystem.globStatusInternal(FileSystem.java:1547)
    at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1488)
    at org.apache.pig.piggybank.storage.avro.AvroStorageUtils.getConcretePathFromGlob(AvroStorageUtils.java:146)
    at org.apache.pig.piggybank.test.storage.avro.TestAvroStorageUtils.testGetConcretePathFromGlob(TestAvroStorageUtils.java:142)
    {code}
    The fix is to explicitly add the URI scheme "file://" to the path that is used in the test.
    --
    This message is automatically generated by JIRA.
    If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
    For more information on JIRA, see: http://www.atlassian.com/software/jira
  • Cheolsoo Park (JIRA) at Aug 6, 2012 at 11:50 pm
    [ https://issues.apache.org/jira/browse/PIG-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13429586#comment-13429586 ]

    Cheolsoo Park commented on PIG-2860:
    ------------------------------------

    Review board:
    https://reviews.apache.org/r/6412/
    TestAvroStorageUtils.testGetConcretePathFromGlob fails on some version of hadoop
    --------------------------------------------------------------------------------

    Key: PIG-2860
    URL: https://issues.apache.org/jira/browse/PIG-2860
    Project: Pig
    Issue Type: Bug
    Components: piggybank
    Affects Versions: 0.10.0
    Reporter: Cheolsoo Park
    Assignee: Cheolsoo Park
    Fix For: 0.11

    Attachments: PIG-2860.patch


    I found that TestAvroStorageUtils.testGetConcretePathFromGlob fails on some versions of hadoop (not ones that upstream Pig is currently using) with the following error:
    {code}
    Call From localhost.localdomain/127.0.0.1 to localhost.localdomain:55883 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
    java.net.ConnectException: Call From localhost.localdomain/127.0.0.1 to localhost.localdomain:55883 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
    at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:722)
    at org.apache.hadoop.ipc.Client.call(Client.java:1164)
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:195)
    at $Proxy12.getFileInfo(Unknown Source)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
    at $Proxy12.getFileInfo(Unknown Source)
    at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:613)
    at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1399)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:740)
    at org.apache.hadoop.fs.FileSystem.getFileStatus(FileSystem.java:2083)
    at org.apache.hadoop.fs.FileSystem.globStatusInternal(FileSystem.java:1547)
    at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1488)
    at org.apache.pig.piggybank.storage.avro.AvroStorageUtils.getConcretePathFromGlob(AvroStorageUtils.java:146)
    at org.apache.pig.piggybank.test.storage.avro.TestAvroStorageUtils.testGetConcretePathFromGlob(TestAvroStorageUtils.java:142)
    {code}
    The fix is to explicitly add the URI scheme "file://" to the path that is used in the test.
    --
    This message is automatically generated by JIRA.
    If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
    For more information on JIRA, see: http://www.atlassian.com/software/jira
  • Cheolsoo Park (JIRA) at Aug 6, 2012 at 11:52 pm
    [ https://issues.apache.org/jira/browse/PIG-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Cheolsoo Park updated PIG-2860:
    -------------------------------

    Status: Patch Available (was: Open)
    TestAvroStorageUtils.testGetConcretePathFromGlob fails on some version of hadoop
    --------------------------------------------------------------------------------

    Key: PIG-2860
    URL: https://issues.apache.org/jira/browse/PIG-2860
    Project: Pig
    Issue Type: Bug
    Components: piggybank
    Affects Versions: 0.10.0
    Reporter: Cheolsoo Park
    Assignee: Cheolsoo Park
    Fix For: 0.11

    Attachments: PIG-2860.patch


    I found that TestAvroStorageUtils.testGetConcretePathFromGlob fails on some versions of hadoop (not ones that upstream Pig is currently using) with the following error:
    {code}
    Call From localhost.localdomain/127.0.0.1 to localhost.localdomain:55883 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
    java.net.ConnectException: Call From localhost.localdomain/127.0.0.1 to localhost.localdomain:55883 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
    at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:722)
    at org.apache.hadoop.ipc.Client.call(Client.java:1164)
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:195)
    at $Proxy12.getFileInfo(Unknown Source)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
    at $Proxy12.getFileInfo(Unknown Source)
    at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:613)
    at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1399)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:740)
    at org.apache.hadoop.fs.FileSystem.getFileStatus(FileSystem.java:2083)
    at org.apache.hadoop.fs.FileSystem.globStatusInternal(FileSystem.java:1547)
    at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1488)
    at org.apache.pig.piggybank.storage.avro.AvroStorageUtils.getConcretePathFromGlob(AvroStorageUtils.java:146)
    at org.apache.pig.piggybank.test.storage.avro.TestAvroStorageUtils.testGetConcretePathFromGlob(TestAvroStorageUtils.java:142)
    {code}
    The fix is to explicitly add the URI scheme "file://" to the path that is used in the test.
    --
    This message is automatically generated by JIRA.
    If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
    For more information on JIRA, see: http://www.atlassian.com/software/jira
  • Jonathan Coveney (JIRA) at Aug 9, 2012 at 4:54 pm
    [ https://issues.apache.org/jira/browse/PIG-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13431971#comment-13431971 ]

    Jonathan Coveney commented on PIG-2860:
    ---------------------------------------

    +1

    Thanks Chelsoo!
    TestAvroStorageUtils.testGetConcretePathFromGlob fails on some version of hadoop
    --------------------------------------------------------------------------------

    Key: PIG-2860
    URL: https://issues.apache.org/jira/browse/PIG-2860
    Project: Pig
    Issue Type: Bug
    Components: piggybank
    Affects Versions: 0.10.0
    Reporter: Cheolsoo Park
    Assignee: Cheolsoo Park
    Fix For: 0.11

    Attachments: PIG-2860.patch


    I found that TestAvroStorageUtils.testGetConcretePathFromGlob fails on some versions of hadoop (not ones that upstream Pig is currently using) with the following error:
    {code}
    Call From localhost.localdomain/127.0.0.1 to localhost.localdomain:55883 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
    java.net.ConnectException: Call From localhost.localdomain/127.0.0.1 to localhost.localdomain:55883 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
    at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:722)
    at org.apache.hadoop.ipc.Client.call(Client.java:1164)
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:195)
    at $Proxy12.getFileInfo(Unknown Source)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
    at $Proxy12.getFileInfo(Unknown Source)
    at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:613)
    at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1399)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:740)
    at org.apache.hadoop.fs.FileSystem.getFileStatus(FileSystem.java:2083)
    at org.apache.hadoop.fs.FileSystem.globStatusInternal(FileSystem.java:1547)
    at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1488)
    at org.apache.pig.piggybank.storage.avro.AvroStorageUtils.getConcretePathFromGlob(AvroStorageUtils.java:146)
    at org.apache.pig.piggybank.test.storage.avro.TestAvroStorageUtils.testGetConcretePathFromGlob(TestAvroStorageUtils.java:142)
    {code}
    The fix is to explicitly add the URI scheme "file://" to the path that is used in the test.
    --
    This message is automatically generated by JIRA.
    If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
    For more information on JIRA, see: http://www.atlassian.com/software/jira
  • Cheolsoo Park (JIRA) at Aug 13, 2012 at 8:28 pm
    [ https://issues.apache.org/jira/browse/PIG-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Cheolsoo Park updated PIG-2860:
    -------------------------------

    Resolution: Fixed
    Status: Resolved (was: Patch Available)

    Closing it since the patch is committed.

    Thanks Jonathan for committing my patch!
    TestAvroStorageUtils.testGetConcretePathFromGlob fails on some version of hadoop
    --------------------------------------------------------------------------------

    Key: PIG-2860
    URL: https://issues.apache.org/jira/browse/PIG-2860
    Project: Pig
    Issue Type: Bug
    Components: piggybank
    Affects Versions: 0.10.0
    Reporter: Cheolsoo Park
    Assignee: Cheolsoo Park
    Fix For: 0.11

    Attachments: PIG-2860.patch


    I found that TestAvroStorageUtils.testGetConcretePathFromGlob fails on some versions of hadoop (not ones that upstream Pig is currently using) with the following error:
    {code}
    Call From localhost.localdomain/127.0.0.1 to localhost.localdomain:55883 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
    java.net.ConnectException: Call From localhost.localdomain/127.0.0.1 to localhost.localdomain:55883 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
    at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:722)
    at org.apache.hadoop.ipc.Client.call(Client.java:1164)
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:195)
    at $Proxy12.getFileInfo(Unknown Source)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
    at $Proxy12.getFileInfo(Unknown Source)
    at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:613)
    at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1399)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:740)
    at org.apache.hadoop.fs.FileSystem.getFileStatus(FileSystem.java:2083)
    at org.apache.hadoop.fs.FileSystem.globStatusInternal(FileSystem.java:1547)
    at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1488)
    at org.apache.pig.piggybank.storage.avro.AvroStorageUtils.getConcretePathFromGlob(AvroStorageUtils.java:146)
    at org.apache.pig.piggybank.test.storage.avro.TestAvroStorageUtils.testGetConcretePathFromGlob(TestAvroStorageUtils.java:142)
    {code}
    The fix is to explicitly add the URI scheme "file://" to the path that is used in the test.
    --
    This message is automatically generated by JIRA.
    If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
    For more information on JIRA, see: http://www.atlassian.com/software/jira

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
categoriespig, hadoop
postedAug 6, '12 at 11:44p
activeAug 13, '12 at 8:28p
posts6
users1
websitepig.apache.org

1 user in discussion

Cheolsoo Park (JIRA): 6 posts

People

Translate

site design / logo © 2022 Grokbase