FAQ
[ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

lohit vijayarenu updated HADOOP-2027:
-------------------------------------

Attachment: HADOOP-2027-1.patch

Thanks Owen. Attached patch includes
1. new API getFileBlockLocations which invokes getBlockLocations to return BlockLocation[]
2. Changes FileSplit to store host information and return when getLocations() is invoked
3. Change FileInputFormat to one call of getFileBlockLocations and store host information in FileSplit using new constructor

I ran the unit test and do not see failures. Will test benchmark and report the timings.
FileSystem should provide byte ranges for file locations
--------------------------------------------------------

Key: HADOOP-2027
URL: https://issues.apache.org/jira/browse/HADOOP-2027
Project: Hadoop Core
Issue Type: Bug
Components: fs
Reporter: Owen O'Malley
Assignee: lohit vijayarenu
Attachments: HADOOP-2027-1.patch


FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
{code}
BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
{code}
and adding
{code}
class BlockLocation implements Writable {
String[] getHosts();
long getOffset();
long getLength();
}
{code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • lohit vijayarenu (JIRA) at Feb 12, 2008 at 1:41 am
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Status: Patch Available (was: Open)

    Making this PA
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Owen O'Malley (JIRA) at Feb 12, 2008 at 5:29 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Owen O'Malley updated HADOOP-2027:
    ----------------------------------

    Status: Open (was: Patch Available)

    You should deprecate the old FileSplit constructor and make it call the new one.

    Set hosts to null in readFields.
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 13, 2008 at 9:22 am
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Status: Patch Available (was: Open)
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 13, 2008 at 9:22 am
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Attachment: HADOOP-2027-2.patch

    Incorporating changes suggested by Owen, removed javac warnings which were due to deprecated calls. I could not get rid of 2 of them which were deprecated calls to Kosmos FileSystem. I am submitting this patch for QA run. Will either try to get those fixed or open new JIRA to fix it
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 13, 2008 at 9:50 am
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Attachment: HADOOP-2027-3.patch

    Resubmitting against latest trunk
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 13, 2008 at 5:31 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Attachment: HADOOP-2027-4.patch

    Another try fixing findbugs
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 13, 2008 at 7:59 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Attachment: HADOOP-2027-5.patch

    I deprecated KFS getFileCacheHints and modified KFSEmulationImpl to call local Filesytems getFileBlockLocations
    There are few javac warnings, which are due to other deprecated APIs like listPaths globPaths. I am attaching this patch against trunk
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch, HADOOP-2027-5.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 13, 2008 at 8:29 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Status: Open (was: Patch Available)

    Canceling and resubmitting patch
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch, HADOOP-2027-5.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 13, 2008 at 8:29 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Status: Patch Available (was: Open)
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch, HADOOP-2027-5.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 13, 2008 at 9:57 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Status: Open (was: Patch Available)

    I missed BlockLocations.java (new file) so build failed. I will resubmit it
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch, HADOOP-2027-5.patch, HADOOP-2027-6.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 13, 2008 at 9:57 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Attachment: HADOOP-2027-6.patch
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch, HADOOP-2027-5.patch, HADOOP-2027-6.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 13, 2008 at 9:59 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Status: Patch Available (was: Open)
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch, HADOOP-2027-5.patch, HADOOP-2027-6.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 27, 2008 at 6:12 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Attachment: HADOOP-2027-7.patch

    Attaching same patch by regenerating against trunk.
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch, HADOOP-2027-5.patch, HADOOP-2027-6.patch, HADOOP-2027-7.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 27, 2008 at 6:18 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Attachment: HADOOP-2027-8.patch

    sorry had missed BlockLocation again :)

    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch, HADOOP-2027-5.patch, HADOOP-2027-6.patch, HADOOP-2027-7.patch, HADOOP-2027-8.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 28, 2008 at 9:00 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Status: Open (was: Patch Available)

    Uploading new one with comments from dhruba.
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch, HADOOP-2027-5.patch, HADOOP-2027-6.patch, HADOOP-2027-7.patch, HADOOP-2027-8.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 28, 2008 at 9:02 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Status: Patch Available (was: Open)

    making this PA
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch, HADOOP-2027-5.patch, HADOOP-2027-6.patch, HADOOP-2027-7.patch, HADOOP-2027-8.patch, HADOOP-2027-9.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 28, 2008 at 9:02 pm
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Attachment: HADOOP-2027-9.patch

    Dhurba suggested it would be good to have information about host:port which is already provided by namenode call.
    So i have one more API getNames() which is similar to DatanodeID's getName, this returns hostname:port and getHosts() returns hostnames as earlier. He suggest this is useful when we consider running 2 datanodes on same node. Attached is the patch which address this.
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch, HADOOP-2027-5.patch, HADOOP-2027-6.patch, HADOOP-2027-7.patch, HADOOP-2027-8.patch, HADOOP-2027-9.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 29, 2008 at 7:29 am
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Attachment: HADOOP-2027-10.patch

    Regenerating against trunk. Tested this patch, applies clean on trunk.
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-10.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch, HADOOP-2027-5.patch, HADOOP-2027-6.patch, HADOOP-2027-7.patch, HADOOP-2027-8.patch, HADOOP-2027-9.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 29, 2008 at 7:29 am
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Status: Open (was: Patch Available)
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-10.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch, HADOOP-2027-5.patch, HADOOP-2027-6.patch, HADOOP-2027-7.patch, HADOOP-2027-8.patch, HADOOP-2027-9.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • lohit vijayarenu (JIRA) at Feb 29, 2008 at 7:31 am
    [ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    lohit vijayarenu updated HADOOP-2027:
    -------------------------------------

    Status: Patch Available (was: Open)
    FileSystem should provide byte ranges for file locations
    --------------------------------------------------------

    Key: HADOOP-2027
    URL: https://issues.apache.org/jira/browse/HADOOP-2027
    Project: Hadoop Core
    Issue Type: Bug
    Components: fs
    Reporter: Owen O'Malley
    Assignee: lohit vijayarenu
    Attachments: HADOOP-2027-1.patch, HADOOP-2027-10.patch, HADOOP-2027-2.patch, HADOOP-2027-3.patch, HADOOP-2027-4.patch, HADOOP-2027-5.patch, HADOOP-2027-6.patch, HADOOP-2027-7.patch, HADOOP-2027-8.patch, HADOOP-2027-9.patch


    FileSystem's getFileCacheHints should be replaced with something more useful. I'd suggest replacing getFileCacheHints with a new method:
    {code}
    BlockLocation[] getFileLocations(Path file, long offset, long range) throws IOException;
    {code}
    and adding
    {code}
    class BlockLocation implements Writable {
    String[] getHosts();
    long getOffset();
    long getLength();
    }
    {code}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedFeb 9, '08 at 9:16a
activeFeb 29, '08 at 7:31a
posts21
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

lohit vijayarenu (JIRA): 21 posts

People

Translate

site design / logo © 2022 Grokbase