Hadoop > common-dev > May 2010

Hello. As some of you might know we have the license for great concurrency analysis software from SureLogic. SureLogic engineers gave some run for HDFS, MR, and Zookeeper code at the end of last ...

Hi, i am experimenting with hadoop. wanted to ask that is the Task distribution policy by job tracker pluggable if yes where in the code tree is it defined. Thanks and regards Saurabh Agarwal

# Shared goals - Hadoop is HDFS & Map-Reduce in this context of this set of slides # Priorities * Yahoo - Correctness - Availability: Not the same as high-availability (6 9s. etc.) i.e. SPOFs - API ...

Hi, I have Downloaded Hadoop 20.2 and untared it.. But when I copy the contents in a newly created NetBeans project, the windo w shose many errors like package not found etc.. Please help Out Saurabh ...

hi, i am trying to figure out how hadoop uses data locality to schedule maps on nodes which locally store tha map input ... going through code i am going in circles in between a couple of file but ...

hi could anyone point me to where i can download the LATE scheduler API plug in for HAdoop ... i distinctly remember reading up on work on the API in this mailing list but cant locate it on the web! ...

UserGroupInformation.createProxyUser's javadoc is broken -------------------------------------------------------- Key: HADOOP-6776 URL: https://issues.apache.org/jira/browse/HADOOP-6776 Project: ...

Create Wiki document about Herriot Test Framework and test development guide ---------------------------------------------------------------------------- Key: HADOOP-6784 URL: ...

Clean up and add documentation for configuration keys in CommonConfigurationKeys.java ------------------------------------------------------------------------------------- Key: HADOOP-6756 URL: ...

Hii.. I am toying around with hadoop configuration. I am trying to replace HDFS with a common nfsmount, I only have map tasks. so intermediate outputs need not be communicated!!! So I want is there a ...

Create a Writable class that stores a possibly incomplete list of FileStatus objects ------------------------------------------------------------------------------------ Key: HADOOP-6743 URL: ...

Move Hadoop cloud scripts to Whirr ---------------------------------- Key: HADOOP-6780 URL: https://issues.apache.org/jira/browse/HADOOP-6780 Project: Hadoop Common Issue Type: Task Components: ...

CLONE -fs -ls does not work if a path name contains the ^ character ------------------------------------------------------------------- Key: HADOOP-6793 URL: ...

Hi, I'm a novice at hadoop, and I want to install it on 3 nodes, I try to configure it by editing core-site.xml, hdfs-site.xml and mapred-site.xml that the first node is the namenode, the second is ...

Fix references to 0.22 in 0.21 branch ------------------------------------- Key: HADOOP-6785 URL: https://issues.apache.org/jira/browse/HADOOP-6785 Project: Hadoop Common Issue Type: Bug Reporter: ...

I have some issues with compiling hadoop-common, hdfs and mapreduce from source. Right now, the hdfs and mapreduce builds are broken, because of MAPREDUCE-1803 and HDFS-1166. However, even if this ...

chang UnixUserGroupInformation to use "user.name" instead of whoami ------------------------------------------------------------------- Key: HADOOP-6770 URL: ...

Hi All, Vamc here, Buddy in Hadoop I have some basic doubt on hadoop Input Data placement... Like, If i input some 30GB of data to hadoop program , it will place the 30gb into HDFS into some set of ...

Add mapred.tasktracker.tasks.maximum to limit the total number of map and reduce tasks -------------------------------------------------------------------------------------- Key: HADOOP-6749 URL: ...

UserGroupInformation incompatibility: getCurrentUGI() and setCurrentUser() missing ---------------------------------------------------------------------------------- Key: HADOOP-6750 URL: ...

Hey folks, Now that I (finally) have crafted a +1'd patch for HADOOP-6704, I'd like to do the same thing for the 0.20 branch. Should I do this in the same Jira ticket or file another ticket ...

Hi All, i am working on hadoop security wherein in the first step to authenticate users,Kerberos authentication protocol was used. Is it wise using Kerberos (version in C) or otherwise have to look ...

Move configuration and script files post split ---------------------------------------------- Key: HADOOP-6794 URL: https://issues.apache.org/jira/browse/HADOOP-6794 Project: Hadoop Common Issue ...

Ivy2.0 has bugs: let's upgrate to at 2.1.0 ------------------------------------------ Key: HADOOP-6792 URL: https://issues.apache.org/jira/browse/HADOOP-6792 Project: Hadoop Common Issue Type: Bug ...

Refresh for proxy superuser config (common part for HDFS-1096) --------------------------------------------------------------- Key: HADOOP-6791 URL: https://issues.apache.org/jira/browse/HADOOP-6791 ...

Instrumented (Herriot) build uses too wide mask to include aspect files. ------------------------------------------------------------------------ Key: HADOOP-6790 URL: ...

set-version should precede Herriot artifacts installation target ---------------------------------------------------------------- Key: HADOOP-6789 URL: ...

Factor out glob pattern code from FileContext and Filesystem ------------------------------------------------------------ Key: HADOOP-6787 URL: https://issues.apache.org/jira/browse/HADOOP-6787 ...

test-patch needs to verify Herriot integrity -------------------------------------------- Key: HADOOP-6786 URL: https://issues.apache.org/jira/browse/HADOOP-6786 Project: Hadoop Common Issue Type: ...

[ https://issues.apache.org/jira/browse/HADOOP-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved HADOOP-5271. ----------------------------------- ...

[Adding common-dev] Updated agenda: * Discuss "HEP" proposal, a mechanism for making enhancements to core Hadoop, and its implementation * Branching strategies: Development Models. Check out ...

Rename core-* configuration files to common-* --------------------------------------------- Key: HADOOP-6783 URL: https://issues.apache.org/jira/browse/HADOOP-6783 Project: Hadoop Common Issue Type: ...

TestAvroRpc fails with avro-1.3.1 and avro-1.3.2 ------------------------------------------------ Key: HADOOP-6782 URL: https://issues.apache.org/jira/browse/HADOOP-6782 Project: Hadoop Common Issue ...

security audit log shouldn't have exception in it. -------------------------------------------------- Key: HADOOP-6781 URL: https://issues.apache.org/jira/browse/HADOOP-6781 Project: Hadoop Common ...

Support for Ceph kernel client ------------------------------ Key: HADOOP-6779 URL: https://issues.apache.org/jira/browse/HADOOP-6779 Project: Hadoop Common Issue Type: New Feature Components: fs ...

add isRunning() method to AbstractDelegationTokenSecretManager (for HDFS-1044) ------------------------------------------------------------------------------- Key: HADOOP-6778 URL: ...

Update Hadoop Common Site's ---------------------------- Key: HADOOP-6775 URL: https://issues.apache.org/jira/browse/HADOOP-6775 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia ...

Namenode is not able to recover from disk full condition -------------------------------------------------------- Key: HADOOP-6774 URL: https://issues.apache.org/jira/browse/HADOOP-6774 Project: ...

Ivy folder contains redundant files ----------------------------------- Key: HADOOP-6773 URL: https://issues.apache.org/jira/browse/HADOOP-6773 Project: Hadoop Common Issue Type: Bug Components: ...

Utilities for system tests specific. ------------------------------------ Key: HADOOP-6772 URL: https://issues.apache.org/jira/browse/HADOOP-6772 Project: Hadoop Common Issue Type: Task Components: ...

Artifact id for Maven deployment should be set to hadoop-core-system-test ------------------------------------------------------------------------- Key: HADOOP-6771 URL: ...

Add an API in FileSystem to get FileSystem instances based on users ------------------------------------------------------------------- Key: HADOOP-6769 URL: ...

RPC client can response more efficiently when sendParam() got IOException ------------------------------------------------------------------------- Key: HADOOP-6768 URL: ...

Patch for running Hadoop on Windows without Cygwin -------------------------------------------------- Key: HADOOP-6767 URL: https://issues.apache.org/jira/browse/HADOOP-6767 Project: Hadoop Common ...

Spill can fail with bad call to Random -------------------------------------- Key: HADOOP-6766 URL: https://issues.apache.org/jira/browse/HADOOP-6766 Project: Hadoop Common Issue Type: Bug ...

[ https://issues.apache.org/jira/browse/HADOOP-6074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HADOOP-6074. ...

Duplicate commons-net in published POM -------------------------------------- Key: HADOOP-6765 URL: https://issues.apache.org/jira/browse/HADOOP-6765 Project: Hadoop Common Issue Type: Bug ...

Add number of reader threads and queue length as configuration parameters in RPC.getServer ------------------------------------------------------------------------------------------ Key: HADOOP-6764 ...

Hi, If I am not using the HDFS, which file has the policy to determine the Input Splits iven the job tracker and how job tacker distributes the tasks? where are these policies located. Are they ...

exception while doing RPC I/O closes channel -------------------------------------------- Key: HADOOP-6762 URL: https://issues.apache.org/jira/browse/HADOOP-6762 Project: Hadoop Common Issue Type: ...