Hadoop > common-dev > June 2010

Dear all, Here I've got a question about the "io.sort.mb" parameter. We can find material from Yahoo! or Cloudera which recommend setting this value to 200 if the job scale is large, but I'm confused ...

Extend the API of NetworkTopology --------------------------------- Key: HADOOP-6827 URL: https://issues.apache.org/jira/browse/HADOOP-6827 Project: Hadoop Common Issue Type: New Feature Reporter: ...

FileStatus allows null srcPath but crashes if that's done --------------------------------------------------------- Key: HADOOP-6796 URL: https://issues.apache.org/jira/browse/HADOOP-6796 Project: ...

Hi, While using LZO compression to try to improve performance of my cluster, I found that compression didn't work. The job I run is "org.apache.hadoop.examples.Sort", with the input data generated by ...

Hi, I am interested in implementing record-aware file splitting for hadoop. I am looking for someone who knows the hadoop internals well and is willing to discuss some details of how to accomplish ...

Extract a subset of tests for smoke (DOA) validation ---------------------------------------------------- Key: HADOOP-6810 URL: https://issues.apache.org/jira/browse/HADOOP-6810 Project: Hadoop ...

hi, all I hava an idea that is similar with the issue HDFS-325. I want to reduce the impact of disk racingwhen read HDFS files. From HDFS code, I know read a block will also need access its metadata ...

Hi All, Does anybody know why Hadoop S3FileSystem doesn't set correctly file modification time when a new file is created? Is it somehow technically limited or just a bug? How can I set correct ...

Hi, I am new to hadoop programming. I am trying to copy a local file to HDFS. My code snippet is: . . Configuration conf = new Configuration(); InputStream in=null; OutputStream out = null; try { in ...

Hi Hadoopers, I have received WARN in the hadoop cluster. Has anybody seen this . Any solution? "Legal Disclaimer: This electronic message and all contents contain information from Cybage Software ...

Hi folks , I have received this error in the hadoop cluster. Has anybody anybody seen this . Any solution. --------------------- namenode errors and warning ------------------ 2010-06-17 18:35:19,970 ...

Hello, I am trying to get profiles for a workload running on top of Hadoop 0.20.2 framework. The workload jars and Hadoop jars have been compiled with debug symbols enabled. I could see local ...

I am working with complex Hive queries and moderate amounts of data. I am running into a problem where my JDBC connection is timing out before the Hive answer is returned. The timeout seems to occur ...

hi hi! i have to use HDFS in my python project and am trying to use thriftfs for it but i cant seem to launch the HadoopThriftServer via the start_thrift_server.sh script i keep getting this error ...

Hi All, I just want to know that 1. How many people are using hadoop in India for their massive data handling ? 2. What level you were achieve successful ? 3. Working with flat file system how much ...

I recently want to learn hadoop source code, I tried to setup a debugging environment in eclipse, but failed ... any one know how to setup the environment ? Goal : -Run hadoop from eclipse(MiniHdfs?) ...

[ https://issues.apache.org/jira/browse/HADOOP-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reopened HADOOP-5436: --------------------------------- Think this ...

TokenStorage renamed to Credentials. ------------------------------------ Key: HADOOP-6845 URL: https://issues.apache.org/jira/browse/HADOOP-6845 Project: Hadoop Common Issue Type: Improvement ...

Update docs to reflect new jar names ------------------------------------ Key: HADOOP-6844 URL: https://issues.apache.org/jira/browse/HADOOP-6844 Project: Hadoop Common Issue Type: Task Components: ...

Entries in the FileSystem's Cache could be cleared when they are not used ------------------------------------------------------------------------- Key: HADOOP-6843 URL: ...

"hadoop fs -text" does not give a useful text representation of MapWritable objects ----------------------------------------------------------------------------------- Key: HADOOP-6842 URL: ...

In Quick Start, mention requirement that HADOOP_HOME needs to be set -------------------------------------------------------------------- Key: HADOOP-6841 URL: ...

Support non-recursive create() in SequenceFile.Writer ----------------------------------------------------- Key: HADOOP-6840 URL: https://issues.apache.org/jira/browse/HADOOP-6840 Project: Hadoop ...

[Herriot] Implement a functionality for getting the user list for creating proxy users. --------------------------------------------------------------------------------------- Key: HADOOP-6839 URL: ...

Investigate Eclipse API Tools for enforcing or reporting on API compatibility ------------------------------------------------------------------------------ Key: HADOOP-6838 URL: ...

Support for LZMA compression ---------------------------- Key: HADOOP-6837 URL: https://issues.apache.org/jira/browse/HADOOP-6837 Project: Hadoop Common Issue Type: Improvement Components: io ...

We are getting more spams in the hadoop wiki page. How should we deal with it? Nicholas Sze Attachment size: 3746 Attachment link:

Hi , anybody know how to parallel write data to hdfs using java? I know there is a program called "distcp" could do this, see, % hadoop distcp hdfs://namenode1/foo hdfs://namenode2/bar but how can ...

Test Autoamtion : Method for restarting the daemon with new configuration. -------------------------------------------------------------------------- Key: HADOOP-6836 URL: ...

TFile.append compares initial key against null lastKey -------------------------------------------------------- Key: HADOOP-6834 URL: https://issues.apache.org/jira/browse/HADOOP-6834 Project: Hadoop ...

IPC leaks call parameters when exceptions thrown ------------------------------------------------ Key: HADOOP-6833 URL: https://issues.apache.org/jira/browse/HADOOP-6833 Project: Hadoop Common Issue ...

Provide a web server plugin that uses a static user for the web UI ------------------------------------------------------------------ Key: HADOOP-6832 URL: ...

"java.lang.ArithmeticException: Non-terminating decimal expansion; no exact representable decimal result." while running "hadoop jar hadoop-0.20.1+169.89-examples.jar pi 4 30" ...

There are currently 8 blockers for 0.21.0 (see http://bit.ly/common21blockers, http://bit.ly/hdfs21blockers, http://bit.ly/mapreduce21blockers). I'd like to get these closed early next week, so I can ...

Hello fellas, problem here. I am trying to get some runtime info in FileInputFormat.java and I try to use LOG.info(). However it never seems write anything into log file. I tried to grep the "logs" ...

Hello everyone, I am going thru source code of MapReduce. In MergeQueue.merge, I can only see the SEGMENTS are combined and sorted by length into a list for merge. However, I could not find the ...

Javadoc warnings in trunk. -------------------------- Key: HADOOP-6830 URL: https://issues.apache.org/jira/browse/HADOOP-6830 Project: Hadoop Common Issue Type: Bug Reporter: Amareshwari Sriramadasu ...

Deprecated scripts shouldn't be used by Herriot ----------------------------------------------- Key: HADOOP-6829 URL: https://issues.apache.org/jira/browse/HADOOP-6829 Project: Hadoop Common Issue ...

Herrior uses old way of accessing logs directories -------------------------------------------------- Key: HADOOP-6828 URL: https://issues.apache.org/jira/browse/HADOOP-6828 Project: Hadoop Common ...

Revert FileSystem create method that takes CreateFlags ------------------------------------------------------ Key: HADOOP-6826 URL: https://issues.apache.org/jira/browse/HADOOP-6826 Project: Hadoop ...

Hi all, I apologize first if this question has been asked before, as I had trouble viewing the archives. I am a GSoC student working on the Mahout project, and I was wondering about generating ...

FileStatus needs unit tests --------------------------- Key: HADOOP-6825 URL: https://issues.apache.org/jira/browse/HADOOP-6825 Project: Hadoop Common Issue Type: Improvement Affects Versions: 0.22.0 ...

Improve NetUtils:normalizeHostName ---------------------------------- Key: HADOOP-6824 URL: https://issues.apache.org/jira/browse/HADOOP-6824 Project: Hadoop Common Issue Type: Improvement Reporter: ...

Provide validation of security-related settings on startup ---------------------------------------------------------- Key: HADOOP-6823 URL: https://issues.apache.org/jira/browse/HADOOP-6823 Project: ...

Provide information as to whether or not security is enabled on web interface ----------------------------------------------------------------------------- Key: HADOOP-6822 URL: ...

Hello everyone I want to add some new feature to the Hadoop web interface. But I met a problem when I was compiling hadoop source code. Here is the error information: ...

Document changes to memory monitoring ------------------------------------- Key: HADOOP-6821 URL: https://issues.apache.org/jira/browse/HADOOP-6821 Project: Hadoop Common Issue Type: Bug Components: ...

RunJar fails executing thousands JARs within single JVM with error "Too many open files" ---------------------------------------------------------------------------------------- Key: HADOOP-6820 URL: ...

[Herriot] Shell command for getting the new exceptions in the logs returning exitcode 1 after executing successfully. ...

Provide a JNI-based implementation of GroupMappingServiceProvider ----------------------------------------------------------------- Key: HADOOP-6818 URL: ...