Search Discussions

107 discussions - 546 posts

  • hello is there any utility to browse hadoop fs? Best Regards, -C.B.
    Cam BazzCam Bazz
    Jan 21, 2008 at 1:12 pm
    Jan 24, 2008 at 7:53 pm
  • Yahoo plans to host a summit / workshop on Apache Hadoop at our Sunnyvale campus on March 25th. Given the interest we are seeing from developers in a broad range of organizations, this seems like a ...
    Ajay AnandAjay Anand
    Jan 16, 2008 at 5:50 pm
    Feb 23, 2008 at 12:14 am
  • This doesn't work to solve this issue because it sets the total number of map/reduce tasks. When setting the total number of map tasks I get an ArrayOutOfBoundsException within Hadoop; I believe ...
    Xavier StevensXavier Stevens
    Jan 9, 2008 at 10:58 pm
    Jan 10, 2008 at 10:54 pm
  • Hi, If someone knows how to fix the problem described below, please help me out. Thanks! I am testing Hadoop on 2-node cluster and the "reduce" always hangs at some stage, even if I use different ...
    Yunhong Gu1Yunhong Gu1
    Jan 18, 2008 at 9:52 pm
    Jan 23, 2008 at 5:06 am
  • Hi, Some of my map tasks are killed by the tracker and give the error "Task task_200801251420_0007_m_000006_0 failed to report status for 601 seconds. Killing!" My map task is basically copy a large ...
    Rui ShiRui Shi
    Jan 28, 2008 at 11:04 pm
    Feb 6, 2008 at 6:31 pm
  • Has there been any progress / a work-around for this? Currently I'm experimenting with Streaming and I've encountered what looks like the same problem as described here: ...
    Miles OsborneMiles Osborne
    Jan 22, 2008 at 2:26 pm
    Jan 29, 2008 at 5:11 am
  • Dear colleagues; Now,I have to use HBase in my map and reduce functions, but I don't know how to use. I have seen the examples in the FQA and org.apache.hadoop.hbase. ,but I can't run it ...
    Ma qiangMa qiang
    Jan 17, 2008 at 7:38 am
    Jan 17, 2008 at 1:24 pm
  • hi, i setup a cluster with 3 slaves and 1 master. when running the wordcount example, hadoop execution halts after the mapping phase. It has started the reduce phase and generally gets to 10-20% but ...
    Florian LeibertFlorian Leibert
    Jan 29, 2008 at 2:30 am
    Mar 28, 2008 at 10:52 pm
  • I started develop the hbase matrix package and benchmarks between the Map/Reduce + Hbase environment and the R-ScaLAPACK + ScaLAPACK + LAPACK + BLACS + BLAS + MPI environment. ...
    Edward yoonEdward yoon
    Jan 25, 2008 at 3:21 pm
    Jan 31, 2008 at 1:20 am
  • Hi, I'm trying to install hadoop on a set of computers that are not exclusively dedicated to run hadoop. Our goal is to use these computers in the hadoop cluster when they are inactive (during ...
    S. NunesS. Nunes
    Jan 8, 2008 at 7:14 pm
    Jan 8, 2008 at 10:37 pm
  • 2008-01-08 08:36:20,045 ERROR org.apache.hadoop.dfs.DataNode: org.apache.hadoop.dfs.InconsistentFSStateException: Directory /var/hadoop/tmp/dfs/data is in an inconsistent state: file VERSION is ...
    Joydeep Sen SarmaJoydeep Sen Sarma
    Jan 8, 2008 at 4:51 pm
    Jan 8, 2008 at 8:13 pm
  • Hi, I have trouble setting the number of maps for a job with version 15.1. As far I understand I can configure the number of maps that a job will do in an hadoop-site.xml on the box where I submit ...
    Stefan GroschupfStefan Groschupf
    Jan 22, 2008 at 9:25 pm
    Jan 24, 2008 at 11:59 pm
  • Hi, Maybe someone here can help me with a rather noob question. Where do I have to put my custom jar to run it as a map/reduce job? Anywhere and then specifying the HADOOP_CLASSPATH variable in ...
    Lars GeorgeLars George
    Jan 7, 2008 at 4:27 pm
    Jan 8, 2008 at 2:54 am
  • Do you have data stored in HBase that you cannot recreate? HADOOP-2478 will introduce an incompatible change in how HBase lays out files in HDFS so that should the root or meta tables be corrupted, ...
    Jim KellermanJim Kellerman
    Jan 3, 2008 at 11:21 pm
    Jan 8, 2008 at 1:38 am
  • Hi! I have a novice question. I have data consisting of (Text, Long) tuples. I need to calculate sum of the values. The way I am achieving it now is mapping Text key to a constant value Text("Total") ...
    Vadim ZalivaVadim Zaliva
    Jan 15, 2008 at 9:18 pm
    Jan 16, 2008 at 5:35 am
  • fsck reports several under replicated blocks, but these do not get fixed until I restart DFS. fsck also reports a missing block at the same time, but this should affect the function of fixing under ...
    Chris KlineChris Kline
    Jan 4, 2008 at 8:33 pm
    Jan 8, 2008 at 7:47 pm
  • Hi, I have inserted about 3.5m documents in a single two column table in HBase running on 32 nodes. So far I was able to insert most data, but with the last million or so I am stuck with this error: ...
    Lars GeorgeLars George
    Jan 4, 2008 at 7:22 pm
    Jan 5, 2008 at 5:53 am
  • Hi, I am new to Hadoop. I just downloaded release 0.14.4 (hadoop-0.14.4.tar.gz) and trying to setup Hadoop on Single Machine (RedHat Linux 9) by following the link ...
    Natarajan, SenthilNatarajan, Senthil
    Jan 2, 2008 at 9:33 pm
    Jan 3, 2008 at 6:36 pm
  • Dear colleagues, Right now, I have to deploy ubuntu 7.10 + hadoop 0.15 on 16 PCs. One PC will be set as master, the others will be set as slaves. The PCs have similar hardware, or even the same ...
    Bin YANGBin YANG
    Jan 15, 2008 at 2:27 pm
    Jan 18, 2008 at 1:08 am
  • I am new to hadoop if any think wrong please correct me .... I Have configured a single/multi node cluster using following link ...
    Jan 2, 2008 at 5:10 am
    Jan 5, 2008 at 7:19 am
  • Hi, I am trying to develop a webapplication that submit jobs to HADOOP map/reduce. I have added hadoop.jar and all the dependencies to tomcat lib and deployed my webapp in tomat. But it is saying ...
    Sandhya KishoreSandhya Kishore
    Jan 21, 2008 at 6:09 am
    Mar 25, 2008 at 2:15 am
  • I've been running Hadoop 0.14.4 and, more recently, 0.15.2 on a dozen machines in our CUBiT array for the last month. During this time I have experienced two major data corruption losses on ...
    Jeff EastmanJeff Eastman
    Jan 16, 2008 at 5:33 pm
    Jan 22, 2008 at 10:50 pm
  • Hi, We've been using Hadoop streaming for the last 3-4 months and it all worked out fine except for one little problem: in some situations a hadoop reduce job gets multiple key groups and is desired ...
    Yuri PradkinYuri Pradkin
    Jan 14, 2008 at 8:33 pm
    Jan 16, 2008 at 4:51 pm
  • (Apologies for cross-posting) The Lucene PMC is pleased to announce the creation of the Mahout Machine Learning project, located at http://lucene.apache.org/mahout. Mahout's goal is to create a suite ...
    Grant IngersollGrant Ingersoll
    Jan 25, 2008 at 12:26 pm
    Feb 6, 2008 at 6:32 pm
  • If I add this to a command line as a -jobconf should it be enforced? Say I have a job that I want to run only 1 map at a time per server I have tried this and look in the job.xml file and its set ...
    Jan 2, 2008 at 7:39 pm
    Jan 3, 2008 at 5:51 am
  • Hello, I have been long interested in storing graphs, in databases, object databases and lucene like indexes. While I was watching the google lecture on clustered computing, (lecture #5) the lecturer ...
    Cam BazzCam Bazz
    Jan 28, 2008 at 11:34 am
    Feb 2, 2008 at 5:31 pm
  • I have a bunch of gzip files which I am trying to process with Hadoop task. The task fails with exception: java.io.EOFException: Unexpected end of ZLIB input stream at ...
    Vadim ZalivaVadim Zaliva
    Jan 29, 2008 at 6:34 pm
    Jan 30, 2008 at 12:20 am
  • Dear colleagues; I run the code as described below: HBaseConfiguration conf = new HBaseConfiguration(); HBaseAdmin admin = new HBaseAdmin(conf); HTableDescriptor[] tables = admin.listTables(); I see ...
    Ma qiangMa qiang
    Jan 18, 2008 at 4:17 am
    Jan 18, 2008 at 8:36 am
  • Hi, How do I make hadoop split its output? The program I am writing crawls a catalog tree from a single url, so initially the input contains only one entry. after a few iterations, it will have tens ...
    Jim the Standing BearJim the Standing Bear
    Jan 16, 2008 at 4:00 pm
    Jan 16, 2008 at 5:36 pm
  • How can I write a C++ program that reads two text files (MatriX1 and Matrix2), multiplies the two matrices, and writes the result in a text file (Matrix3) using Hadoop? -- View this message in ...
    Jan 26, 2008 at 2:22 am
    Feb 7, 2008 at 12:19 pm
  • Hi , While inserting the data into Hbase , timestamp is giving problem. Hbase select * from test; +-------------------------+-------------------------+-------------------------+ ...
    Peeyush BishnoiPeeyush Bishnoi
    Jan 31, 2008 at 2:59 pm
    Feb 1, 2008 at 6:41 am
  • I have seen that hbase can cause "too many open file" errors. I increase my limit to 10240 (10 times the previous limit) but still get errors. Is there a recommended value that I should set my open ...
    Marc HarrisMarc Harris
    Jan 28, 2008 at 3:12 pm
    Jan 28, 2008 at 8:58 pm
  • I tried to find more details on speculative task execution on hadoop site and mailing archive, but it didn't seem to get explained a lot. I'd appreciate if anybody can help me on following related ...
    Eric ZhangEric Zhang
    Jan 23, 2008 at 1:57 am
    Jan 23, 2008 at 8:11 pm
  • Are there any restrictions on the string that can be used as the key for an hbase row? I ask because I am using strings of the form: <URL <space <alphanumerics <comma <numerics and I frequently get ...
    Marc HarrisMarc Harris
    Jan 22, 2008 at 5:09 pm
    Jan 22, 2008 at 6:28 pm
  • Hello, I'm trying to get Hadoop to process a 2 gig file but it seems to only be processing the first block. I'm running the exact Hadoop vmware image that is available here ...
    Matt HerndonMatt Herndon
    Jan 18, 2008 at 3:47 pm
    Jan 18, 2008 at 5:56 pm
  • I am using hadoop 0.15.1 to index some catalog that has a tree-like structure, where the leaf nodes are data files. My main task is a loop that performs a breadth-first walkthrough that parses out ...
    Jim the Standing BearJim the Standing Bear
    Jan 16, 2008 at 5:54 am
    Jan 16, 2008 at 1:36 pm
  • Hi, I'm running into a problem where IdentityMapper seems to produce way too much data. For example, I have a job that reads a sequence file using IdentityMapper and then uses IdentityReducer to ...
    Mike ForrestMike Forrest
    Jan 10, 2008 at 10:51 pm
    Jan 10, 2008 at 11:44 pm
  • Hello, When launching a map-reduce job, I am interested in copying a certain file to the datanodes, but not HDFS - the local file system, so I can access that file from my job on the datanode. (The ...
    Jan 24, 2008 at 4:06 pm
    Jan 30, 2008 at 1:06 pm
  • Is anyone else having the same problems as me with regard to frequently seeing "NotServingRegionException" and "IllegalStateException: region offline" exceptions when trying to load data into an ...
    Marc HarrisMarc Harris
    Jan 24, 2008 at 8:25 pm
    Jan 25, 2008 at 6:45 pm
  • I connect to HBase using HBaseAdmin and HTable class succefully, suddenly can't manipulate HBase and the error print as belows: java.net.SocketTimeoutException: timed out waiting for rpc response at ...
    Ma qiangMa qiang
    Jan 24, 2008 at 5:19 am
    Jan 24, 2008 at 6:56 am
  • Dear colleagues, As we know, hadoop uses ssh to connect other nodes. It is a little inconvenient, because it requires me type the password for each nodes. I find ssh can disable the password ...
    Bin YANGBin YANG
    Jan 23, 2008 at 7:09 am
    Jan 24, 2008 at 4:16 am
  • What is needed to back up an hbase "instance"? I am working on a project and I want to add things to my code incrementally. When something works, I want to be able to take the entire hbase database, ...
    Marc HarrisMarc Harris
    Jan 23, 2008 at 10:32 pm
    Jan 24, 2008 at 12:30 am
  • Dear colleagues: I use eclipse to develop some programs in hadoop, when exceptions took place such as death cycle, I don't know how to terminate it safely. Can you tell me? Thank you very much! Best ...
    Ma qiangMa qiang
    Jan 21, 2008 at 7:37 am
    Jan 21, 2008 at 5:30 pm
  • I'm trying to run the rand-sort benchmark on my cluster, but i see to be running out of heap space. I changed the heap parameter in hadoop-env.sh to HADOOP_HEAPSIZE=3000, did i not change the write ...
    Michael Di DomenicoMichael Di Domenico
    Jan 30, 2008 at 9:45 pm
    Jan 31, 2008 at 1:15 am
  • Firstly, if it is inappropriate to post this here, please accept my apologies and let me know. On behalf of my company, I am evaluating Hbase for use with a development project. The description of ...
    Marc HarrisMarc Harris
    Jan 29, 2008 at 6:31 pm
    Jan 29, 2008 at 10:04 pm
  • Hello, After updating to the latest trunk version, I find that jobs that use a mapper extending from TableMap now fail with: Exception in thread "main" java.io.IOException: Expecting at least one ...
    Mike ForrestMike Forrest
    Jan 23, 2008 at 10:54 pm
    Jan 27, 2008 at 7:49 pm
  • Hi, From a performance/architecture perspective, what is better, one Hbase table with 100m rows or 10 tables with 10m each (r an even smaller max number per table)? Thanks, Lars
    Lars GeorgeLars George
    Jan 22, 2008 at 5:14 pm
    Jan 27, 2008 at 8:40 am
  • Hi, I am very new to Hadoop, and I have a project where I need to use Lucene to index some input given either as a a huge collection of Java objects or one huge java object. I read about Hadoop's ...
    Roger dimitriRoger dimitri
    Jan 25, 2008 at 1:00 am
    Jan 25, 2008 at 6:11 pm
  • Hey all, Some months ago I decided to poke around deeper with Hadoop, after having been a Nutch user for some time. After way to much of the aforementioned poking, I decided to give my work a name, a ...
    Chris K WenselChris K Wensel
    Jan 22, 2008 at 3:47 am
    Jan 23, 2008 at 8:40 pm
  • I been getting these errors from time to time seams like when the region servers are under a load for long time they start failing with this error. nit all at the same time but it happens on ...
    Jan 19, 2008 at 8:00 pm
    Jan 19, 2008 at 11:20 pm
Group Navigation
period‹ prev | Jan 2008 | next ›
Group Overview
groupcommon-user @

113 users for January 2008

Ted Dunning: 56 posts Ma qiang: 26 posts Stack: 22 posts Joydeep Sen Sarma: 21 posts Lars George: 20 posts Jason Venner: 16 posts Vadim Zaliva: 14 posts Edward yoon: 13 posts Marc Harris: 12 posts Miles Osborne: 12 posts Doug Cutting: 11 posts Edward yoon: 11 posts Jeff Eastman: 11 posts Arun C Murthy: 10 posts Arun C Murthy: 10 posts Billy Pearson: 10 posts Yunhong Gu1: 10 posts Khalil Honsali: 9 posts Mike Forrest: 8 posts Amar Kamat: 7 posts
show more